Could you post the completed stacktrace? On Tue, Aug 19, 2014 at 10:47 AM, Aaron <aaron.doss...@target.com> wrote: > Hello, I have a relatively simple python program that works just find in > local most (--master local) but produces a strange error when I try to run > it via Yarn ( --deploy-mode client --master yarn) or just execute the code > through pyspark. Here's the code: sc = SparkContext(appName="foo") input = > sc.textFile("hdfs://[valid hdfs path]") mappedToLines = input.map(lambda > myline: myline.split(",")) The third line yields this error: TypeError: > 'bool' object is not callable But "myline" seems to be a valid string if I > look at it this way: >>> mappedToLines = input.map(lambda myline: > len(myline)) >>> mappedToLines.collect() [84, 104, 109, 89, 108, 92, 89, 90, > 93, 102] I just now have access to a Hadoop cluster with Spark installed, so > hopefully I'm running into some simple issues that I never had to deal with > when testing in my own sandbox in purely local mode before. Any help would > be appreciated, thanks! -Aaron > ________________________________ > View this message in context: Python script runs fine in local mode, errors > in other modes > Sent from the Apache Spark User List mailing list archive at Nabble.com.
--------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org