Hello,I have a relatively simple python program that works just find in local
most (--master local) but produces a strange error when I try to run it via
Yarn ( --deploy-mode client --master yarn) or just execute the code through
pyspark.Here's the code:sc = SparkContext(appName="foo")input =
sc.textFile("hdfs://[valid hdfs path]")mappedToLines = input.map(lambda
myline: myline.split(","))The third line yields this error:TypeError: 'bool'
object is not callableBut "myline" seems to be a valid string if I look at
it this way:>>> mappedToLines = input.map(lambda myline: len(myline))>>>
mappedToLines.collect()[84, 104, 109, 89, 108, 92, 89, 90, 93, 102]I just
now have access to a Hadoop cluster with Spark installed, so hopefully I'm
running into some simple issues that I never had to deal with when testing
in my own sandbox in purely local mode before. Any help would be
appreciated, thanks! -Aaron
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Python-script-runs-fine-in-local-mode-errors-in-other-modes-tp12390.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
