Re: Using Hadoop InputFormat in Python

2014-08-14 Thread Tassilo Klein
and then using sc.newAPIHadoopFile(path, myCustomFullyQualifiedPackageName.ClassName, .) However, that didn't work as it couldn't find the class. Any other idea? Thanks so far, -Tassilo -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop

Re: Using Hadoop InputFormat in Python

2014-08-14 Thread Kan Zhang
.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067p12092.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e

Re: Using Hadoop InputFormat in Python

2014-08-14 Thread TJ Klein
Yes, thanks great. This seems to be the issue. At least running with spark-submit works as well. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067p12126.html Sent from the Apache Spark User List mailing list archive

Using Hadoop InputFormat in Python

2014-08-13 Thread Tassilo Klein
not sure how to use that in combination with my custom InputFormat. Does anybody have a short snipped of code how to do it? Thanks in advance. Best, Tassilo -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067.html Sent from

Re: Using Hadoop InputFormat in Python

2014-08-13 Thread Sunny Khatri
, I am not sure how to use that in combination with my custom InputFormat. Does anybody have a short snipped of code how to do it? Thanks in advance. Best, Tassilo -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop-InputFormat-in-Python

Re: Using Hadoop InputFormat in Python

2014-08-13 Thread Kan Zhang
.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h

Re: Using Hadoop InputFormat in Python

2014-08-13 Thread Tassilo Klein
in context: http://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067p12069.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr