It's not possible currently to write anything other than text (or pickle files I think in 1.0.0 or if not then in 1.0.1) from PySpark.
I have an outstanding pull request to add READING any InputFormat from PySpark, and after that is in I will look into OutputFormat too. What does your data look like? Any details about your use case that you could share would aid the design of this feature. N On Wed, May 28, 2014 at 3:00 PM, gaurav.dasgupta <gaurav.d...@gmail.com>wrote: > Hi, > > I am unable to understand how to write data directly on HBase table from a > Spark (pyspark) Python program. Is this possible in the current Spark > releases? If so, can someone provide an example code snippet to do this? > > Thanks in advance. > > Regards, > Gaurav > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Writing-RDDs-from-Python-Spark-progrma-pyspark-to-HBase-tp6469.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
