Re: lowerupperBound not working/spark 1.3

2015-06-14 Thread Sujeevan
se_staging.exp_table3 where cs_id = 1 and cs_id = 1) as exp_table3new ,columnName=cs_id,lowerBound=1 ,upperBound = 1, numPartitions=12 ) Best Regards, Sujeevan. N On Mon, Mar 23, 2015 at 4:02 AM, Ted Yu yuzhih...@gmail.com wrote: I went over JDBCRelation#columnPartition() but didn't find

Re: what is the best way to transfer data from RDBMS to spark?

2015-04-25 Thread Sujeevan
to spark, then you'll have to explore other options which depends on the datatype. For e.g. Spark RedShift integration http://spark-packages.org/package/databricks/spark-redshift Best Regards, Sujeevan. N On Sat, Apr 25, 2015 at 4:24 PM, ayan guha guha.a...@gmail.com wrote: Actually, Spark SQL

[no subject]

2015-01-03 Thread Sujeevan
Best Regards, Sujeevan. N