lower and upper offset not working in spark with mysql database

2015-07-05 Thread Hafiz Mujadid
Hi all! I am trying to read records from offset 100 to 110 from a table using following piece of code val sc = new SparkContext(new SparkConf().setAppName(SparkJdbcDs).setMaster(local[*])) val sqlContext = new SQLContext(sc) val options = new HashMap[String, String]()

RE: lower and upper offset not working in spark with mysql database

2015-07-05 Thread Manohar753
I think you should mention partitionColumn like below and the Colum type should be numeric. It works for my case. options.put(partitionColumn, revision); Thanks, Manohar From: Hafiz Mujadid [via Apache Spark User List] [mailto:ml-node+s1001560n23635...@n3.nabble.com] Sent: Monday,

Re: lower and upper offset not working in spark with mysql database

2015-07-05 Thread Hafiz Mujadid
thanks On Mon, Jul 6, 2015 at 10:46 AM, Manohar753 [via Apache Spark User List] ml-node+s1001560n23637...@n3.nabble.com wrote: I think you should mention partitionColumn like below and the Colum type should be numeric. It works for my case. options.put(partitionColumn, revision);