DISTRIBUTE BY only promises that data will be collocated, but does not create a partition for each value. You are probably looking for Dynamic Partitions <https://cwiki.apache.org/confluence/display/Hive/DynamicPartitions>, which was recently merged into HiveContext.
On Tue, Oct 28, 2014 at 11:49 AM, nitinkak001 <nitinkak...@gmail.com> wrote: > Any suggestions guys?? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Does-JavaSchemaRDD-inherit-the-Hive-partitioning-of-data-tp17410p17539.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
