Re: Spark 2 cannot create ORC table when CLUSTERED. This worked in Spark 1.6.1

Hi, SPARK-17047 created Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: Spark 2 cannot create ORC table when CLUSTERED. This worked in Spark 1.6.1

Hi Mich, File a JIRA issue as that seems as if they overlooked that part. Spark 2.0 has less and less HiveQL with more and more native support. (My take on this is that the days of Hive in Spark are counted and Hive is gonna disappear soon) Pozdrawiam, Jacek Laskowski

Re: Spark 2 cannot create ORC table when CLUSTERED. This worked in Spark 1.6.1

And SPARK even reads ORC data very slowly. And in case the HIVE table is partitioned, then it just hangs. Regards, Gourav On Thu, Aug 11, 2016 at 6:02 PM, Mich Talebzadeh wrote: > > > This does not work with CLUSTERED BY clause in Spark 2 now! > > CREATE TABLE

Spark 2 cannot create ORC table when CLUSTERED. This worked in Spark 1.6.1

This does not work with CLUSTERED BY clause in Spark 2 now! CREATE TABLE test.dummy2 ( ID INT , CLUSTERED INT , SCATTERED INT , RANDOMISED INT , RANDOM_STRING VARCHAR(50) , SMALL_VC VARCHAR(10) , PADDING VARCHAR(10) ) CLUSTERED BY (ID) INTO 256 BUCKETS STORED AS ORC