Hive unwanted directories creation issue
We are creating external table in Hive and if the location path is not present in the HDFS say /testdata(as shown below), Hive is creating the '/testdata' dummy folder. Is there any option in hive or any way to stop creating dummy directories if the location folder not exists. So we end up creating many unwanted dummy directories if the data not present on the HDFS for many partitions we add after creating table. CREATE EXTERNAL TABLE testTable ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' WITH SERDEPROPERTIES ('avro.schema.literal'='{ schema json literal') STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat' LOCATION '/testdata/'; Regards Sathish Valluri
This looks like an Hive issue to me, Can anyone suggest other ways to overcome this.
We are creating external table in Hive and if the location path is not present in the HDFS say /testdata(as shown below), Hive is creating the ‘/testdata’ dummy folder. Is there any option in hive or any way to stop creating dummy directories if the location folder not exists. So we end up creating many unwanted dummy directories if the data not present on the HDFS for many partitions we add after creating table. CREATE EXTERNAL TABLE testTable ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' WITH SERDEPROPERTIES ('avro.schema.literal'='{ schema json literal') STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat' LOCATION '/testdata/'; Regards Sathish Valluri
HIVE-7850 requet to assign jira ticket
Hi All, I have fix available for https://issues.apache.org/jira/browse/HIVE-7850 with me and can anyone provide permissions for me to submit the patch changes to this jira issue. Jira username : vallurisathish Regards Sathish Valluri smime.p7s Description: S/MIME cryptographic signature
HIVE-7850 requet to assign jira ticket
Hi All, I have fix available for https://issues.apache.org/jira/browse/HIVE-7850 with me and can anyone provide permissions for me to submit the patch changes to this jira issue. Jira username : vallurisathish Regards Sathish Valluri