[jira] [Updated] (HIVE-11117) Hive external table - skip header and trailer property issue
[
https://issues.apache.org/jira/browse/HIVE-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Turoczy updated HIVE-7:
--
Labels: check mapreduce (was: check)
> Hive external table - skip header and trailer property issue
>
>
> Key: HIVE-7
> URL: https://issues.apache.org/jira/browse/HIVE-7
> Project: Hive
> Issue Type: Bug
> Environment: Production
>Reporter: Janarthanan
>Priority: Critical
> Labels: check, mapreduce
>
> I am using an external hive table pointing to a HDFS location. The external
> table is partitioned on year/mm/dd folders. When there are more than one
> partition folder (ex: /2015/01/02/file.txt & /2015/01/03/file2.txt), the
> select on external table, skips the DATA RECORD instead of skipping the
> header/trailer record from one of the file).
> tblproperties ("skip.header.line.count"="1");
> Resolution: On enabling hive.input format instead of text input format and
> execution using TEZ engine instead of MapReduce resovled the issue.
> How to resolve the problem without setting these parameters ? I don't want to
> run the hive query using TEZ.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-11117) Hive external table - skip header and trailer property issue
[
https://issues.apache.org/jira/browse/HIVE-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Turoczy updated HIVE-7:
--
Labels: check (was: )
> Hive external table - skip header and trailer property issue
>
>
> Key: HIVE-7
> URL: https://issues.apache.org/jira/browse/HIVE-7
> Project: Hive
> Issue Type: Bug
> Environment: Production
>Reporter: Janarthanan
>Priority: Critical
> Labels: check
>
> I am using an external hive table pointing to a HDFS location. The external
> table is partitioned on year/mm/dd folders. When there are more than one
> partition folder (ex: /2015/01/02/file.txt & /2015/01/03/file2.txt), the
> select on external table, skips the DATA RECORD instead of skipping the
> header/trailer record from one of the file).
> tblproperties ("skip.header.line.count"="1");
> Resolution: On enabling hive.input format instead of text input format and
> execution using TEZ engine instead of MapReduce resovled the issue.
> How to resolve the problem without setting these parameters ? I don't want to
> run the hive query using TEZ.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-11117) Hive external table - skip header and trailer property issue
[ https://issues.apache.org/jira/browse/HIVE-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janarthanan updated HIVE-7: --- Environment: Production Priority: Critical (was: Major) Hive external table - skip header and trailer property issue Key: HIVE-7 URL: https://issues.apache.org/jira/browse/HIVE-7 Project: Hive Issue Type: Bug Environment: Production Reporter: Janarthanan Priority: Critical I am using an external hive table pointing to a HDFS location. The external table is partitioned on year/mm/dd folders. When there are more than one partition folder (ex: /2015/01/02/file.txt /2015/01/03/file2.txt), the select on external table, skips the DATA RECORD instead of skipping the header/trailer record from one of the file). tblproperties (skip.header.line.count=1); Resolution: On enabling hive.input format instead of text input format and execution using TEZ engine instead of MapReduce resovled the issue. How to resolve the problem without setting these parameters ? I don't want to run the hive query using TEZ. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
