[jira] [Updated] (HIVE-2904) ant gen-test failed
[
https://issues.apache.org/jira/browse/HIVE-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-2904:
-
Status: Open (was: Patch Available)
> ant gen-test failed
> ---
>
> Key: HIVE-2904
> URL: https://issues.apache.org/jira/browse/HIVE-2904
> Project: Hive
> Issue Type: Bug
>Affects Versions: 0.8.1
>Reporter: Sho Shimauchi
> Labels: patch
> Attachments: HIVE-2904.1.patch, HIVE-2904.D2487.1.patch,
> HIVE-2904.D2487.2.patch
>
>
> When I ran the commands introduced in Getting Started page, ant gen-test
> failed with the following error.
> {quote}
> $ ant gen-test
>
> Buildfile: /Users/sho/src/apache/hive/ql/build.xml
> test-conditions:
> [echo] Project: ql
> test-init:
> [echo] Project: ql
> [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data
> [mkdir] Created dir:
> /Users/sho/src/apache/hive/build/ql/test/logs/clientpositive
> [mkdir] Created dir:
> /Users/sho/src/apache/hive/build/ql/test/logs/clientnegative
> [mkdir] Created dir:
> /Users/sho/src/apache/hive/build/ql/test/logs/positive
> [mkdir] Created dir:
> /Users/sho/src/apache/hive/build/ql/test/logs/negative
> [mkdir] Created dir:
> /Users/sho/src/apache/hive/build/ql/test/data/warehouse
> [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data/metadb
> gen-test:
> [echo] ql
> [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates
> [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute
> log
> [qtestgen] ???: FileResourceLoader : adding path
> '/Users/sho/src/apache/hive/ql/src/test/templates'
> [qtestgen] Generated
> /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/ql/parse/TestParse.java
> from template TestParse.vm
> [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates
> [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute
> log
> [qtestgen] ???: FileResourceLoader : adding path
> '/Users/sho/src/apache/hive/ql/src/test/templates'
> [qtestgen] Generated
> /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/ql/parse/TestParseNegative.java
> from template TestParseNegative.vm
> [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates
> [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute
> log
> [qtestgen] ???: FileResourceLoader : adding path
> '/Users/sho/src/apache/hive/ql/src/test/templates'
> [qtestgen] Generated
> /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/cli/TestCliDriver.java
> from template TestCliDriver.vm
> BUILD FAILED
> /Users/sho/src/apache/hive/ql/build.xml:116: Problem: failed to create task
> or type if
> Cause: The name is undefined.
> Action: Check the spelling.
> Action: Check that any custom tasks/types have been declared.
> Action: Check that any / declarations have taken place.
> {quote}
> Getting Started:
> https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2933) analyze command throw NPE when table doesn't exists
[ https://issues.apache.org/jira/browse/HIVE-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2933: - Status: Open (was: Patch Available) > analyze command throw NPE when table doesn't exists > --- > > Key: HIVE-2933 > URL: https://issues.apache.org/jira/browse/HIVE-2933 > Project: Hive > Issue Type: Bug > Components: Statistics >Affects Versions: 0.8.1 >Reporter: alex gemini >Priority: Minor > Attachments: HIVE-2933-0.8.1-1.patch > > > analyze command throw NPE when table doesn't exists -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2929) race condition in DAG execute tasks for hive
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2929: - Attachment: hive.2929.1.patch > race condition in DAG execute tasks for hive > > > Key: HIVE-2929 > URL: https://issues.apache.org/jira/browse/HIVE-2929 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: hive.2929.1.patch > > > select ... > ( > SubQuery involving MapReduce > union all > SubQuery involving MapReduce > ); > or > select ... > (SubQuery involving MapReduce) > join > (SubQuery involving MapReduce) > ; > If both the subQueries finish at nearly the same time, there is a race > condition in which the results of the subQuery finishing last will be > completely missed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2929) race condition in DAG execute tasks for hive
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2929: - Status: Patch Available (was: Open) > race condition in DAG execute tasks for hive > > > Key: HIVE-2929 > URL: https://issues.apache.org/jira/browse/HIVE-2929 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: hive.2929.1.patch > > > select ... > ( > SubQuery involving MapReduce > union all > SubQuery involving MapReduce > ); > or > select ... > (SubQuery involving MapReduce) > join > (SubQuery involving MapReduce) > ; > If both the subQueries finish at nearly the same time, there is a race > condition in which the results of the subQuery finishing last will be > completely missed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2858) Cache remote map reduce job stack traces for additional logging
[ https://issues.apache.org/jira/browse/HIVE-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2858: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Cache remote map reduce job stack traces for additional logging > --- > > Key: HIVE-2858 > URL: https://issues.apache.org/jira/browse/HIVE-2858 > Project: Hive > Issue Type: Improvement > Components: Logging >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2858.D2223.1.patch, HIVE-2858.D2223.2.patch > > > Currently we are parsing the task logs for failed jobs for information to > display to the user in the CLI. In addition, we could parse those logs for > stack traces and store e them in the SessionState. This way, when we log > failed queries, these will give us a decent idea of why those queries failed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2931) conf settings may be ignored
[ https://issues.apache.org/jira/browse/HIVE-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2931: - Attachment: hive.2931.1.patch > conf settings may be ignored > > > Key: HIVE-2931 > URL: https://issues.apache.org/jira/browse/HIVE-2931 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: hive.2931.1.patch > > > This is a pretty serious problem. > If a conf variable is changed, Hive may not pick up the variable unless the > metastore variables are changed. > When any session variables are changed, it might be simpler to update the > corresponding Hive conf. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2931) conf settings may be ignored
[ https://issues.apache.org/jira/browse/HIVE-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2931: - Status: Patch Available (was: Open) > conf settings may be ignored > > > Key: HIVE-2931 > URL: https://issues.apache.org/jira/browse/HIVE-2931 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: hive.2931.1.patch > > > This is a pretty serious problem. > If a conf variable is changed, Hive may not pick up the variable unless the > metastore variables are changed. > When any session variables are changed, it might be simpler to update the > corresponding Hive conf. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2901) Hive union with NULL constant and string in same column returns all null
[ https://issues.apache.org/jira/browse/HIVE-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2901: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Navis > Hive union with NULL constant and string in same column returns all null > > > Key: HIVE-2901 > URL: https://issues.apache.org/jira/browse/HIVE-2901 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Navis >Priority: Critical > Attachments: HIVE-2901.D2541.1.patch, HIVE-2901.D2541.2.patch, > HIVE-2901.D2541.3.patch > > > select x from (select value as x from src union all select NULL as x from > src)a; > This query produces all nulls, where value is a string column. > Notably, > select x from (select key as x from src union all select NULL as x from src)a; > where key is a string, but can be cast to a double, the query returns correct > results. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2863) Ambiguous table name or column reference message displays when table and column names are the same
[ https://issues.apache.org/jira/browse/HIVE-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2863: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Navis > Ambiguous table name or column reference message displays when table and > column names are the same > -- > > Key: HIVE-2863 > URL: https://issues.apache.org/jira/browse/HIVE-2863 > Project: Hive > Issue Type: Bug >Reporter: Mauro Cazzari >Assignee: Navis > Attachments: HIVE-2863.D2361.1.patch > > > Given the following table: > CREATE TABLE `Y` (`y` DOUBLE) ROW FORMAT DELIMITED FIELDS TERMINATED BY > '\001' STORED AS TEXTFILE; > The following query fails: > SELECT `Y`.`y` FROM `Y` WHERE ( `y` = 1 ) > ERROR: java.sql.SQLException: Query returned non-zero code: 10, cause: > FAILED: Error in >semantic analysis: Line 1:36 Ambiguous table alias or column reference > '`y`' > ERROR: Unable to execute Hadoop query. > ERROR: Prepare error. SQL statement: SELECT `Y`.`y` FROM `Y` WHERE ( `y` > = 1 ). > The problem goes away if the table and column names do not match. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2801) When join key is null, random distribute this tuple
[ https://issues.apache.org/jira/browse/HIVE-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2801: - Assignee: binlijin Status: Open (was: Patch Available) Please make it 'Patch Available' after addresssing Ashutosh's concerns > When join key is null, random distribute this tuple > --- > > Key: HIVE-2801 > URL: https://issues.apache.org/jira/browse/HIVE-2801 > Project: Hive > Issue Type: Improvement >Reporter: binlijin >Assignee: binlijin > Attachments: HIVE-2801.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2853) Add pre event listeners to metastore
[ https://issues.apache.org/jira/browse/HIVE-2853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2853: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Add pre event listeners to metastore > > > Key: HIVE-2853 > URL: https://issues.apache.org/jira/browse/HIVE-2853 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2853.D2175.1.patch, HIVE-2853.D2175.2.patch > > > Currently there are event listeners in the metastore which run after the > completion of a method. It would be useful to have similar hooks which run > before the metastore method is executed. These can be used to make > validating names, locations, etc. customizable. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2805) Move metastore upgrade scripts labeled 0.10.0 into scripts labeled 0.9.0
[ https://issues.apache.org/jira/browse/HIVE-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2805: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Move metastore upgrade scripts labeled 0.10.0 into scripts labeled 0.9.0 > > > Key: HIVE-2805 > URL: https://issues.apache.org/jira/browse/HIVE-2805 > Project: Hive > Issue Type: Task > Components: Metastore >Affects Versions: 0.9.0 >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2805.D1743.1.patch > > > Move contents of upgrade-0.9.0-to-0.10.0.mysql.sql, > upgrade-0.9.0-to-0.10.0.derby.sql into upgrade-0.8.0-to-0.9.0.mysql.sql, > upgrade-0.8.0-to-0.9.0.derby.sql > Rename hive-schema-0.10.0.derby.sql, hive-schema-0.10.0.mysql.sql to > hive-schema-0.9.0.derby.sql, hive-schema-0.9.0.mysql.sql -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2858) Cache remote map reduce job stack traces for additional logging
[ https://issues.apache.org/jira/browse/HIVE-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2858: - Status: Open (was: Patch Available) > Cache remote map reduce job stack traces for additional logging > --- > > Key: HIVE-2858 > URL: https://issues.apache.org/jira/browse/HIVE-2858 > Project: Hive > Issue Type: Improvement > Components: Logging >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2858.D2223.1.patch > > > Currently we are parsing the task logs for failed jobs for information to > display to the user in the CLI. In addition, we could parse those logs for > stack traces and store e them in the SessionState. This way, when we log > failed queries, these will give us a decent idea of why those queries failed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2848) Add validation to HiveConf ConfVars
[ https://issues.apache.org/jira/browse/HIVE-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2848: - Status: Open (was: Patch Available) Comments on arc diff > Add validation to HiveConf ConfVars > --- > > Key: HIVE-2848 > URL: https://issues.apache.org/jira/browse/HIVE-2848 > Project: Hive > Issue Type: Improvement >Affects Versions: 0.9.0 >Reporter: Kevin Wilfong >Assignee: Navis > Attachments: HIVE-2848.D2313.1.patch, HIVE-2848.D2313.2.patch > > > It would be good if we could add some validation to ConfVars in the HiveConf > when they are set. > At least if a variable is supposed to be boolean, numeric, or > strict/nonstrict, it shouldn't be too difficult to check for these. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2881) Remove redundant key comparing in SMBMapJoinOperator
[ https://issues.apache.org/jira/browse/HIVE-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2881: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Navis > Remove redundant key comparing in SMBMapJoinOperator > > > Key: HIVE-2881 > URL: https://issues.apache.org/jira/browse/HIVE-2881 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Attachments: HIVE-2881.D2379.1.patch > > > Currently, SMBJoin compares keys twice in #findSmallestKey and #joinObject. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2866) Cache local map reduce job errors for additional logging
[ https://issues.apache.org/jira/browse/HIVE-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2866: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Cache local map reduce job errors for additional logging > > > Key: HIVE-2866 > URL: https://issues.apache.org/jira/browse/HIVE-2866 > Project: Hive > Issue Type: Improvement > Components: Logging >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2866.D2277.1.patch > > > Using the CachingPrintStream we are storing errors that occur locally in > Hive, but because local map reduce jobs are run in a separate JVM we are not > storing that occur for these. We can use this same construct to store errors > written to the subprocesses error stream. This way, when we log failed > queries, these will give us a decent idea of why those queries failed. > See related issues: > https://issues.apache.org/jira/browse/HIVE-2832 > https://issues.apache.org/jira/browse/HIVE-2858 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2676) The row count that loaded to a table may not right
[ https://issues.apache.org/jira/browse/HIVE-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2676: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks binlijin > The row count that loaded to a table may not right > - > > Key: HIVE-2676 > URL: https://issues.apache.org/jira/browse/HIVE-2676 > Project: Hive > Issue Type: Improvement >Reporter: binlijin >Priority: Minor > Labels: patch > Attachments: HIVE-2676.patch > > > create table tablename as SELECT *** > At the end hive will print a number that show how many Rows loaded to the > tablename, but sometimes the number is not right. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2875) Renaming partition changes partition location prefix
[ https://issues.apache.org/jira/browse/HIVE-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2875: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Renaming partition changes partition location prefix > > > Key: HIVE-2875 > URL: https://issues.apache.org/jira/browse/HIVE-2875 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2875.D2349.1.patch, HIVE-2875.D2349.2.patch > > > Renaming a partition changes the location of the partition to the default > location of the table, followed by the partition specification. It should > just change the partition specification of the path. > If the path does not end with the old partition specification, we should > probably throw an exception because renaming a partition should not change > the path so dramatically, and not changing the path to reflect the new > partition name could leave the partition in a very confusing state. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2518) pull junit jar from maven repos via ivy
[ https://issues.apache.org/jira/browse/HIVE-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2518: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > pull junit jar from maven repos via ivy > --- > > Key: HIVE-2518 > URL: https://issues.apache.org/jira/browse/HIVE-2518 > Project: Hive > Issue Type: Improvement >Reporter: He Yongqiang >Assignee: Kevin Wilfong > Attachments: HIVE-2518.D2493.1.patch > > > see https://issues.apache.org/jira/browse/HIVE-2505 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2906) Support providing some table properties by user via SQL
[
https://issues.apache.org/jira/browse/HIVE-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-2906:
-
Status: Open (was: Patch Available)
> Support providing some table properties by user via SQL
> ---
>
> Key: HIVE-2906
> URL: https://issues.apache.org/jira/browse/HIVE-2906
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
>Reporter: Navis
>Assignee: Navis
> Attachments: HIVE-2906.D2499.1.patch
>
>
> Some properties are needed to be provided to StorageHandler by user in
> runtime. It might be an address for remote resource or retry count for access
> or maximum version count(for hbase), etc.
> For example,
> {code}
> select emp.empno, emp.ename from hbase_emp ('max.version'='3') emp;
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2852) hive.stats.autogather should default to false.
[ https://issues.apache.org/jira/browse/HIVE-2852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2852: - Status: Open (was: Patch Available) > hive.stats.autogather should default to false. > -- > > Key: HIVE-2852 > URL: https://issues.apache.org/jira/browse/HIVE-2852 > Project: Hive > Issue Type: Task > Components: Configuration >Affects Versions: 0.8.1 >Reporter: Edward Capriolo >Assignee: Edward Capriolo >Priority: Minor > Fix For: 0.9.0 > > Attachments: hive-2852.patch.1.txt > > > hive.stats.autogather is set to true. A majority of people are not using > indexing or this feature, as a result INSERT OVERWRITE TABLE statements are > creating derby stat_db directories in the users CWD. This should be disabled > for now. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2471) Add timestamp column to the partition stats table.
[ https://issues.apache.org/jira/browse/HIVE-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2471: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Add timestamp column to the partition stats table. > -- > > Key: HIVE-2471 > URL: https://issues.apache.org/jira/browse/HIVE-2471 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2471.1.patch.txt, HIVE-2471.D2367.1.patch, > HIVE-2471.D2367.2.patch, HIVE-2471.D2367.3.patch > > > Occasionally, when entries are added to the partition stats table the program > is halted before it can delete those entries, by an exception, keyboard > interrupt, etc. These build up to the point where the table gets very large, > and it hurts the performance of the update statement which is often called. > In order to fix this, I am adding a column to the table which is > auto-populated with the current timestamp. This will allow us to create > scripts that go through periodically and clean out old entries from the table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2864) If hive history file's directory doesn't exist don't crash
[ https://issues.apache.org/jira/browse/HIVE-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2864: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > If hive history file's directory doesn't exist don't crash > -- > > Key: HIVE-2864 > URL: https://issues.apache.org/jira/browse/HIVE-2864 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2864.D2265.1.patch, HIVE-2864.D2265.2.patch > > > Currently, if the history file's directory does not exist the Hive client > crashes. Instead, since this is not a vital feature, it should just display > a warning to the user and continue without it. > This will become more important once the directory becomes configurable, see: > https://issues.apache.org/jira/browse/HIVE-1708 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2875) Renaming partition changes partition location prefix
[ https://issues.apache.org/jira/browse/HIVE-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2875: - Status: Open (was: Patch Available) > Renaming partition changes partition location prefix > > > Key: HIVE-2875 > URL: https://issues.apache.org/jira/browse/HIVE-2875 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2875.D2349.1.patch > > > Renaming a partition changes the location of the partition to the default > location of the table, followed by the partition specification. It should > just change the partition specification of the path. > If the path does not end with the old partition specification, we should > probably throw an exception because renaming a partition should not change > the path so dramatically, and not changing the path to reflect the new > partition name could leave the partition in a very confusing state. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2871) Add a new hook to run at the beginning and end of the Driver.run method
[ https://issues.apache.org/jira/browse/HIVE-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2871: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Add a new hook to run at the beginning and end of the Driver.run method > --- > > Key: HIVE-2871 > URL: https://issues.apache.org/jira/browse/HIVE-2871 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2871.D2331.1.patch, HIVE-2871.D2331.2.patch, > HIVE-2871.D2331.3.patch > > > Driver.run is the highest level method which all queries go through, whether > they come from Hive Server, the CLI, or any other entry. We also do not have > any hooks before the compilation method is called, and having hooks in > Driver.run would provide this. Having hooks in Driver.run will allow, for > example, being able to overwrite config values used throughout query > processing, including compilation, and at the other end, cleaning up any > resources/logging any final values just before returning to the user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2872) Store which configs the user has explicitly changed
[ https://issues.apache.org/jira/browse/HIVE-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2872: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Store which configs the user has explicitly changed > --- > > Key: HIVE-2872 > URL: https://issues.apache.org/jira/browse/HIVE-2872 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2872.D2337.1.patch, HIVE-2872.D2337.2.patch > > > It would be useful to keep track of which config variables the user has > explicitly changed from the values which are either default or loaded from > hive-site.xml. These include config variables set using the hiveconf > argument to the CLI, and via the SET command. This could be used to prevent > Hive from changing a config variable which has been explicitly set by the > user, and also potentially for logging to help with later debugging of failed > queries. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2871) Add a new hook to run at the beginning and end of the Driver.run method
[ https://issues.apache.org/jira/browse/HIVE-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2871: - Status: Open (was: Patch Available) > Add a new hook to run at the beginning and end of the Driver.run method > --- > > Key: HIVE-2871 > URL: https://issues.apache.org/jira/browse/HIVE-2871 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2871.D2331.1.patch, HIVE-2871.D2331.2.patch > > > Driver.run is the highest level method which all queries go through, whether > they come from Hive Server, the CLI, or any other entry. We also do not have > any hooks before the compilation method is called, and having hooks in > Driver.run would provide this. Having hooks in Driver.run will allow, for > example, being able to overwrite config values used throughout query > processing, including compilation, and at the other end, cleaning up any > resources/logging any final values just before returning to the user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2872) Store which configs the user has explicitly changed
[ https://issues.apache.org/jira/browse/HIVE-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2872: - Status: Open (was: Patch Available) > Store which configs the user has explicitly changed > --- > > Key: HIVE-2872 > URL: https://issues.apache.org/jira/browse/HIVE-2872 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2872.D2337.1.patch > > > It would be useful to keep track of which config variables the user has > explicitly changed from the values which are either default or loaded from > hive-site.xml. These include config variables set using the hiveconf > argument to the CLI, and via the SET command. This could be used to prevent > Hive from changing a config variable which has been explicitly set by the > user, and also potentially for logging to help with later debugging of failed > queries. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2871) Add a new hook to run at the beginning and end of the Driver.run method
[ https://issues.apache.org/jira/browse/HIVE-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2871: - Status: Open (was: Patch Available) > Add a new hook to run at the beginning and end of the Driver.run method > --- > > Key: HIVE-2871 > URL: https://issues.apache.org/jira/browse/HIVE-2871 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2871.D2331.1.patch > > > Driver.run is the highest level method which all queries go through, whether > they come from Hive Server, the CLI, or any other entry. We also do not have > any hooks before the compilation method is called, and having hooks in > Driver.run would provide this. Having hooks in Driver.run will allow, for > example, being able to overwrite config values used throughout query > processing, including compilation, and at the other end, cleaning up any > resources/logging any final values just before returning to the user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2832) Cache error messages for additional logging
[ https://issues.apache.org/jira/browse/HIVE-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2832: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Cache error messages for additional logging > --- > > Key: HIVE-2832 > URL: https://issues.apache.org/jira/browse/HIVE-2832 > Project: Hive > Issue Type: Improvement > Components: Logging >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2832.D2025.1.patch, HIVE-2832.D2025.2.patch > > > It would be good if we could cache logs written to SessionState.err so that > they could be exposed to hooks for additional logging. This would allow > logging of error messages with the queries that failed in a central location. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2837) insert into external tables should not be allowed
[ https://issues.apache.org/jira/browse/HIVE-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2837: - Status: Patch Available (was: Open) > insert into external tables should not be allowed > - > > Key: HIVE-2837 > URL: https://issues.apache.org/jira/browse/HIVE-2837 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2837.D2211.1.patch > > > This is a very risky thing to allow. > Since, the external tables can point to any user location, which can > potentially corrupt some other tables. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2838) cleanup readentity/writeentity
[ https://issues.apache.org/jira/browse/HIVE-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2838: - Status: Patch Available (was: Open) > cleanup readentity/writeentity > -- > > Key: HIVE-2838 > URL: https://issues.apache.org/jira/browse/HIVE-2838 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2838.D2193.1.patch, HIVE-2838.D2193.2.patch > > > Ideally, there should be one common entity instead of readentity/writeentity. > Unfortunately, that would be a backward incompatible change since users os > hive might have written > there own hooks, where they are using readentity/writeentity. > We should atleast create a common class, and then we can deprecate read/write > entity later, for a new release. > For now, I propose to make a backward compatible change. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2833) Fix test failures caused by HIVE-2716
[ https://issues.apache.org/jira/browse/HIVE-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2833: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Fix test failures caused by HIVE-2716 > - > > Key: HIVE-2833 > URL: https://issues.apache.org/jira/browse/HIVE-2833 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Carl Steinbach >Assignee: Kevin Wilfong > Attachments: HIVE-2716.D2055.1.patch, HIVE-2833.D2055.2.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2825) Concatenating a partition does not inherit location from table
[ https://issues.apache.org/jira/browse/HIVE-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2825: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin. > Concatenating a partition does not inherit location from table > -- > > Key: HIVE-2825 > URL: https://issues.apache.org/jira/browse/HIVE-2825 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2825.D1995.1.patch, HIVE-2825.D1995.2.patch > > > When a table is created in one dfs, a partition is added to that table, the > table's dfs is changed, and the partitioned is concatenated, the partitions > location remains exactly the same. Instead, it should inherit its location > from the table, and be updated accordingly. > See https://issues.apache.org/jira/browse/HIVE-1707 for an analogous change > to insert overwrite. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2823) Add logging of total run time of Driver
[ https://issues.apache.org/jira/browse/HIVE-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2823: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Add logging of total run time of Driver > --- > > Key: HIVE-2823 > URL: https://issues.apache.org/jira/browse/HIVE-2823 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2823.D1977.1.patch, HIVE-2823.D1977.2.patch > > > We are currently logging the run time of several components of the Driver, > e.g. compilation and map reduce execution time. It would be helpful to log > the total run time of the Driver's run method as well. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2612) support hive table/partitions exists in more than one region
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2612: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin and Yongqiang > support hive table/partitions exists in more than one region > > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Kevin Wilfong > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.3.patch.txt, HIVE-2612.4.patch.txt, HIVE-2612.6.patch.txt, > HIVE-2612.7.patch.txt, HIVE-2612.8.patch.txt, HIVE-2612.D1569.1.patch, > HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, > HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch, > HIVE-2612.D1707.1.patch, hive.2612.5.patch > > > 1) add region object into hive metastore > 2) each partition/table has a primary region and a list of living regions, > and also data location in each region -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2785) support use region
[ https://issues.apache.org/jira/browse/HIVE-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2785: - Description: use physicalRegion; use physicalRegion ; should be supported was: use region; use region ; should be supported > support use region > -- > > Key: HIVE-2785 > URL: https://issues.apache.org/jira/browse/HIVE-2785 > Project: Hive > Issue Type: New Feature >Reporter: Namit Jain >Assignee: Namit Jain > > use physicalRegion; > use physicalRegion ; > should be supported -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2786) Throw an error if the user tries to insert a table into a region other than the primary region
[ https://issues.apache.org/jira/browse/HIVE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2786: - Description: By default, the user can only insert into the primary region. Add an option to insert into the secondary region also. The config variable is 'hive.insert.secondary.regions' - default for that variable is false was: By default, the user can only insert into the primary cluster. Add an option to insert into the secondary clusters also Summary: Throw an error if the user tries to insert a table into a region other than the primary region (was: Throw an error if the user tries to insert a table into a cluster other than the primary cluster) > Throw an error if the user tries to insert a table into a region other than > the primary region > -- > > Key: HIVE-2786 > URL: https://issues.apache.org/jira/browse/HIVE-2786 > Project: Hive > Issue Type: New Feature >Reporter: Namit Jain > > By default, the user can only insert into the primary region. > Add an option to insert into the secondary region also. > The config variable is 'hive.insert.secondary.regions' - default for that > variable is false -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2785) support use region
[ https://issues.apache.org/jira/browse/HIVE-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2785: - Description: use region; use region ; should be supported was: use cluster; use cluster ; should be supported Summary: support use region (was: support use cluster) > support use region > -- > > Key: HIVE-2785 > URL: https://issues.apache.org/jira/browse/HIVE-2785 > Project: Hive > Issue Type: New Feature >Reporter: Namit Jain > > use region; > use region ; > should be supported -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2612) support hive table/partitions exists in more than one region
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2612: - Attachment: hive.2612.5.patch > support hive table/partitions exists in more than one region > > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.3.patch.txt, HIVE-2612.4.patch.txt, HIVE-2612.D1569.1.patch, > HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, > HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch, > hive.2612.5.patch > > > 1) add region object into hive metastore > 2) each partition/table has a primary region and a list of living regions, > and also data location in each region -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2795) View partitions do not have a storage descriptor
[ https://issues.apache.org/jira/browse/HIVE-2795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2795: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > View partitions do not have a storage descriptor > > > Key: HIVE-2795 > URL: https://issues.apache.org/jira/browse/HIVE-2795 > Project: Hive > Issue Type: Improvement >Reporter: Namit Jain >Assignee: Kevin Wilfong > Attachments: HIVE-2795.D1683.1.patch, HIVE-2795.D1683.2.patch, > HIVE-2795.D1683.3.patch > > > Besides being an inconsistency, it causes errors. > Calling describe formatted on a view partition throws an exception > java.lang.NullPointerException > at org.apache.hadoop.hive.ql.metadata.Partition.getCols(Partition.java:505) > > at org.apache.hadoop.hive.ql.exec.DDLTask.describeTable(DDLTask.java:2570) > because it does not have a column descriptor, which is part of the storage > descriptor. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2612) support hive table/partitions coexists in more than one region
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2612: - Description: 1) add region object into hive metastore 2) each partition/table has a primary region and a list of living regions, and also data location in each region was: 1) add cluster object into hive metastore 2) each partition/table has a creation cluster and a list of living clusters, and also data location in each cluster Summary: support hive table/partitions coexists in more than one region (was: support hive table/partitions coexistes in more than one clusters) > support hive table/partitions coexists in more than one region > -- > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.3.patch.txt, HIVE-2612.4.patch.txt, HIVE-2612.D1569.1.patch, > HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, > HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch > > > 1) add region object into hive metastore > 2) each partition/table has a primary region and a list of living regions, > and also data location in each region -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2612) support hive table/partitions exists in more than one region
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2612: - Summary: support hive table/partitions exists in more than one region (was: support hive table/partitions coexists in more than one region) > support hive table/partitions exists in more than one region > > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.3.patch.txt, HIVE-2612.4.patch.txt, HIVE-2612.D1569.1.patch, > HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, > HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch > > > 1) add region object into hive metastore > 2) each partition/table has a primary region and a list of living regions, > and also data location in each region -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2749) CONV returns incorrect results sometimes
[ https://issues.apache.org/jira/browse/HIVE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2749: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed. Thanks Jonathan > CONV returns incorrect results sometimes > > > Key: HIVE-2749 > URL: https://issues.apache.org/jira/browse/HIVE-2749 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang > Attachments: HIVE-2749.D1437.1.patch, HIVE-2749.D1437.2.patch, > HIVE-2749.D1437.2.patch > > > ...because it fails to reset state. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2759) Change global_limit.q into linux format file
[ https://issues.apache.org/jira/browse/HIVE-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2759: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Zhenxiao > Change global_limit.q into linux format file > > > Key: HIVE-2759 > URL: https://issues.apache.org/jira/browse/HIVE-2759 > Project: Hive > Issue Type: Bug > Components: Testing Infrastructure >Reporter: Zhenxiao Luo >Assignee: Zhenxiao Luo > Attachments: HIVE-2759.D1497.1.patch, HIVE-2759.D1497.1.patch > > > global_limit.q is in dos format, and has "\ No newline at end of file". > Needs to be changed into linux format, removing all "^M" at the end of each > line. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2726) COALESCE(NULL, NULL) NPEs
[ https://issues.apache.org/jira/browse/HIVE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2726: - Status: Open (was: Patch Available) > COALESCE(NULL, NULL) NPEs > - > > Key: HIVE-2726 > URL: https://issues.apache.org/jira/browse/HIVE-2726 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang >Priority: Minor > Attachments: HIVE-2726.D1317.1.patch, HIVE-2726.D1317.1.patch > > > ReturnOIResolver returns null when it gets no non-void arguments. This is > bad. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2774) Message when trying to create a view from a view should give name of offending view
[
https://issues.apache.org/jira/browse/HIVE-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-2774:
-
Status: Open (was: Patch Available)
> Message when trying to create a view from a view should give name of
> offending view
> ---
>
> Key: HIVE-2774
> URL: https://issues.apache.org/jira/browse/HIVE-2774
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
>Affects Versions: 0.7.1
>Reporter: Jakob Homan
>Assignee: Jakob Homan
> Fix For: 0.9.0
>
> Attachments: HIVE-2774.patch
>
>
> Currently when trying to create a view that contains another view (a
> prohibited operation) the exception is:
> {noformat}FAILED: Error in semantic analysis: Invalid Table Alias Referencing
> view from foreign databases is not supported.{noformat}
> 'Twould be better if this message included the view that caused the error so
> that when building views from lots of tables, one doesn't need to hunt to
> figure out which one was the actual view.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2779) Improve hooks run in Driver
[ https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2779: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Improve hooks run in Driver > --- > > Key: HIVE-2779 > URL: https://issues.apache.org/jira/browse/HIVE-2779 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch, > HIVE-2779.D1599.3.patch > > > There are some small improvements that can be made to the hooks which are run > in the Driver: > 1) The code to get hooks has been clearly just been copy+pasted for each of > Pre/Post/OnFailure/SemanticAnalyzer hooks. This code should be consolidated > into a single method. > 2) There is a lot more information available to SemanticAnalyzer hooks which > ran after semantic analysis than to those that run before, such as inputs and > outputs. We should make some of this information available to those hooks, > preferably through HiveSemanticAnalyzerHookContext, so that existing hooks > aren't broken. > 3) Currently, possibly unintentionally, hooks are initialized and run in the > order they appear in the comma separated list that is the value of the > configuration variable. This is a useful property, we should add comments > indicating this is desired and add a unit test to enforce it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2756) Views should be added to the inputs of queries.
[ https://issues.apache.org/jira/browse/HIVE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2756: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Views should be added to the inputs of queries. > --- > > Key: HIVE-2756 > URL: https://issues.apache.org/jira/browse/HIVE-2756 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2756.D1575.1.patch > > > Views, in addition to the underlying tables, should be included in the inputs > of a command which queries a view. > This is useful when we want to know exactly what inputs need to be present in > order to run the query run by a user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2756) Views should be added to the inputs of queries.
[ https://issues.apache.org/jira/browse/HIVE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2756: - Status: Patch Available (was: Open) > Views should be added to the inputs of queries. > --- > > Key: HIVE-2756 > URL: https://issues.apache.org/jira/browse/HIVE-2756 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2756.D1575.1.patch > > > Views, in addition to the underlying tables, should be included in the inputs > of a command which queries a view. > This is useful when we want to know exactly what inputs need to be present in > order to run the query run by a user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2747) UNION ALL with subquery which selects NULL and performs group by fails
[ https://issues.apache.org/jira/browse/HIVE-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2747: - Assignee: (was: Kevin Wilfong) > UNION ALL with subquery which selects NULL and performs group by fails > -- > > Key: HIVE-2747 > URL: https://issues.apache.org/jira/browse/HIVE-2747 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong > > Queries like the following > from (select key, value, count(1) as count from src group by key, value union > all select NULL as key, value, count(1) as count from src group by value) a > select count(*); > fail with the exception > java.lang.NullPointerException > at > org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:60) > at java.lang.String.valueOf(String.java:2826) > at java.lang.StringBuilder.append(StringBuilder.java:115) > at > org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110) > at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) > at > org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:427) > at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) > at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:98) > ... 18 more > This should at least provide a more informative error message if not work. > It works without the group by. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2762) Alter Table Partition Concatenate Fails On Certain Characters
[ https://issues.apache.org/jira/browse/HIVE-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2762: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Alter Table Partition Concatenate Fails On Certain Characters > - > > Key: HIVE-2762 > URL: https://issues.apache.org/jira/browse/HIVE-2762 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2762.1.patch.txt, HIVE-2762.2.patch.txt, > HIVE-2762.D1533.1.patch, HIVE-2762.D1533.2.patch, HIVE-2762.D1533.3.patch > > > Alter table partition concatenate creates a Java URI object for the location > of a partition. If the partition name contains certain characters, such as } > or space ' ', the object constructor fails, causing the query to fail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2772) make union31.q deterministic
[ https://issues.apache.org/jira/browse/HIVE-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2772: - Status: Patch Available (was: Open) > make union31.q deterministic > > > Key: HIVE-2772 > URL: https://issues.apache.org/jira/browse/HIVE-2772 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2772.D1557.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2772) make union31.q deterministic
[ https://issues.apache.org/jira/browse/HIVE-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2772: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed by Yongqiang > make union31.q deterministic > > > Key: HIVE-2772 > URL: https://issues.apache.org/jira/browse/HIVE-2772 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2772.D1557.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2769) union with a multi-table insert is not working
[ https://issues.apache.org/jira/browse/HIVE-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2769: - Status: Patch Available (was: Open) > union with a multi-table insert is not working > -- > > Key: HIVE-2769 > URL: https://issues.apache.org/jira/browse/HIVE-2769 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2769.D1545.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2769) union with a multi-table insert is not working
[ https://issues.apache.org/jira/browse/HIVE-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2769: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed by Yongqiang > union with a multi-table insert is not working > -- > > Key: HIVE-2769 > URL: https://issues.apache.org/jira/browse/HIVE-2769 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2769.D1545.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2635) wrong class loader used for external jars
[ https://issues.apache.org/jira/browse/HIVE-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2635: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > wrong class loader used for external jars > - > > Key: HIVE-2635 > URL: https://issues.apache.org/jira/browse/HIVE-2635 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2635.D687.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2635) wrong class loader used for external jars
[ https://issues.apache.org/jira/browse/HIVE-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2635: - Status: Patch Available (was: Open) > wrong class loader used for external jars > - > > Key: HIVE-2635 > URL: https://issues.apache.org/jira/browse/HIVE-2635 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2635.D687.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2762) Alter Table Partition Concatenate Fails On Certain Characters
[ https://issues.apache.org/jira/browse/HIVE-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2762: - Status: Open (was: Patch Available) > Alter Table Partition Concatenate Fails On Certain Characters > - > > Key: HIVE-2762 > URL: https://issues.apache.org/jira/browse/HIVE-2762 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2762.1.patch.txt, HIVE-2762.D1533.1.patch, > HIVE-2762.D1533.2.patch > > > Alter table partition concatenate creates a Java URI object for the location > of a partition. If the partition name contains certain characters, such as } > or space ' ', the object constructor fails, causing the query to fail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2674) get_partitions_ps throws TApplicationException if table doesn't exist
[ https://issues.apache.org/jira/browse/HIVE-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2674: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > get_partitions_ps throws TApplicationException if table doesn't exist > - > > Key: HIVE-2674 > URL: https://issues.apache.org/jira/browse/HIVE-2674 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2674.D987.1.patch, HIVE-2674.D987.2.patch > > > If the table passed to get_partition_ps doesn't exist, a NPE is thrown by > getPartitionPsQueryResults. There should be a check here, which throws a > NoSuchObjectException if the table doesn't exist. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2504) Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory
[ https://issues.apache.org/jira/browse/HIVE-2504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2504: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Chinna Rao > Warehouse table subdirectories should inherit the group permissions of the > warehouse parent directory > - > > Key: HIVE-2504 > URL: https://issues.apache.org/jira/browse/HIVE-2504 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Carl Steinbach >Assignee: Chinna Rao Lalam > Attachments: HIVE-2504.patch > > > When the Hive Metastore creates a subdirectory in the Hive warehouse for > a new table it does so with the default HDFS permissions. Since the default > dfs.umask value is 022, this means that the new subdirectory will not inherit > the > group write permissions of the hive warehouse directory. > We should make the umask used by Warehouse.mkdirs() configurable, and set > it to use a default value of 002. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2695) Add PRINTF() Udf
[ https://issues.apache.org/jira/browse/HIVE-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2695: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Zhenxiao > Add PRINTF() Udf > > > Key: HIVE-2695 > URL: https://issues.apache.org/jira/browse/HIVE-2695 > Project: Hive > Issue Type: New Feature > Components: UDF >Reporter: Carl Steinbach >Assignee: Zhenxiao Luo > Attachments: HIVE-2695.D1155.1.patch, HIVE-2695.D1161.1.patch, > HIVE-2695.D1173.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2674) get_partitions_ps throws TApplicationException if table doesn't exist
[ https://issues.apache.org/jira/browse/HIVE-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2674: - Status: Open (was: Patch Available) > get_partitions_ps throws TApplicationException if table doesn't exist > - > > Key: HIVE-2674 > URL: https://issues.apache.org/jira/browse/HIVE-2674 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2674.D987.1.patch > > > If the table passed to get_partition_ps doesn't exist, a NPE is thrown by > getPartitionPsQueryResults. There should be a check here, which throws a > NoSuchObjectException if the table doesn't exist. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2691) Specify location of log4j configuration files via configuration properties
[
https://issues.apache.org/jira/browse/HIVE-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-2691:
-
Status: Open (was: Patch Available)
commented on D1131
> Specify location of log4j configuration files via configuration properties
> --
>
> Key: HIVE-2691
> URL: https://issues.apache.org/jira/browse/HIVE-2691
> Project: Hive
> Issue Type: New Feature
> Components: Configuration, Logging
>Reporter: Carl Steinbach
>Assignee: Zhenxiao Luo
> Attachments: HIVE-2691.D1131.1.patch
>
>
> Oozie needs to be able to override the default location of the log4j
> configuration
> files from the Hive command line, e.g:
> {noformat}
> hive -hiveconf hive.log4j.file=/home/carl/hive-log4j.properties -hiveconf
> hive.log4j.exec.file=/home/carl/hive-exec-log4j.properties
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2690) a bug in 'alter table concatenate' that causes filenames getting double url encoded
[ https://issues.apache.org/jira/browse/HIVE-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2690: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Yongqiang > a bug in 'alter table concatenate' that causes filenames getting double url > encoded > --- > > Key: HIVE-2690 > URL: https://issues.apache.org/jira/browse/HIVE-2690 > Project: Hive > Issue Type: Bug >Reporter: He Yongqiang >Assignee: He Yongqiang > Attachments: HIVE-2690.1.patch, HIVE-2690.D1095.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2602) add support for insert partition overwrite(...) if not exists
[ https://issues.apache.org/jira/browse/HIVE-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2602: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Chinna Rao Lalam > add support for insert partition overwrite(...) if not exists > - > > Key: HIVE-2602 > URL: https://issues.apache.org/jira/browse/HIVE-2602 > Project: Hive > Issue Type: New Feature >Reporter: Namit Jain >Assignee: Chinna Rao Lalam > Attachments: HIVE-2602.1.patch, HIVE-2602.2.patch, HIVE-2602.3.patch, > HIVE-2602.D579.1.patch, HIVE-2602.D579.2.patch, HIVE-2602.D879.1.patch, > HIVE-2602.patch > > > INSERT OVERWRITE TABLE X PARTITION (a=b, c=d) IF NOT EXISTS ... > The partition should be created and written if and only if it's not there > already. > The support can be added for dynamic partitions in the future, but this jira > is for adding this support for static partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2654) "hive.querylog.location" requires parent directory to be exist or else folder creation fails
[ https://issues.apache.org/jira/browse/HIVE-2654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2654: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Chinna Rao Lalam > "hive.querylog.location" requires parent directory to be exist or else folder > creation fails > > > Key: HIVE-2654 > URL: https://issues.apache.org/jira/browse/HIVE-2654 > Project: Hive > Issue Type: Bug > Components: Query Processor > Environment: Hadoop 0.20.1, Hive0.9.0 and SUSE Linux Enterprise > Server 10 SP2 (i586) - Kernel 2.6.16.60-0.21-smp (5). >Reporter: Chinna Rao Lalam >Assignee: Chinna Rao Lalam > Attachments: HIVE-2654.D885.1.patch, HIVE-2654.patch > > > if value of "hive.querylog.location" is '/tmp/root/hive123/test' if the > parent directories not exist the creation of the folder is failed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2589) Newly created partition should inherit properties from table
[ https://issues.apache.org/jira/browse/HIVE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2589: - Status: Open (was: Patch Available) > Newly created partition should inherit properties from table > > > Key: HIVE-2589 > URL: https://issues.apache.org/jira/browse/HIVE-2589 > Project: Hive > Issue Type: Improvement > Components: Metastore >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Fix For: 0.9.0 > > Attachments: hive-2589.patch, hive-2589.patch, hive-2589_1.patch > > > This will make all the info contained in table properties available to > partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2602) add support for insert partition overwrite(...) if not exists
[ https://issues.apache.org/jira/browse/HIVE-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2602: - Status: Open (was: Patch Available) > add support for insert partition overwrite(...) if not exists > - > > Key: HIVE-2602 > URL: https://issues.apache.org/jira/browse/HIVE-2602 > Project: Hive > Issue Type: New Feature >Reporter: Namit Jain >Assignee: Chinna Rao Lalam > Attachments: HIVE-2602.1.patch, HIVE-2602.2.patch, > HIVE-2602.D579.1.patch, HIVE-2602.D879.1.patch, HIVE-2602.patch > > > INSERT OVERWRITE TABLE X PARTITION (a=b, c=d) IF NOT EXISTS ... > The partition should be created and written if and only if it's not there > already. > The support can be added for dynamic partitions in the future, but this jira > is for adding this support for static partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2611) Make index table output of create index command if index is table based
[ https://issues.apache.org/jira/browse/HIVE-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2611: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Make index table output of create index command if index is table based > --- > > Key: HIVE-2611 > URL: https://issues.apache.org/jira/browse/HIVE-2611 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2611.1.patch.txt, HIVE-2611.D705.1.patch, > HIVE-2611.D705.2.patch, HIVE-2611.D705.3.patch > > > If an index is table based, when that index is created a table is created to > contain that index. This should be listed in the output of the command. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2617) Insert overwrite table db.tname fails if partition already exists
[ https://issues.apache.org/jira/browse/HIVE-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2617: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Chinna > Insert overwrite table db.tname fails if partition already exists > -- > > Key: HIVE-2617 > URL: https://issues.apache.org/jira/browse/HIVE-2617 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Aniket Mokashi >Assignee: Chinna Rao Lalam > Attachments: HIVE-2617.1.patch, HIVE-2617.D843.1.patch, > HIVE-2617.patch > > > Insert Overwrite table db.tname fails if partition already exists. > For example- > insert overwrite table db.tname PARTITION(part='p') select .. from t2 where > part='p'; fails if partition 'p' already exists. Workaround is - use db; and > the fire the command. > From the source code- > alterPartition(tbl.getTableName(), new Partition(tbl, tpart)); takes String > tablename as argument and loses db information. Table table = > newTable(tablename) is called to retrieve table from name. But, it relies on > currentDatabase value (hence the workaround). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2651) The variable hive.exec.mode.local.auto.tasks.max should be changed
[ https://issues.apache.org/jira/browse/HIVE-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2651: - Status: Patch Available (was: Open) > The variable hive.exec.mode.local.auto.tasks.max should be changed > -- > > Key: HIVE-2651 > URL: https://issues.apache.org/jira/browse/HIVE-2651 > Project: Hive > Issue Type: Improvement >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2651.D861.1.patch > > > It should be called hive.exec.mode.local.auto.input.files.max instead. > The number of input files are checked currently. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2640) Add alterPartition to AlterHandler interface
[ https://issues.apache.org/jira/browse/HIVE-2640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2640: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Add alterPartition to AlterHandler interface > > > Key: HIVE-2640 > URL: https://issues.apache.org/jira/browse/HIVE-2640 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2640.D699.1.patch, HIVE-2640.D699.2.patch > > > Adding alterPartition to the AlterHandler interface would allow for > customized functionality to be executed as part of altering a partition, much > like it is already allowed for alterTable. > Based on the name of the interface, and a comment in the AlterHandler code, > it looks like alterPartition was meant to be included along with alterTable. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2617) Insert overwrite table db.tname fails if partition already exists
[ https://issues.apache.org/jira/browse/HIVE-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2617: - Status: Open (was: Patch Available) > Insert overwrite table db.tname fails if partition already exists > -- > > Key: HIVE-2617 > URL: https://issues.apache.org/jira/browse/HIVE-2617 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Aniket Mokashi >Assignee: Chinna Rao Lalam > Attachments: HIVE-2617.D843.1.patch, HIVE-2617.patch > > > Insert Overwrite table db.tname fails if partition already exists. > For example- > insert overwrite table db.tname PARTITION(part='p') select .. from t2 where > part='p'; fails if partition 'p' already exists. Workaround is - use db; and > the fire the command. > From the source code- > alterPartition(tbl.getTableName(), new Partition(tbl, tpart)); takes String > tablename as argument and loses db information. Table table = > newTable(tablename) is called to retrieve table from name. But, it relies on > currentDatabase value (hence the workaround). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2602) add support for insert partition overwrite(...) if not exists
[ https://issues.apache.org/jira/browse/HIVE-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2602: - Status: Open (was: Patch Available) > add support for insert partition overwrite(...) if not exists > - > > Key: HIVE-2602 > URL: https://issues.apache.org/jira/browse/HIVE-2602 > Project: Hive > Issue Type: New Feature >Reporter: Namit Jain >Assignee: Chinna Rao Lalam > Attachments: HIVE-2602.1.patch, HIVE-2602.D579.1.patch, > HIVE-2602.patch > > > INSERT OVERWRITE TABLE X PARTITION (a=b, c=d) IF NOT EXISTS ... > The partition should be created and written if and only if it's not there > already. > The support can be added for dynamic partitions in the future, but this jira > is for adding this support for static partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2651) The variable hive.exec.mode.local.auto.tasks.max should be changed
[ https://issues.apache.org/jira/browse/HIVE-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2651: - Description: It should be called hive.exec.mode.local.auto.input.files.max instead. The number of input files are checked currently. was: It should be called hive.exec.mode.local.auto.files.max instead. The number of input files are checked currently. > The variable hive.exec.mode.local.auto.tasks.max should be changed > -- > > Key: HIVE-2651 > URL: https://issues.apache.org/jira/browse/HIVE-2651 > Project: Hive > Issue Type: Improvement >Reporter: Namit Jain > > It should be called hive.exec.mode.local.auto.input.files.max instead. > The number of input files are checked currently. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2628) move one line log from MapOperator to HiveContextAwareRecordReader
[ https://issues.apache.org/jira/browse/HIVE-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2628: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Yongqiang > move one line log from MapOperator to HiveContextAwareRecordReader > -- > > Key: HIVE-2628 > URL: https://issues.apache.org/jira/browse/HIVE-2628 > Project: Hive > Issue Type: Improvement >Reporter: He Yongqiang >Assignee: He Yongqiang > Attachments: HIVE-2628.D615.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2520) left semi join will duplicate data
[ https://issues.apache.org/jira/browse/HIVE-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2520: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks binlijin > left semi join will duplicate data > -- > > Key: HIVE-2520 > URL: https://issues.apache.org/jira/browse/HIVE-2520 > Project: Hive > Issue Type: Bug >Affects Versions: 0.7.0 >Reporter: binlijin >Assignee: binlijin >Priority: Critical > Labels: patch > Attachments: HIVE-2520.D717.1.patch, hive-2520.2.patch, > hive-2520.patch > > > CREATE TABLE sales (name STRING, id INT) > ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'; > CREATE TABLE things (id INT, name STRING) > ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'; > The 'sales' table has data in a file: sales.txt, and the data is： > Joe 2 > Hank 2 > The 'things' table has data int two files: things.txt and things2.txt： > The content of things.txt is : > 2 Tie > The content of things2.txt is : > 2 Tie > SELECT * FROM sales LEFT SEMI JOIN things ON (sales.id = things.id); > will output： > Joe 2 > Joe 2 > Hank 2 > Hank 2 > so the result is wrong. > In CommonJoinOperator left semi join should use " genObject(null, 0, new > IntermediateObject(new ArrayList[numAliases], 0), true); " to generate data. > but now it uses " genUniqueJoinObject(0, 0); " to generate data. > This patch will solve this problem. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2526) "lastAceesTime" is always zero when executed through "describe extended " unlike "show table extende like " where lastAccessTime is updated.
[ https://issues.apache.org/jira/browse/HIVE-2526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2526: - Status: Open (was: Patch Available) > "lastAceesTime" is always zero when executed through "describe extended > " unlike "show table extende like " where > lastAccessTime is updated. > - > > Key: HIVE-2526 > URL: https://issues.apache.org/jira/browse/HIVE-2526 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 > Environment: Linux : SuSE 11 SP1 >Reporter: rohithsharma >Assignee: Priyadarshini >Priority: Minor > Attachments: HIVE-2526.patch > > > When the table is accessed(load),lastAccessTime is displaying updated > accessTime in > "show table extended like ".But "describe extended " > is always displaying zero. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2640) Add alterPartition to AlterHandler interface
[ https://issues.apache.org/jira/browse/HIVE-2640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2640: - Status: Open (was: Patch Available) > Add alterPartition to AlterHandler interface > > > Key: HIVE-2640 > URL: https://issues.apache.org/jira/browse/HIVE-2640 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2640.D699.1.patch > > > Adding alterPartition to the AlterHandler interface would allow for > customized functionality to be executed as part of altering a partition, much > like it is already allowed for alterTable. > Based on the name of the interface, and a comment in the AlterHandler code, > it looks like alterPartition was meant to be included along with alterTable. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2611) Make index table output of create index command if index is table based
[ https://issues.apache.org/jira/browse/HIVE-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2611: - Status: Open (was: Patch Available) > Make index table output of create index command if index is table based > --- > > Key: HIVE-2611 > URL: https://issues.apache.org/jira/browse/HIVE-2611 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2611.1.patch.txt, HIVE-2611.D705.1.patch, > HIVE-2611.D705.2.patch > > > If an index is table based, when that index is created a table is created to > contain that index. This should be listed in the output of the command. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2329) Not using map aggregation, fails to execute group-by after cluster-by with same key
[ https://issues.apache.org/jira/browse/HIVE-2329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2329: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Navis > Not using map aggregation, fails to execute group-by after cluster-by with > same key > --- > > Key: HIVE-2329 > URL: https://issues.apache.org/jira/browse/HIVE-2329 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2329.1.patch.txt, HIVE-2329.D657.1.patch > > > hive.map.aggr=false > select Q1.key_int1, sum(Q1.key_int1), sum(distinct Q1.key_int1) from (select > * from t1 cluster by key_int1) Q1 group by Q1.key_int1 > resulted.. > FAILED: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.MapRedTask > from hadoop logs.. > Caused by: java.lang.RuntimeException: cannot find field key from [] > at > org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getStandardStructFieldRef(ObjectInspectorUtils.java:321) > at > org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector.getStructFieldRef(StandardStructObjectInspector.java:119) > at > org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.initialize(ExprNodeColumnEvaluator.java:82) > at > org.apache.hadoop.hive.ql.exec.GroupByOperator.initializeOp(GroupByOperator.java:198) > at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) > at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:433) > > I think the problem is caused by ReduceSinkDeDuplication, removing RS which > was providing rs.key for GBY operation. If child of child RS is a GBY, we > should bypass the optimization. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2632) ignore exception for external jars via reflection
[ https://issues.apache.org/jira/browse/HIVE-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2632: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed by Yongqiang (via namit) > ignore exception for external jars via reflection > - > > Key: HIVE-2632 > URL: https://issues.apache.org/jira/browse/HIVE-2632 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2632.D639.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1909) create an option to ignore archived partitions
[ https://issues.apache.org/jira/browse/HIVE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1909: - Status: Open (was: Patch Available) > create an option to ignore archived partitions > -- > > Key: HIVE-1909 > URL: https://issues.apache.org/jira/browse/HIVE-1909 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Namit Jain >Assignee: Namit Jain > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2602) add support for insert partition overwrite(...) if not exists
[ https://issues.apache.org/jira/browse/HIVE-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2602: - Status: Open (was: Patch Available) > add support for insert partition overwrite(...) if not exists > - > > Key: HIVE-2602 > URL: https://issues.apache.org/jira/browse/HIVE-2602 > Project: Hive > Issue Type: New Feature >Reporter: Namit Jain >Assignee: Chinna Rao Lalam > Attachments: HIVE-2602.D579.1.patch, HIVE-2602.patch > > > INSERT OVERWRITE TABLE X PARTITION (a=b, c=d) IF NOT EXISTS ... > The partition should be created and written if and only if it's not there > already. > The support can be added for dynamic partitions in the future, but this jira > is for adding this support for static partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2632) ignore exception for external jars via reflection
[ https://issues.apache.org/jira/browse/HIVE-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2632: - Status: Patch Available (was: Open) > ignore exception for external jars via reflection > - > > Key: HIVE-2632 > URL: https://issues.apache.org/jira/browse/HIVE-2632 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2632.D639.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2632) ignore exception for external jars via reflection
[ https://issues.apache.org/jira/browse/HIVE-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2632: - Status: Open (was: Patch Available) > ignore exception for external jars via reflection > - > > Key: HIVE-2632 > URL: https://issues.apache.org/jira/browse/HIVE-2632 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2632.D639.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2632) ignore exception for external jars via reflection
[ https://issues.apache.org/jira/browse/HIVE-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2632: - Status: Patch Available (was: Open) > ignore exception for external jars via reflection > - > > Key: HIVE-2632 > URL: https://issues.apache.org/jira/browse/HIVE-2632 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2632.D639.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2634) revert HIVE-2566
[ https://issues.apache.org/jira/browse/HIVE-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2634: - Status: Patch Available (was: Open) > revert HIVE-2566 > > > Key: HIVE-2634 > URL: https://issues.apache.org/jira/browse/HIVE-2634 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2634.D651.1.patch > > > This is leading to some problems. > I will upload the offending testcase in a new jira. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1909) create an option to ignore archived partitions
[ https://issues.apache.org/jira/browse/HIVE-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1909: - Status: Patch Available (was: Open) > create an option to ignore archived partitions > -- > > Key: HIVE-1909 > URL: https://issues.apache.org/jira/browse/HIVE-1909 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Namit Jain >Assignee: Namit Jain > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2618) Describe partition returns table columns but should return partition columns
[ https://issues.apache.org/jira/browse/HIVE-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2618: - Status: Patch Available (was: Open) > Describe partition returns table columns but should return partition columns > > > Key: HIVE-2618 > URL: https://issues.apache.org/jira/browse/HIVE-2618 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Namit Jain > > If a partitioned table and some partitions are created, and then the table is > altered adding a columns, if describe is called on the partitions created > before the columns were added it will show the new columns, even though it > should not. In particular, in the metastore, the partition will not have > these columns. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2619) Add hook to run in metastore's endFunction which can collect more fb303 counters
[ https://issues.apache.org/jira/browse/HIVE-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2619: - Summary: Add hook to run in metastore's endFunction which can collect more fb303 counters (was: Add hook to run in meatastore's endFunction which can collect more fb303 counters) > Add hook to run in metastore's endFunction which can collect more fb303 > counters > > > Key: HIVE-2619 > URL: https://issues.apache.org/jira/browse/HIVE-2619 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2619.1.patch.txt, HIVE-2619.D555.1.patch, > HIVE-2619.D555.2.patch, HIVE-2619.D561.1.patch > > > Create the potential for hooks to run in the endFunction method of HMSHandler > which take the name of a function and whether or not it succeeded. Also, > override getCounters from fb303 to allow these hooks to add counters which > they collect, should this be desired. These hooks can be similar to > EventListeners, but they should be more generic. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2196) Ensure HiveConf includes all properties defined in hive-default.xml
[ https://issues.apache.org/jira/browse/HIVE-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2196: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Chinna > Ensure HiveConf includes all properties defined in hive-default.xml > --- > > Key: HIVE-2196 > URL: https://issues.apache.org/jira/browse/HIVE-2196 > Project: Hive > Issue Type: Bug > Components: Configuration >Affects Versions: 0.8.0 >Reporter: Carl Steinbach >Assignee: Chinna Rao Lalam > Attachments: HIVE-2196.1.patch, HIVE-2196.2.patch, HIVE-2196.3.patch, > HIVE-2196.4.patch, HIVE-2196.5.patch, HIVE-2196.6.patch, HIVE-2196.build.log, > HIVE-2196.patch > > > There are a bunch of properties that are defined in hive-default.xml but not > in HiveConf. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1003) optimize metadata only queries
[ https://issues.apache.org/jira/browse/HIVE-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1003: - Release Note: Added support for metadata only queries. (was: Added support for metadata only queries and DUAL table. DUAL becomes keyword - incompability with previous versions.) > optimize metadata only queries > -- > > Key: HIVE-1003 > URL: https://issues.apache.org/jira/browse/HIVE-1003 > Project: Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Namit Jain >Assignee: Marcin Kurczych > Fix For: 0.9.0 > > Attachments: D105.1.patch, D105.2.patch, HIVE-1003.1.patch, > hive.1003.2.patch, hive.1003.3.patch, hive.1003.4.patch > > > Queries like: > select max(ds) from T > where ds is a partitioning column should be optimized. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1237) select coalesce(null) from src dies
[ https://issues.apache.org/jira/browse/HIVE-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1237: - Status: Open (was: Patch Available) > select coalesce(null) from src dies > --- > > Key: HIVE-1237 > URL: https://issues.apache.org/jira/browse/HIVE-1237 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.7.0, 0.8.0 >Reporter: Namit Jain >Assignee: Ashutosh Chauhan > Attachments: hive-1237.patch, hive-1237_1.patch > > > select coalesce(null) from src ; > FAILED: Unknown exception: null -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2178) Log related Check style Comments fixes
[ https://issues.apache.org/jira/browse/HIVE-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2178: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Chinna > Log related Check style Comments fixes > -- > > Key: HIVE-2178 > URL: https://issues.apache.org/jira/browse/HIVE-2178 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.5.0, 0.8.0 > Environment: Hadoop 0.20.1, Hive0.8.0 and SUSE Linux Enterprise > Server 10 SP2 (i586) - Kernel 2.6.16.60-0.21-smp (5) >Reporter: Chinna Rao Lalam >Assignee: Chinna Rao Lalam > Attachments: D291.1.patch, HIVE-2178.1.patch, HIVE-2178.2.patch, > HIVE-2178.3.patch, HIVE-2178.4.patch, HIVE-2178.5.patch, HIVE-2178.patch > > > Fix Log related Check style Comments -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2017) Driver.execute() should maintaining SessionState in case of runtime errors
[
https://issues.apache.org/jira/browse/HIVE-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-2017:
-
Status: Open (was: Patch Available)
> Driver.execute() should maintaining SessionState in case of runtime errors
> --
>
> Key: HIVE-2017
> URL: https://issues.apache.org/jira/browse/HIVE-2017
> Project: Hive
> Issue Type: Bug
>Reporter: Ning Zhang
>Assignee: Chinna Rao Lalam
> Attachments: HIVE-2017.1.patch, HIVE-2017.2.patch, HIVE-2017.3.patch,
> HIVE-2017.4.patch
>
>
> Here's a snippet from Driver.execute():
> {code}
> // TODO: This error messaging is not very informative. Fix that.
> errorMessage = "FAILED: Execution Error, return code " + exitVal
> + " from "
> + tsk.getClass().getName();
> SQLState = "08S01";
> console.printError(errorMessage);
> if (running.size() != 0) {
> taskCleanup();
> }
> return 9;
> {code}
> I simply returned in case of runtime errors without maintaining SessionState.
> It could cause resource leak mentioned in HIVE-1959.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2196) Ensure HiveConf includes all properties defined in hive-default.xml
[ https://issues.apache.org/jira/browse/HIVE-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2196: - Status: Open (was: Patch Available) And, also please mark it as 'Patch Available' so that everyone takes a look > Ensure HiveConf includes all properties defined in hive-default.xml > --- > > Key: HIVE-2196 > URL: https://issues.apache.org/jira/browse/HIVE-2196 > Project: Hive > Issue Type: Bug > Components: Configuration >Affects Versions: 0.8.0 >Reporter: Carl Steinbach >Assignee: Chinna Rao Lalam > Attachments: HIVE-2196.1.patch, HIVE-2196.2.patch, HIVE-2196.3.patch, > HIVE-2196.4.patch, HIVE-2196.5.patch, HIVE-2196.build.log, HIVE-2196.patch > > > There are a bunch of properties that are defined in hive-default.xml but not > in HiveConf. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2466) mapjoin_subquery dump small table (mapjoin table) to the same file
[ https://issues.apache.org/jira/browse/HIVE-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2466: - Status: Open (was: Patch Available) > mapjoin_subquery dump small table (mapjoin table) to the same file > --- > > Key: HIVE-2466 > URL: https://issues.apache.org/jira/browse/HIVE-2466 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.7.1 >Reporter: binlijin >Assignee: binlijin >Priority: Blocker > Attachments: D285.1.patch, hive-2466.1.patch, hive-2466.2.patch, > hive-2466.3.patch > > > in mapjoin_subquery.q there is a query： > SELECT /*+ MAPJOIN(z) */ subq.key1, z.value > FROM > (SELECT /*+ MAPJOIN(x) */ x.key as key1, x.value as value1, y.key as key2, > y.value as value2 > FROM src1 x JOIN src y ON (x.key = y.key)) subq > JOIN srcpart z ON (subq.key1 = z.key and z.ds='2008-04-08' and z.hr=11); > when dump x and z to a local file,there all dump to the same file, so we lost > the data of x -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2546) add explain formatted
[ https://issues.apache.org/jira/browse/HIVE-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2546: - Status: Patch Available (was: Open) Made some of the methods static so that they can be invoked from a standalone hook (if needed) > add explain formatted > - > > Key: HIVE-2546 > URL: https://issues.apache.org/jira/browse/HIVE-2546 > Project: Hive > Issue Type: Improvement >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: D261.1.patch, hive.2546.1.patch > > > The output can be a json string. > This can be easily parsed by some program that way. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
