[jira] [Updated] (HIVE-2599) Support Composit/Compound Keys with HBaseStorageHandler
[ https://issues.apache.org/jira/browse/HIVE-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-2599: - Labels: (was: TODOC13) > Support Composit/Compound Keys with HBaseStorageHandler > --- > > Key: HIVE-2599 > URL: https://issues.apache.org/jira/browse/HIVE-2599 > Project: Hive > Issue Type: Improvement > Components: HBase Handler >Affects Versions: 0.8.0 >Reporter: Hans Uhlig >Assignee: Swarnim Kulkarni > Fix For: 0.13.0 > > Attachments: HIVE-2599.1.patch.txt, HIVE-2599.2.patch.txt, > HIVE-2599.2.patch.txt, HIVE-2599.3.patch.txt, HIVE-2599.4.patch.txt > > > It would be really nice for hive to be able to understand composite keys from > an underlying HBase schema. Currently we have to store key fields twice to be > able to both key and make data available. I noticed John Sichi mentioned in > HIVE-1228 that this would be a separate issue but I cant find any follow up. > How feasible is this in the HBaseStorageHandler? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-2599) Support Composit/Compound Keys with HBaseStorageHandler
[ https://issues.apache.org/jira/browse/HIVE-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576667#comment-14576667 ] Lefty Leverenz commented on HIVE-2599: -- Doc note: [~amains12] documented this in the HBase Integration wikidoc, so I'm removing the TODOC13 label. Thanks Andrew! * [HBase Integration -- Simple Composite Row Keys | https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration#HBaseIntegration-SimpleCompositeRowKeys] > Support Composit/Compound Keys with HBaseStorageHandler > --- > > Key: HIVE-2599 > URL: https://issues.apache.org/jira/browse/HIVE-2599 > Project: Hive > Issue Type: Improvement > Components: HBase Handler >Affects Versions: 0.8.0 >Reporter: Hans Uhlig >Assignee: Swarnim Kulkarni > Fix For: 0.13.0 > > Attachments: HIVE-2599.1.patch.txt, HIVE-2599.2.patch.txt, > HIVE-2599.2.patch.txt, HIVE-2599.3.patch.txt, HIVE-2599.4.patch.txt > > > It would be really nice for hive to be able to understand composite keys from > an underlying HBase schema. Currently we have to store key fields twice to be > able to both key and make data available. I noticed John Sichi mentioned in > HIVE-1228 that this would be a separate issue but I cant find any follow up. > How feasible is this in the HBaseStorageHandler? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-6411) Support more generic way of using composite key for HBaseHandler
[ https://issues.apache.org/jira/browse/HIVE-6411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576663#comment-14576663 ] Lefty Leverenz commented on HIVE-6411: -- [~amains12] documented this in the wiki so I'm removing the TODOC14 label. Thanks Andrew! * [HBaseIntegration -- Complex Composite Row Keys and HBaseKeyFactory | https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration#HBaseIntegration-ComplexCompositeRowKeysandHBaseKeyFactory] Note that the doc has a TODO (so maybe the TODOC14 label should be restored): bq. "hbase.composite.key.factory" should be the fully qualified class name of a class implementing HBaseKeyFactory. See SampleHBaseKeyFactory2 for a fixed length example in the same package. This class must be on your classpath in order for the above example to work. TODO: place these in an accessible place; they're currently only in test code. > Support more generic way of using composite key for HBaseHandler > > > Key: HIVE-6411 > URL: https://issues.apache.org/jira/browse/HIVE-6411 > Project: Hive > Issue Type: Improvement > Components: HBase Handler >Reporter: Navis >Assignee: Navis >Priority: Minor > Fix For: 0.14.0 > > Attachments: HIVE-6411.1.patch.txt, HIVE-6411.10.patch.txt, > HIVE-6411.11.patch.txt, HIVE-6411.2.patch.txt, HIVE-6411.3.patch.txt, > HIVE-6411.4.patch.txt, HIVE-6411.5.patch.txt, HIVE-6411.6.patch.txt, > HIVE-6411.7.patch.txt, HIVE-6411.8.patch.txt, HIVE-6411.9.patch.txt > > > HIVE-2599 introduced using custom object for the row key. But it forces key > objects to extend HBaseCompositeKey, which is again extension of LazyStruct. > If user provides proper Object and OI, we can replace internal key and keyOI > with those. > Initial implementation is based on factory interface. > {code} > public interface HBaseKeyFactory { > void init(SerDeParameters parameters, Properties properties) throws > SerDeException; > ObjectInspector createObjectInspector(TypeInfo type) throws SerDeException; > LazyObjectBase createObject(ObjectInspector inspector) throws > SerDeException; > } > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-6411) Support more generic way of using composite key for HBaseHandler
[ https://issues.apache.org/jira/browse/HIVE-6411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-6411: - Labels: (was: TODOC14) > Support more generic way of using composite key for HBaseHandler > > > Key: HIVE-6411 > URL: https://issues.apache.org/jira/browse/HIVE-6411 > Project: Hive > Issue Type: Improvement > Components: HBase Handler >Reporter: Navis >Assignee: Navis >Priority: Minor > Fix For: 0.14.0 > > Attachments: HIVE-6411.1.patch.txt, HIVE-6411.10.patch.txt, > HIVE-6411.11.patch.txt, HIVE-6411.2.patch.txt, HIVE-6411.3.patch.txt, > HIVE-6411.4.patch.txt, HIVE-6411.5.patch.txt, HIVE-6411.6.patch.txt, > HIVE-6411.7.patch.txt, HIVE-6411.8.patch.txt, HIVE-6411.9.patch.txt > > > HIVE-2599 introduced using custom object for the row key. But it forces key > objects to extend HBaseCompositeKey, which is again extension of LazyStruct. > If user provides proper Object and OI, we can replace internal key and keyOI > with those. > Initial implementation is based on factory interface. > {code} > public interface HBaseKeyFactory { > void init(SerDeParameters parameters, Properties properties) throws > SerDeException; > ObjectInspector createObjectInspector(TypeInfo type) throws SerDeException; > LazyObjectBase createObject(ObjectInspector inspector) throws > SerDeException; > } > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10959) Templeton launcher job should reconnect to the running child job on task retry
[ https://issues.apache.org/jira/browse/HIVE-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Mitic updated HIVE-10959: -- Summary: Templeton launcher job should reconnect to the running child job on task retry (was: Templeton launcher job should reconnect to the running child job on its task retry when RMHA is enabled) > Templeton launcher job should reconnect to the running child job on task retry > -- > > Key: HIVE-10959 > URL: https://issues.apache.org/jira/browse/HIVE-10959 > Project: Hive > Issue Type: Bug > Components: WebHCat >Affects Versions: 0.15.0 >Reporter: Ivan Mitic >Assignee: Ivan Mitic > > Currently, Templeton launcher kills all child jobs (jobs tagged with the > parent job's id) upon task retry. > Upon templeton launcher task retry, templeton should reconnect to the running > job and continue tracking its progress that way. > This logic cannot be used for all job kinds (e.g. for jobs that are driven by > the client side like regular hive). However, for MapReduceV2, and possibly > Tez and HiveOnTez, this should be the default. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8931) Test TestAccumuloCliDriver is not completing
[ https://issues.apache.org/jira/browse/HIVE-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576492#comment-14576492 ] Hive QA commented on HIVE-8931: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12738271/HIVE-8931.003.patch {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9003 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_index_bitmap_auto {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4208/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4208/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4208/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12738271 - PreCommit-HIVE-TRUNK-Build > Test TestAccumuloCliDriver is not completing > > > Key: HIVE-8931 > URL: https://issues.apache.org/jira/browse/HIVE-8931 > Project: Hive > Issue Type: Bug >Reporter: Brock Noland >Assignee: Josh Elser > Fix For: 1.2.1 > > Attachments: HIVE-8931.001.patch, HIVE-8931.002.patch, > HIVE-8931.003.patch > > > Tests are taking 3 hours due to {{TestAccumuloCliDriver}} not finishing. > Logs: > http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1848/failed/TestAccumuloCliDriver/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10447) Beeline JDBC Driver to support 2 way SSL
[ https://issues.apache.org/jira/browse/HIVE-10447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-10447: -- Labels: (was: TODOC1.2) > Beeline JDBC Driver to support 2 way SSL > > > Key: HIVE-10447 > URL: https://issues.apache.org/jira/browse/HIVE-10447 > Project: Hive > Issue Type: Bug > Components: Beeline >Reporter: Hari Sankar Sivarama Subramaniyan >Assignee: Hari Sankar Sivarama Subramaniyan > Fix For: 1.2.0 > > Attachments: HIVE-10447.1.patch, HIVE-10447.2.patch, > HIVE-10447.2.patch > > > This jira should cover 2-way SSL authentication between the JDBC Client and > server which requires the driver to support it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10447) Beeline JDBC Driver to support 2 way SSL
[ https://issues.apache.org/jira/browse/HIVE-10447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576487#comment-14576487 ] Lefty Leverenz commented on HIVE-10447: --- Looks good, thanks [~hsubramaniyan]! Removing the TODOC1.2 label. > Beeline JDBC Driver to support 2 way SSL > > > Key: HIVE-10447 > URL: https://issues.apache.org/jira/browse/HIVE-10447 > Project: Hive > Issue Type: Bug > Components: Beeline >Reporter: Hari Sankar Sivarama Subramaniyan >Assignee: Hari Sankar Sivarama Subramaniyan > Fix For: 1.2.0 > > Attachments: HIVE-10447.1.patch, HIVE-10447.2.patch, > HIVE-10447.2.patch > > > This jira should cover 2-way SSL authentication between the JDBC Client and > server which requires the driver to support it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-6758) Beeline doesn't work with -e option when started in background
[ https://issues.apache.org/jira/browse/HIVE-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576475#comment-14576475 ] Lefty Leverenz commented on HIVE-6758: -- Removed TODOC1.2 label. > Beeline doesn't work with -e option when started in background > -- > > Key: HIVE-6758 > URL: https://issues.apache.org/jira/browse/HIVE-6758 > Project: Hive > Issue Type: Improvement > Components: CLI >Affects Versions: 0.11.0, 0.14.0 >Reporter: Johndee Burks >Assignee: Mohit Sabharwal > Attachments: HIVE-6758.patch > > > In hive CLI you could easily integrate its use into a script and back ground > the process like this: > hive -e "some query" & > Beeline does not run when you do the same even with the -f switch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-6758) Beeline doesn't work with -e option when started in background
[ https://issues.apache.org/jira/browse/HIVE-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-6758: - Labels: (was: TODOC1.2) > Beeline doesn't work with -e option when started in background > -- > > Key: HIVE-6758 > URL: https://issues.apache.org/jira/browse/HIVE-6758 > Project: Hive > Issue Type: Improvement > Components: CLI >Affects Versions: 0.11.0, 0.14.0 >Reporter: Johndee Burks >Assignee: Mohit Sabharwal > Attachments: HIVE-6758.patch > > > In hive CLI you could easily integrate its use into a script and back ground > the process like this: > hive -e "some query" & > Beeline does not run when you do the same even with the -f switch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8931) Test TestAccumuloCliDriver is not completing
[ https://issues.apache.org/jira/browse/HIVE-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576447#comment-14576447 ] Hive QA commented on HIVE-8931: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12738266/HIVE-8931.002.patch {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9003 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_autogen_colalias {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4207/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4207/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4207/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12738266 - PreCommit-HIVE-TRUNK-Build > Test TestAccumuloCliDriver is not completing > > > Key: HIVE-8931 > URL: https://issues.apache.org/jira/browse/HIVE-8931 > Project: Hive > Issue Type: Bug >Reporter: Brock Noland >Assignee: Josh Elser > Fix For: 1.2.1 > > Attachments: HIVE-8931.001.patch, HIVE-8931.002.patch, > HIVE-8931.003.patch > > > Tests are taking 3 hours due to {{TestAccumuloCliDriver}} not finishing. > Logs: > http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1848/failed/TestAccumuloCliDriver/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8931) Test TestAccumuloCliDriver is not completing
[ https://issues.apache.org/jira/browse/HIVE-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HIVE-8931: - Fix Version/s: (was: 0.12.1) 1.2.1 > Test TestAccumuloCliDriver is not completing > > > Key: HIVE-8931 > URL: https://issues.apache.org/jira/browse/HIVE-8931 > Project: Hive > Issue Type: Bug >Reporter: Brock Noland >Assignee: Josh Elser > Fix For: 1.2.1 > > Attachments: HIVE-8931.001.patch, HIVE-8931.002.patch, > HIVE-8931.003.patch > > > Tests are taking 3 hours due to {{TestAccumuloCliDriver}} not finishing. > Logs: > http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1848/failed/TestAccumuloCliDriver/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8931) Test TestAccumuloCliDriver is not completing
[ https://issues.apache.org/jira/browse/HIVE-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HIVE-8931: - Attachment: HIVE-8931.003.patch Just missed the fastbit dependency. All AccumuloStorageHandler tests passed for me after that. > Test TestAccumuloCliDriver is not completing > > > Key: HIVE-8931 > URL: https://issues.apache.org/jira/browse/HIVE-8931 > Project: Hive > Issue Type: Bug >Reporter: Brock Noland >Assignee: Josh Elser > Fix For: 0.12.1 > > Attachments: HIVE-8931.001.patch, HIVE-8931.002.patch, > HIVE-8931.003.patch > > > Tests are taking 3 hours due to {{TestAccumuloCliDriver}} not finishing. > Logs: > http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1848/failed/TestAccumuloCliDriver/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8931) Test TestAccumuloCliDriver is not completing
[ https://issues.apache.org/jira/browse/HIVE-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576409#comment-14576409 ] Josh Elser commented on HIVE-8931: -- Drat, a few test failures due to having to work around the shaded hive-exec jar. > Test TestAccumuloCliDriver is not completing > > > Key: HIVE-8931 > URL: https://issues.apache.org/jira/browse/HIVE-8931 > Project: Hive > Issue Type: Bug >Reporter: Brock Noland >Assignee: Josh Elser > Fix For: 0.12.1 > > Attachments: HIVE-8931.001.patch, HIVE-8931.002.patch > > > Tests are taking 3 hours due to {{TestAccumuloCliDriver}} not finishing. > Logs: > http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1848/failed/TestAccumuloCliDriver/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-8931) Test TestAccumuloCliDriver is not completing
[ https://issues.apache.org/jira/browse/HIVE-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HIVE-8931: - Attachment: HIVE-8931.002.patch v2 against master instead of branch-1.2. No difference other than the version in the pom which is what caused the precommit to fail. > Test TestAccumuloCliDriver is not completing > > > Key: HIVE-8931 > URL: https://issues.apache.org/jira/browse/HIVE-8931 > Project: Hive > Issue Type: Bug >Reporter: Brock Noland >Assignee: Josh Elser > Fix For: 0.12.1 > > Attachments: HIVE-8931.001.patch, HIVE-8931.002.patch > > > Tests are taking 3 hours due to {{TestAccumuloCliDriver}} not finishing. > Logs: > http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1848/failed/TestAccumuloCliDriver/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10911) Add support for date datatype in the value based windowing function
[ https://issues.apache.org/jira/browse/HIVE-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576142#comment-14576142 ] Lefty Leverenz commented on HIVE-10911: --- Doc note: This should be documented in the Windowing and Analytics doc for release 2.0.0. * [Windowing and Analytics Functions | https://cwiki.apache.org/confluence/display/Hive/LanguageManual+WindowingAndAnalytics] > Add support for date datatype in the value based windowing function > --- > > Key: HIVE-10911 > URL: https://issues.apache.org/jira/browse/HIVE-10911 > Project: Hive > Issue Type: Sub-task > Components: PTF-Windowing >Affects Versions: 1.3.0 >Reporter: Aihua Xu >Assignee: Aihua Xu > Labels: TODOC2.0 > Fix For: 2.0.0 > > Attachments: HIVE-10911.patch > > > Currently date datatype is not supported in value based windowing function. > For the following query with hiredate to be date type, an exception will be > thrown. > {{select deptno, ename, hiredate, sal, sum(sal) over (partition by deptno > order by hiredate range 90 preceding) from emp;}} > It's valuable to support such type with number of days as the value > difference. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10911) Add support for date datatype in the value based windowing function
[ https://issues.apache.org/jira/browse/HIVE-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-10911: -- Labels: TODOC2.0 (was: ) > Add support for date datatype in the value based windowing function > --- > > Key: HIVE-10911 > URL: https://issues.apache.org/jira/browse/HIVE-10911 > Project: Hive > Issue Type: Sub-task > Components: PTF-Windowing >Affects Versions: 1.3.0 >Reporter: Aihua Xu >Assignee: Aihua Xu > Labels: TODOC2.0 > Fix For: 2.0.0 > > Attachments: HIVE-10911.patch > > > Currently date datatype is not supported in value based windowing function. > For the following query with hiredate to be date type, an exception will be > thrown. > {{select deptno, ename, hiredate, sal, sum(sal) over (partition by deptno > order by hiredate range 90 preceding) from emp;}} > It's valuable to support such type with number of days as the value > difference. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10957) QueryPlan's start time is incorrect in certain cases
[ https://issues.apache.org/jira/browse/HIVE-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576133#comment-14576133 ] Wei Zheng commented on HIVE-10957: -- Saw those 3 test failures in preceding test runs. Shouldn't be related to this JIRA. > QueryPlan's start time is incorrect in certain cases > > > Key: HIVE-10957 > URL: https://issues.apache.org/jira/browse/HIVE-10957 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Wei Zheng > Attachments: HIVE-10957.1.patch, HIVE-10957.2.patch > > > In some cases the start time of the previous query is used mistakenly. -- This message was sent by Atlassian JIRA (v6.3.4#6332)