[jira] [Commented] (HIVE-2608) Do not require AS a,b,c part in LATERAL VIEW
[ https://issues.apache.org/jira/browse/HIVE-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707970#comment-13707970 ] Phabricator commented on HIVE-2608: --- ashutoshc has requested changes to the revision "HIVE-2608 [jira] Do not require AS a,b,c part in LATERAL VIEW". INLINE COMMENTS ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java:2503 I think this ErrorMsg enum can now be removed from ErrorMsg.java altogether. If so, it will be good to remove this to avoid confusion. REVISION DETAIL https://reviews.facebook.net/D4317 BRANCH HIVE-2608 ARCANIST PROJECT hive To: JIRA, ashutoshc, navis Cc: ikabiljo > Do not require AS a,b,c part in LATERAL VIEW > > > Key: HIVE-2608 > URL: https://issues.apache.org/jira/browse/HIVE-2608 > Project: Hive > Issue Type: Improvement > Components: Query Processor, UDF >Reporter: Igor Kabiljo >Assignee: Navis >Priority: Minor > Attachments: HIVE-2608.D4317.5.patch, HIVE-2608.D4317.6.patch > > > Currently, it is required to state column names when LATERAL VIEW is used. > That shouldn't be necessary, since UDTF returns struct which contains column > names - and they should be used by default. > For example, it would be great if this was possible: > SELECT t.*, t.key1 + t.key4 > FROM some_table > LATERAL VIEW JSON_TUPLE(json, 'key1', 'key2', 'key3', 'key3') t; -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4675) Create new parallel unit test environment
[ https://issues.apache.org/jira/browse/HIVE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707969#comment-13707969 ] Ashutosh Chauhan commented on HIVE-4675: I for one hasn't gotten around to look at this one. Quite a big patch, so need to allocate continuous amount of time for it : ) I am fine with combining two patches. > Create new parallel unit test environment > - > > Key: HIVE-4675 > URL: https://issues.apache.org/jira/browse/HIVE-4675 > Project: Hive > Issue Type: Improvement > Components: Testing Infrastructure >Reporter: Brock Noland >Assignee: Brock Noland > Fix For: 0.12.0 > > Attachments: HIVE-4675.patch > > > The current ptest tool is great, but it has the following limitations: > -Requires an NFS filer > -Unless the NFS filer is dedicated ptests can become IO bound easily > -Investigating of failures is troublesome because the source directory for > the failure is not saved > -Ignoring or isolated tests is not supported > -No unit tests for the ptest framework exist > It'd be great to have a ptest tool that addresses this limitations. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4852) -Dbuild.profile=core fails
[ https://issues.apache.org/jira/browse/HIVE-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707967#comment-13707967 ] Ashutosh Chauhan commented on HIVE-4852: +1 > -Dbuild.profile=core fails > -- > > Key: HIVE-4852 > URL: https://issues.apache.org/jira/browse/HIVE-4852 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4852.1.patch > > > Core profile fails because of an added chmod to some hcat files. Simple fix: > Check if modules contains hcat before running the command. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4853) junit timeout needs to be updated
[ https://issues.apache.org/jira/browse/HIVE-4853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707966#comment-13707966 ] Ashutosh Chauhan commented on HIVE-4853: Increasing timeout probably is fine. However, I have noticed recently timestamp1.q & timestamp2.q has started taking inordinately long time in my builds. Sometimes more than an hour. They need to be looked closely. > junit timeout needs to be updated > - > > Key: HIVE-4853 > URL: https://issues.apache.org/jira/browse/HIVE-4853 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4853.1.patch > > > All the ptf, join etc tests we've added recently have pushed the junit time > for TestCliDriver past the timout value on most machines (if run serially). > The build machine uses it's own value - so you don't see it there. But when > running locally it can be a real downer if you find out that the tests were > aborted due to timeout. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4854) testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707965#comment-13707965 ] Ashutosh Chauhan commented on HIVE-4854: +1 > testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2 > - > > Key: HIVE-4854 > URL: https://issues.apache.org/jira/browse/HIVE-4854 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4854.1.patch > > > Problem is with mkdir command. It tries to generate multiple directories at > once without the right flag. That works only on the 1 line. Simple fix to the > test should do the trick -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4388) HBase tests fail against Hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707964#comment-13707964 ] Ashutosh Chauhan commented on HIVE-4388: This is less than ideal because: * These will not be *official* builds. * Infra guys don't recommend hosting anything on people.apache.org We can probably look over first, but I will be wary of second. Is it possible to host it on any other neutral place? > HBase tests fail against Hadoop 2 > - > > Key: HIVE-4388 > URL: https://issues.apache.org/jira/browse/HIVE-4388 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner > > Currently we're building by default against 0.92. When you run against hadoop > 2 (-Dhadoop.mr.rev=23) builds fail because of: HBASE-5963. > HIVE-3861 upgrades the version of hbase used. This will get you past the > problem in HBASE-5963 (which was fixed in 0.94.1) but fails with: HBASE-6396. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4388) HBase tests fail against Hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707964#comment-13707964 ] Ashutosh Chauhan commented on HIVE-4388: This is less than ideal because: * These will not be *official* builds. * Infra guys don't recommend hosting anything on people.apache.org We can probably look over first, but I will be wary of second. Is it possible to host it on any other neutral place? > HBase tests fail against Hadoop 2 > - > > Key: HIVE-4388 > URL: https://issues.apache.org/jira/browse/HIVE-4388 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner > > Currently we're building by default against 0.92. When you run against hadoop > 2 (-Dhadoop.mr.rev=23) builds fail because of: HBASE-5963. > HIVE-3861 upgrades the version of hbase used. This will get you past the > problem in HBASE-5963 (which was fixed in 0.94.1) but fails with: HBASE-6396. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4721) Fix TestCliDriver.ptf_npath.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707960#comment-13707960
]
Ashutosh Chauhan commented on HIVE-4721:
+1
> Fix TestCliDriver.ptf_npath.q on 0.23
> -
>
> Key: HIVE-4721
> URL: https://issues.apache.org/jira/browse/HIVE-4721
> Project: Hive
> Issue Type: Sub-task
>Reporter: Brock Noland
>Assignee: Gunther Hagleitner
> Attachments: HIVE-4721.1.patch
>
>
> In HIVE-4717 I tried changing the last line of ptf_npath.q from:
> {noformat}
> where fl_num = 1142;
> {noformat}
> to:
> {noformat}
> where fl_num = 1142 order by origin_city_name, fl_num, year, month,
> day_of_month, sz, tpath;
> {noformat}
> in order to make the test deterministic. However this results, not just
> different order, in different results for 0.23 and 0.20S.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4388) HBase tests fail against Hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707957#comment-13707957 ] Brock Noland commented on HIVE-4388: Is anyone opposed to using a custom published 0.94 artifact on people.apache.org? > HBase tests fail against Hadoop 2 > - > > Key: HIVE-4388 > URL: https://issues.apache.org/jira/browse/HIVE-4388 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner > > Currently we're building by default against 0.92. When you run against hadoop > 2 (-Dhadoop.mr.rev=23) builds fail because of: HBASE-5963. > HIVE-3861 upgrades the version of hbase used. This will get you past the > problem in HBASE-5963 (which was fixed in 0.94.1) but fails with: HBASE-6396. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4721) Fix TestCliDriver.ptf_npath.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707956#comment-13707956
]
Brock Noland commented on HIVE-4721:
Good call! To test the test-patch build I ran the full unit test suite and
everything looks good:
https://builds.apache.org/user/brock/my-views/view/hive/job/Hive-Test-Patch-trunk-hadoop1-ptest/10/testReport/
> Fix TestCliDriver.ptf_npath.q on 0.23
> -
>
> Key: HIVE-4721
> URL: https://issues.apache.org/jira/browse/HIVE-4721
> Project: Hive
> Issue Type: Sub-task
>Reporter: Brock Noland
>Assignee: Gunther Hagleitner
> Attachments: HIVE-4721.1.patch
>
>
> In HIVE-4717 I tried changing the last line of ptf_npath.q from:
> {noformat}
> where fl_num = 1142;
> {noformat}
> to:
> {noformat}
> where fl_num = 1142 order by origin_city_name, fl_num, year, month,
> day_of_month, sz, tpath;
> {noformat}
> in order to make the test deterministic. However this results, not just
> different order, in different results for 0.23 and 0.20S.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4840) Fix eclipse template classpath to include the BoneCP lib
[ https://issues.apache.org/jira/browse/HIVE-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707948#comment-13707948 ] Hudson commented on HIVE-4840: -- SUCCESS: Integrated in Hive-Test-Patch-trunk-hadoop1-ptest #10 (See [https://builds.apache.org/job/Hive-Test-Patch-trunk-hadoop1-ptest/10/]) HIVE-4840 : Fix eclipse template classpath to include the BoneCP lib (Yin Huai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1502678) * /hive/trunk/eclipse-templates/.classpath * /hive/trunk/hcatalog/src/test/e2e/hcatalog/drivers/Util.pm > Fix eclipse template classpath to include the BoneCP lib > > > Key: HIVE-4840 > URL: https://issues.apache.org/jira/browse/HIVE-4840 > Project: Hive > Issue Type: Bug >Reporter: Yin Huai >Assignee: Yin Huai >Priority: Trivial > Fix For: 0.12.0 > > Attachments: HIVE-4840.patch.txt > > > HIVE-4807 did not change the classpath in eclipse template accordingly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4658) Make KW_OUTER optional in outer joins
[ https://issues.apache.org/jira/browse/HIVE-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707949#comment-13707949 ] Hudson commented on HIVE-4658: -- SUCCESS: Integrated in Hive-Test-Patch-trunk-hadoop1-ptest #10 (See [https://builds.apache.org/job/Hive-Test-Patch-trunk-hadoop1-ptest/10/]) HIVE-4658 : Make KW_OUTER optional in outer joins (Edward Capriolo via Navis) (navis: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1502758) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/FromClauseParser.g * /hive/trunk/ql/src/test/queries/clientpositive/optional_outer.q * /hive/trunk/ql/src/test/results/clientpositive/optional_outer.q.out > Make KW_OUTER optional in outer joins > - > > Key: HIVE-4658 > URL: https://issues.apache.org/jira/browse/HIVE-4658 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Navis >Assignee: Edward Capriolo >Priority: Trivial > Fix For: 0.12.0 > > Attachments: hive-4658.2.patch.txt, HIVE-4658.D11091.1.patch > > > For really trivial migration issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4290) Build profiles: Partial builds for quicker dev
[ https://issues.apache.org/jira/browse/HIVE-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707950#comment-13707950 ] Hudson commented on HIVE-4290: -- SUCCESS: Integrated in Hive-Test-Patch-trunk-hadoop1-ptest #10 (See [https://builds.apache.org/job/Hive-Test-Patch-trunk-hadoop1-ptest/10/]) HIVE-4290 : Build profiles: Partial builds for quicker dev (Gunther Hagleitner via Navis) (navis: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1502760) * /hive/trunk/build.properties * /hive/trunk/build.xml * /hive/trunk/ql/build.xml * /hive/trunk/ql/ivy.xml > Build profiles: Partial builds for quicker dev > -- > > Key: HIVE-4290 > URL: https://issues.apache.org/jira/browse/HIVE-4290 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Fix For: 0.12.0 > > Attachments: HIVE-4290.2.patch, HIVE-4290.D11481.1.patch, > HIVE-4290.patch > > > Building is definitely taking longer with hcat, hs2 etc in the build. When > you're working on one area of the system though, it would be easier to have > an option to only build that. Not for pre-commit or build machines, but for > dev this should help. > ant clean package build OR > ant -Dbuild.profile=full clean package test --> build everything > ant -Dbuild.profile=core clean package test --> build just enough to run the > tests in ql > ant -Dbuild.profile=hcat clean package test --> build only hcatalog -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4854) testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-4854: - Attachment: HIVE-4854.1.patch > testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2 > - > > Key: HIVE-4854 > URL: https://issues.apache.org/jira/browse/HIVE-4854 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4854.1.patch > > > Problem is with mkdir command. It tries to generate multiple directories at > once without the right flag. That works only on the 1 line. Simple fix to the > test should do the trick -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4854) testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707878#comment-13707878 ] Gunther Hagleitner commented on HIVE-4854: -- Tried on both 1 line and 2 line. Works on both. > testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2 > - > > Key: HIVE-4854 > URL: https://issues.apache.org/jira/browse/HIVE-4854 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4854.1.patch > > > Problem is with mkdir command. It tries to generate multiple directories at > once without the right flag. That works only on the 1 line. Simple fix to the > test should do the trick -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4854) testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-4854: - Status: Patch Available (was: Open) > testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2 > - > > Key: HIVE-4854 > URL: https://issues.apache.org/jira/browse/HIVE-4854 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4854.1.patch > > > Problem is with mkdir command. It tries to generate multiple directories at > once without the right flag. That works only on the 1 line. Simple fix to the > test should do the trick -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4854) testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2
Gunther Hagleitner created HIVE-4854: Summary: testCliDriver_load_hdfs_file_with_space_in_the_name fails on hadoop 2 Key: HIVE-4854 URL: https://issues.apache.org/jira/browse/HIVE-4854 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Problem is with mkdir command. It tries to generate multiple directories at once without the right flag. That works only on the 1 line. Simple fix to the test should do the trick -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4853) junit timeout needs to be updated
[ https://issues.apache.org/jira/browse/HIVE-4853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-4853: - Attachment: HIVE-4853.1.patch > junit timeout needs to be updated > - > > Key: HIVE-4853 > URL: https://issues.apache.org/jira/browse/HIVE-4853 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4853.1.patch > > > All the ptf, join etc tests we've added recently have pushed the junit time > for TestCliDriver past the timout value on most machines (if run serially). > The build machine uses it's own value - so you don't see it there. But when > running locally it can be a real downer if you find out that the tests were > aborted due to timeout. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4853) junit timeout needs to be updated
[ https://issues.apache.org/jira/browse/HIVE-4853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-4853: - Status: Patch Available (was: Open) > junit timeout needs to be updated > - > > Key: HIVE-4853 > URL: https://issues.apache.org/jira/browse/HIVE-4853 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4853.1.patch > > > All the ptf, join etc tests we've added recently have pushed the junit time > for TestCliDriver past the timout value on most machines (if run serially). > The build machine uses it's own value - so you don't see it there. But when > running locally it can be a real downer if you find out that the tests were > aborted due to timeout. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4853) junit timeout needs to be updated
Gunther Hagleitner created HIVE-4853: Summary: junit timeout needs to be updated Key: HIVE-4853 URL: https://issues.apache.org/jira/browse/HIVE-4853 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner All the ptf, join etc tests we've added recently have pushed the junit time for TestCliDriver past the timout value on most machines (if run serially). The build machine uses it's own value - so you don't see it there. But when running locally it can be a real downer if you find out that the tests were aborted due to timeout. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4721) Fix TestCliDriver.ptf_npath.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gunther Hagleitner updated HIVE-4721:
-
Status: Patch Available (was: Open)
> Fix TestCliDriver.ptf_npath.q on 0.23
> -
>
> Key: HIVE-4721
> URL: https://issues.apache.org/jira/browse/HIVE-4721
> Project: Hive
> Issue Type: Sub-task
>Reporter: Brock Noland
>Assignee: Gunther Hagleitner
> Attachments: HIVE-4721.1.patch
>
>
> In HIVE-4717 I tried changing the last line of ptf_npath.q from:
> {noformat}
> where fl_num = 1142;
> {noformat}
> to:
> {noformat}
> where fl_num = 1142 order by origin_city_name, fl_num, year, month,
> day_of_month, sz, tpath;
> {noformat}
> in order to make the test deterministic. However this results, not just
> different order, in different results for 0.23 and 0.20S.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4721) Fix TestCliDriver.ptf_npath.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707865#comment-13707865
]
Gunther Hagleitner commented on HIVE-4721:
--
Tried on both hadoop 1 & 2. Same result.
> Fix TestCliDriver.ptf_npath.q on 0.23
> -
>
> Key: HIVE-4721
> URL: https://issues.apache.org/jira/browse/HIVE-4721
> Project: Hive
> Issue Type: Sub-task
>Reporter: Brock Noland
>Assignee: Gunther Hagleitner
> Attachments: HIVE-4721.1.patch
>
>
> In HIVE-4717 I tried changing the last line of ptf_npath.q from:
> {noformat}
> where fl_num = 1142;
> {noformat}
> to:
> {noformat}
> where fl_num = 1142 order by origin_city_name, fl_num, year, month,
> day_of_month, sz, tpath;
> {noformat}
> in order to make the test deterministic. However this results, not just
> different order, in different results for 0.23 and 0.20S.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4721) Fix TestCliDriver.ptf_npath.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gunther Hagleitner updated HIVE-4721:
-
Attachment: HIVE-4721.1.patch
> Fix TestCliDriver.ptf_npath.q on 0.23
> -
>
> Key: HIVE-4721
> URL: https://issues.apache.org/jira/browse/HIVE-4721
> Project: Hive
> Issue Type: Sub-task
>Reporter: Brock Noland
>Assignee: Gunther Hagleitner
> Attachments: HIVE-4721.1.patch
>
>
> In HIVE-4717 I tried changing the last line of ptf_npath.q from:
> {noformat}
> where fl_num = 1142;
> {noformat}
> to:
> {noformat}
> where fl_num = 1142 order by origin_city_name, fl_num, year, month,
> day_of_month, sz, tpath;
> {noformat}
> in order to make the test deterministic. However this results, not just
> different order, in different results for 0.23 and 0.20S.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4721) Fix TestCliDriver.ptf_npath.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707864#comment-13707864
]
Gunther Hagleitner commented on HIVE-4721:
--
I think you've tried sorting in the wrong place. You need to make sure that the
fl_num is in the sort key in the npath expression. Otherwise other rows of same
date might come in between resulting in non-deterministic behavior.
> Fix TestCliDriver.ptf_npath.q on 0.23
> -
>
> Key: HIVE-4721
> URL: https://issues.apache.org/jira/browse/HIVE-4721
> Project: Hive
> Issue Type: Sub-task
>Reporter: Brock Noland
>Assignee: Gunther Hagleitner
> Attachments: HIVE-4721.1.patch
>
>
> In HIVE-4717 I tried changing the last line of ptf_npath.q from:
> {noformat}
> where fl_num = 1142;
> {noformat}
> to:
> {noformat}
> where fl_num = 1142 order by origin_city_name, fl_num, year, month,
> day_of_month, sz, tpath;
> {noformat}
> in order to make the test deterministic. However this results, not just
> different order, in different results for 0.23 and 0.20S.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-4721) Fix TestCliDriver.ptf_npath.q on 0.23
[
https://issues.apache.org/jira/browse/HIVE-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gunther Hagleitner reassigned HIVE-4721:
Assignee: Gunther Hagleitner
> Fix TestCliDriver.ptf_npath.q on 0.23
> -
>
> Key: HIVE-4721
> URL: https://issues.apache.org/jira/browse/HIVE-4721
> Project: Hive
> Issue Type: Sub-task
>Reporter: Brock Noland
>Assignee: Gunther Hagleitner
>
> In HIVE-4717 I tried changing the last line of ptf_npath.q from:
> {noformat}
> where fl_num = 1142;
> {noformat}
> to:
> {noformat}
> where fl_num = 1142 order by origin_city_name, fl_num, year, month,
> day_of_month, sz, tpath;
> {noformat}
> in order to make the test deterministic. However this results, not just
> different order, in different results for 0.23 and 0.20S.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4290) Build profiles: Partial builds for quicker dev
[ https://issues.apache.org/jira/browse/HIVE-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707854#comment-13707854 ] Hudson commented on HIVE-4290: -- ABORTED: Integrated in Hive-trunk-h0.21 #2196 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2196/]) HIVE-4290 : Build profiles: Partial builds for quicker dev (Gunther Hagleitner via Navis) (navis: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1502760) * /hive/trunk/build.properties * /hive/trunk/build.xml * /hive/trunk/ql/build.xml * /hive/trunk/ql/ivy.xml > Build profiles: Partial builds for quicker dev > -- > > Key: HIVE-4290 > URL: https://issues.apache.org/jira/browse/HIVE-4290 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Fix For: 0.12.0 > > Attachments: HIVE-4290.2.patch, HIVE-4290.D11481.1.patch, > HIVE-4290.patch > > > Building is definitely taking longer with hcat, hs2 etc in the build. When > you're working on one area of the system though, it would be easier to have > an option to only build that. Not for pre-commit or build machines, but for > dev this should help. > ant clean package build OR > ant -Dbuild.profile=full clean package test --> build everything > ant -Dbuild.profile=core clean package test --> build just enough to run the > tests in ql > ant -Dbuild.profile=hcat clean package test --> build only hcatalog -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4658) Make KW_OUTER optional in outer joins
[ https://issues.apache.org/jira/browse/HIVE-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707853#comment-13707853 ] Hudson commented on HIVE-4658: -- ABORTED: Integrated in Hive-trunk-h0.21 #2196 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2196/]) HIVE-4658 : Make KW_OUTER optional in outer joins (Edward Capriolo via Navis) (navis: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1502758) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/FromClauseParser.g * /hive/trunk/ql/src/test/queries/clientpositive/optional_outer.q * /hive/trunk/ql/src/test/results/clientpositive/optional_outer.q.out > Make KW_OUTER optional in outer joins > - > > Key: HIVE-4658 > URL: https://issues.apache.org/jira/browse/HIVE-4658 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Navis >Assignee: Edward Capriolo >Priority: Trivial > Fix For: 0.12.0 > > Attachments: hive-4658.2.patch.txt, HIVE-4658.D11091.1.patch > > > For really trivial migration issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4852) -Dbuild.profile=core fails
[ https://issues.apache.org/jira/browse/HIVE-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-4852: - Status: Patch Available (was: Open) > -Dbuild.profile=core fails > -- > > Key: HIVE-4852 > URL: https://issues.apache.org/jira/browse/HIVE-4852 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4852.1.patch > > > Core profile fails because of an added chmod to some hcat files. Simple fix: > Check if modules contains hcat before running the command. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4852) -Dbuild.profile=core fails
[ https://issues.apache.org/jira/browse/HIVE-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-4852: - Attachment: HIVE-4852.1.patch > -Dbuild.profile=core fails > -- > > Key: HIVE-4852 > URL: https://issues.apache.org/jira/browse/HIVE-4852 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Attachments: HIVE-4852.1.patch > > > Core profile fails because of an added chmod to some hcat files. Simple fix: > Check if modules contains hcat before running the command. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4852) -Dbuild.profile=core fails
Gunther Hagleitner created HIVE-4852: Summary: -Dbuild.profile=core fails Key: HIVE-4852 URL: https://issues.apache.org/jira/browse/HIVE-4852 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Core profile fails because of an added chmod to some hcat files. Simple fix: Check if modules contains hcat before running the command. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4851) Fix flaky tests
Brock Noland created HIVE-4851: -- Summary: Fix flaky tests Key: HIVE-4851 URL: https://issues.apache.org/jira/browse/HIVE-4851 Project: Hive Issue Type: Bug Reporter: Brock Noland Assignee: Brock Noland I see the following tests fail quite often: * TestNegativeMinimrCliDriver.testNegativeCliDriver_mapreduce_stack_trace_hadoop20 * TestOrcHCatLoader.testReadDataBasic * TestMinimrCliDriver.testCliDriver_bucketmpjoin6 * TestNotificationListener.testAMQListener This one is less often, but still fails randomly: * TestMinimrCliDriver.testCliDriver_bucket4 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4850) Implement vectorized JOIN operators
Remus Rusanu created HIVE-4850: -- Summary: Implement vectorized JOIN operators Key: HIVE-4850 URL: https://issues.apache.org/jira/browse/HIVE-4850 Project: Hive Issue Type: Sub-task Reporter: Remus Rusanu Assignee: Remus Rusanu Easysauce -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4290) Build profiles: Partial builds for quicker dev
[ https://issues.apache.org/jira/browse/HIVE-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707784#comment-13707784 ] Hudson commented on HIVE-4290: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #75 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/75/]) HIVE-4290 : Build profiles: Partial builds for quicker dev (Gunther Hagleitner via Navis) (navis: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1502760) * /hive/trunk/build.properties * /hive/trunk/build.xml * /hive/trunk/ql/build.xml * /hive/trunk/ql/ivy.xml > Build profiles: Partial builds for quicker dev > -- > > Key: HIVE-4290 > URL: https://issues.apache.org/jira/browse/HIVE-4290 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Fix For: 0.12.0 > > Attachments: HIVE-4290.2.patch, HIVE-4290.D11481.1.patch, > HIVE-4290.patch > > > Building is definitely taking longer with hcat, hs2 etc in the build. When > you're working on one area of the system though, it would be easier to have > an option to only build that. Not for pre-commit or build machines, but for > dev this should help. > ant clean package build OR > ant -Dbuild.profile=full clean package test --> build everything > ant -Dbuild.profile=core clean package test --> build just enough to run the > tests in ql > ant -Dbuild.profile=hcat clean package test --> build only hcatalog -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Tez branch and tez based patches
I have started to see several re factoring patches around tez. https://issues.apache.org/jira/browse/HIVE-4843 This is the only mention on the hive list I can find with tez: "Makes sense. I will create the branch soon. Thanks, Ashutosh On Tue, Jun 11, 2013 at 7:44 PM, Gunther Hagleitner < ghagleit...@hortonworks.com> wrote: > Hi, > > I am starting to work on integrating Tez into Hive (see HIVE-4660, design > doc has already been uploaded - any feedback will be much appreciated). > This will be a fair amount of work that will take time to stabilize/test. > I'd like to propose creating a branch in order to be able to do this > incrementally and collaboratively. In order to progress rapidly with this, > I would also like to go "commit-then-review". > > Thanks, > Gunther. >" These refactor-ings are largely destructive to a number of bugs and language improvements in hive.The language improvements and bug fixes that have been sitting in Jira for quite some time now marked patch-available and are waiting for review. There are a few things I want to point out: 1) Normally we create design docs in out wiki (which it is not) 2) Normally when the change is significantly complex we get multiple committers to comment on it (which we did not) On point 2 no one -1 the branch, but this is really something that should have required a +1 from 3 committers. I for one am not completely sold on Tez. http://incubator.apache.org/projects/tez.html. "directed-acyclic-graph of tasks for processing data" this description sounds like many things which have never become popular. One to think of is oozie "Oozie Workflow jobs are Directed Acyclical Graphs (DAGs) of actions.". I am sure I can find a number of libraries/frameworks that make this same claim. In general I do not feel like we have done our homework and pre-requisites to justify all this work. If we have done the homework, I am sure that it has not been communicated and accepted by hive developers at large. If we have a branch, why are we also committing on trunk? Scanning through the tez doc the only language I keep finding language like "minimal changes to the planner" yet, there is ALREADY lots of large changes going on! Really none of the above would bother me accept for the fact that these "minimal changes" are causing many "patch available" ready-for-review bugs and core hive features to need to be re based. I am sure I have mentioned this before, but I have to spend 12+ hours to test a single patch on my laptop. A few days ago I was testing a new core hive feature. After all the tests passed and before I was able to commit, someone unleashed a tez patch on trunk which caused the thing I was testing for 12 hours to need to be rebased. I'm not cool with this.Next time that happens to me I will seriously consider reverting the patch. Bug fixes and new hive features are more important to me then integrating with incubator projects.
[jira] [Commented] (HIVE-4675) Create new parallel unit test environment
[ https://issues.apache.org/jira/browse/HIVE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707772#comment-13707772 ] Brock Noland commented on HIVE-4675: Hi, Just curious if anyone has started reviewing this yet? The reason I ask is HIVE-4815 did a lot of refactoring of this code so that patch by itself is quite large. If no one has started reviewing this then I am inclined to merge this patch and HIVE-4815 because the total size of the combined patch is actually smaller than the current patch on this JIRA. TLDR: If I merge this jira with HIVE-4815 the result is a smaller patch. Brock > Create new parallel unit test environment > - > > Key: HIVE-4675 > URL: https://issues.apache.org/jira/browse/HIVE-4675 > Project: Hive > Issue Type: Improvement > Components: Testing Infrastructure >Reporter: Brock Noland >Assignee: Brock Noland > Fix For: 0.12.0 > > Attachments: HIVE-4675.patch > > > The current ptest tool is great, but it has the following limitations: > -Requires an NFS filer > -Unless the NFS filer is dedicated ptests can become IO bound easily > -Investigating of failures is troublesome because the source directory for > the failure is not saved > -Ignoring or isolated tests is not supported > -No unit tests for the ptest framework exist > It'd be great to have a ptest tool that addresses this limitations. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2608) Do not require AS a,b,c part in LATERAL VIEW
[
https://issues.apache.org/jira/browse/HIVE-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707761#comment-13707761
]
Edward Capriolo commented on HIVE-2608:
---
Accidentally I ran the tests in java7.
Everything ran but the jdbc tests and these two
{quote}
testNegativeCliDriver_udtf_not_supported2 Failure Unexpected exception
See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get
more logs.
junit.framework.AssertionFailedError: Unexpected exception
See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get
more logs.
at junit.framework.Assert.fail(Assert.java:47)
at
org.apache.hadoop.hive.cli.TestNegativeCliDriver.runTest(TestNegativeCliDriver.java:2576)
at
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_udtf_not_supported2(TestNegativeCliDriver.java:2498)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:154)
at junit.framework.TestCase.runBare(TestCase.java:127)
at junit.framework.TestResult$1.protect(TestResult.java:106)
at junit.framework.TestResult.runProtected(TestResult.java:124)
at junit.framework.TestResult.run(TestResult.java:109)
at junit.framework.TestCase.run(TestCase.java:118)
at junit.framework.TestSuite.runTest(TestSuite.java:208)
at junit.framework.TestSuite.run(TestSuite.java:203)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:520)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1060)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:911)
3.769q
testNegativeCliDriver_lateral_view_join Failure Unexpected exception See
build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more
logs.
junit.framework.AssertionFailedError: Unexpected exception
See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get
more logs.
at junit.framework.Assert.fail(Assert.java:47)
at
org.apache.hadoop.hive.cli.TestNegativeCliDriver.runTest(TestNegativeCliDriver.java:2576)
at
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_lateral_view_join(TestNegativeCliDriver.java:1758)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:154)
at junit.framework.TestCase.runBare(TestCase.java:127)
at junit.framework.TestResult$1.protect(TestResult.java:106)
at junit.framework.TestResult.runProtected(TestResult.java:124)
at junit.framework.TestResult.run(TestResult.java:109)
at junit.framework.TestCase.run(TestCase.java:118)
at junit.framework.TestSuite.runTest(TestSuite.java:208)
at junit.framework.TestSuite.run(TestSuite.java:203)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:520)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1060)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:911)
{quote}
Will run these two by hand.
> Do not require AS a,b,c part in LATERAL VIEW
>
>
> Key: HIVE-2608
> URL: https://issues.apache.org/jira/browse/HIVE-2608
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor, UDF
>Reporter: Igor Kabiljo
>Assignee: Navis
>Priority: Minor
> Attachments: HIVE-2608.D4317.5.patch, HIVE-2608.D4317.6.patch
>
>
> Currently, it is required to state column names when LATERAL VIEW is used.
> That shouldn't be necessary, since UDTF returns struct which contains column
> names - and they should be used by default.
> For example, it would be great if this was possible:
> SELECT t.*, t.key1 + t.key4
> FROM some_table
> LATERAL VIEW JSON_TUPLE(json, 'key1', 'key2', 'key3', 'key3') t;
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4730) Join on more than 2^31 records on single reducer failed (wrong results)
[ https://issues.apache.org/jira/browse/HIVE-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo updated HIVE-4730: -- Priority: Blocker (was: Critical) > Join on more than 2^31 records on single reducer failed (wrong results) > --- > > Key: HIVE-4730 > URL: https://issues.apache.org/jira/browse/HIVE-4730 > Project: Hive > Issue Type: Bug >Affects Versions: 0.7.1, 0.8.0, 0.8.1, 0.9.0, 0.10.0, 0.11.0 >Reporter: Gabi Kazav >Assignee: Navis >Priority: Blocker > Attachments: HIVE-4730.D11283.1.patch > > > join on more than 2^31 rows leads to wrong results. for example: > Create table small_table (p1 string) ROW FORMAT DELIMITEDLINES TERMINATED > BY '\n'; > Create table big_table (p1 string) ROW FORMAT DELIMITEDLINES TERMINATED > BY '\n'; > Loading 1 row to small_table (the value 1). > Loading 2149580800 rows to big_table with the same value (1 on this case). > create table output as select a.p1 from big_table a join small_table b on > (a.p1=b.p1); > select count(*) from output ; will return only 1 row... > the reducer syslog: > ... > 2013-06-13 17:20:59,254 INFO ExecReducer: ExecReducer: processing 214700 > rows: used memory = 32925960 > 2013-06-13 17:21:00,745 INFO ExecReducer: ExecReducer: processing 214800 > rows: used memory = 12815184 > 2013-06-13 17:21:02,205 INFO ExecReducer: ExecReducer: processing 214900 > rows: used memory = 26684552 <-- looks like wrong value.. > ... > 2013-06-13 17:21:04,062 INFO ExecReducer: ExecReducer: processed 2149580801 > rows: used memory = 17715896 > 2013-06-13 17:21:04,062 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 > finished. closing... > 2013-06-13 17:21:04,062 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 > forwarded 1 rows > 2013-06-13 17:21:05,791 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: > SKEWJOINFOLLOWUPJOBS:0 > 2013-06-13 17:21:05,792 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 5 > finished. closing... > 2013-06-13 17:21:05,792 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 5 > forwarded 1 rows > 2013-06-13 17:21:05,792 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: > 6 finished. closing... > 2013-06-13 17:21:05,792 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: > 6 forwarded 0 rows > 2013-06-13 17:21:05,946 INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator: > TABLE_ID_1_ROWCOUNT:1 > 2013-06-13 17:21:05,946 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 5 > Close done > 2013-06-13 17:21:05,946 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 > Close done -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4849) permgen of maven publish
Edward Capriolo created HIVE-4849: - Summary: permgen of maven publish Key: HIVE-4849 URL: https://issues.apache.org/jira/browse/HIVE-4849 Project: Hive Issue Type: Bug Reporter: Edward Capriolo Get this all the time hive-mvn-publish: [echo] Installing local artifact for maven : shims [for] hcatalog: The following error occurred while executing this line: [for] /home/edward/Documents/java/hive-trunk2/build.xml:310: The following error occurred while executing this line: [for] /home/edward/Documents/java/hive-trunk2/hcatalog/build.xml:75: The following error occurred while executing this line: [for] /home/edward/Documents/java/hive-trunk2/hcatalog/build-support/ant/deploy.xml:81: The following error occurred while executing this line: [for] /home/edward/Documents/java/hive-trunk2/hcatalog/build-support/ant/deploy.xml:57: The following error occurred while executing this line: [for] /home/edward/Documents/java/hive-trunk2/hcatalog/build-support/ant/deploy.xml:48: java.lang.OutOfMemoryError: PermGen space Caught an exception while logging the end of the build. Exception was: java.lang.OutOfMemoryError: PermGen space java.lang.OutOfMemoryError: PermGen space at java.lang.Throwable.getStackTraceElement(Native Method) at java.lang.Throwable.getOurStackTrace(Throwable.java:591) at java.lang.Throwable.printStackTrace(Throwable.java:462) at java.lang.Throwable.printStackTrace(Throwable.java:451) at org.apache.tools.ant.Main.runBuild(Main.java:838) at org.apache.tools.ant.Main.startAnt(Main.java:217) at org.apache.tools.ant.launch.Launcher.run(Launcher.java:280) at org.apache.tools.ant.launch.Launcher.main(Launcher.java:109) PermGen space especially after the test target -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4838) Refactor MapJoin HashMap code to improve testability and readability
[ https://issues.apache.org/jira/browse/HIVE-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707751#comment-13707751 ] Brock Noland commented on HIVE-4838: Correct I believe this to only affect the null safe operator. > Refactor MapJoin HashMap code to improve testability and readability > > > Key: HIVE-4838 > URL: https://issues.apache.org/jira/browse/HIVE-4838 > Project: Hive > Issue Type: Bug >Reporter: Brock Noland >Assignee: Brock Noland > Attachments: HIVE-4838.patch, HIVE-4838.patch > > > MapJoin is an essential component for high performance joins in Hive and the > current code has done great service for many years. However, the code is > showing it's age and currently suffers from the following issues: > * Uses static state via the MapJoinMetaData class to pass serialization > metadata to the Key, Row classes. > * The api of a logical "Table Container" is not defined and therefore it's > unclear what apis HashMapWrapper > needs to publicize. Additionally HashMapWrapper has many used public methods. > * HashMapWrapper contains logic to serialize, test memory bounds, and > implement the table container. Ideally these logical units could be seperated > * HashTableSinkObjectCtx has unused fields and unused methods > * CommonJoinOperator and children use ArrayList on left hand side when only > List is required > * There are unused classes MRU, DCLLItemm and classes which duplicate > functionality MapJoinSingleKey and MapJoinDoubleKeys -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4658) Make KW_OUTER optional in outer joins
[ https://issues.apache.org/jira/browse/HIVE-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707749#comment-13707749 ] Hudson commented on HIVE-4658: -- ABORTED: Integrated in Hive-trunk-hadoop1-ptest #74 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/74/]) HIVE-4658 : Make KW_OUTER optional in outer joins (Edward Capriolo via Navis) (navis: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1502758) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/FromClauseParser.g * /hive/trunk/ql/src/test/queries/clientpositive/optional_outer.q * /hive/trunk/ql/src/test/results/clientpositive/optional_outer.q.out > Make KW_OUTER optional in outer joins > - > > Key: HIVE-4658 > URL: https://issues.apache.org/jira/browse/HIVE-4658 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Navis >Assignee: Edward Capriolo >Priority: Trivial > Fix For: 0.12.0 > > Attachments: hive-4658.2.patch.txt, HIVE-4658.D11091.1.patch > > > For really trivial migration issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4848) std, stddev and stddev_pop aggregates on double/float fail to vectorize
[ https://issues.apache.org/jira/browse/HIVE-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated HIVE-4848: --- Status: Patch Available (was: Open) > std, stddev and stddev_pop aggregates on double/float fail to vectorize > --- > > Key: HIVE-4848 > URL: https://issues.apache.org/jira/browse/HIVE-4848 > Project: Hive > Issue Type: Sub-task > Components: Query Processor >Affects Versions: vectorization-branch >Reporter: Remus Rusanu >Assignee: Remus Rusanu >Priority: Trivial > Attachments: hive-4848.1.patch > > > the aggregatesDefinition erroneously list std,stddev and stddev for Double as > Long. trivial fix. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4848) std, stddev and stddev_pop aggregates on double/float fail to vectorize
[ https://issues.apache.org/jira/browse/HIVE-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated HIVE-4848: --- Attachment: hive-4848.1.patch > std, stddev and stddev_pop aggregates on double/float fail to vectorize > --- > > Key: HIVE-4848 > URL: https://issues.apache.org/jira/browse/HIVE-4848 > Project: Hive > Issue Type: Sub-task > Components: Query Processor >Affects Versions: vectorization-branch >Reporter: Remus Rusanu >Assignee: Remus Rusanu >Priority: Trivial > Attachments: hive-4848.1.patch > > > the aggregatesDefinition erroneously list std,stddev and stddev for Double as > Long. trivial fix. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4848) std, stddev and stddev_pop aggregates on double/float fail to vectorize
Remus Rusanu created HIVE-4848: -- Summary: std, stddev and stddev_pop aggregates on double/float fail to vectorize Key: HIVE-4848 URL: https://issues.apache.org/jira/browse/HIVE-4848 Project: Hive Issue Type: Sub-task Components: Query Processor Affects Versions: vectorization-branch Reporter: Remus Rusanu Assignee: Remus Rusanu Priority: Trivial the aggregatesDefinition erroneously list std,stddev and stddev for Double as Long. trivial fix. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4840) Fix eclipse template classpath to include the BoneCP lib
[ https://issues.apache.org/jira/browse/HIVE-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707718#comment-13707718 ] Hudson commented on HIVE-4840: -- ABORTED: Integrated in Hive-trunk-hadoop2 #285 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/285/]) HIVE-4840 : Fix eclipse template classpath to include the BoneCP lib (Yin Huai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1502678) * /hive/trunk/eclipse-templates/.classpath * /hive/trunk/hcatalog/src/test/e2e/hcatalog/drivers/Util.pm > Fix eclipse template classpath to include the BoneCP lib > > > Key: HIVE-4840 > URL: https://issues.apache.org/jira/browse/HIVE-4840 > Project: Hive > Issue Type: Bug >Reporter: Yin Huai >Assignee: Yin Huai >Priority: Trivial > Fix For: 0.12.0 > > Attachments: HIVE-4840.patch.txt > > > HIVE-4807 did not change the classpath in eclipse template accordingly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4840) Fix eclipse template classpath to include the BoneCP lib
[ https://issues.apache.org/jira/browse/HIVE-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707706#comment-13707706 ] Hudson commented on HIVE-4840: -- ABORTED: Integrated in Hive-trunk-h0.21 #2195 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2195/]) HIVE-4840 : Fix eclipse template classpath to include the BoneCP lib (Yin Huai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1502678) * /hive/trunk/eclipse-templates/.classpath * /hive/trunk/hcatalog/src/test/e2e/hcatalog/drivers/Util.pm > Fix eclipse template classpath to include the BoneCP lib > > > Key: HIVE-4840 > URL: https://issues.apache.org/jira/browse/HIVE-4840 > Project: Hive > Issue Type: Bug >Reporter: Yin Huai >Assignee: Yin Huai >Priority: Trivial > Fix For: 0.12.0 > > Attachments: HIVE-4840.patch.txt > > > HIVE-4807 did not change the classpath in eclipse template accordingly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4204) Support ellipsis for selecting multiple columns
[
https://issues.apache.org/jira/browse/HIVE-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-4204:
--
Attachment: HIVE-4204.D9549.3.patch
navis updated the revision "HIVE-4204 [jira] Support ellipsis for selecting
multiple columns".
Rebased to trunk
Reviewers: JIRA
REVISION DETAIL
https://reviews.facebook.net/D9549
CHANGE SINCE LAST DIFF
https://reviews.facebook.net/D9549?vs=30195&id=35709#toc
AFFECTED FILES
ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java
ql/src/java/org/apache/hadoop/hive/ql/exec/ColumnInfo.java
ql/src/java/org/apache/hadoop/hive/ql/parse/FromClauseParser.g
ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g
ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g
ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g
ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckCtx.java
ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java
ql/src/test/queries/clientnegative/allcolref_from_tablealias.q
ql/src/test/queries/clientpositive/allcolref_from.q
ql/src/test/results/clientnegative/allcolref_from_tablealias.q.out
ql/src/test/results/clientpositive/allcolref_from.q.out
To: JIRA, navis
> Support ellipsis for selecting multiple columns
> ---
>
> Key: HIVE-4204
> URL: https://issues.apache.org/jira/browse/HIVE-4204
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
>Reporter: Navis
>Assignee: Navis
>Priority: Trivial
> Attachments: HIVE-4204.D9549.1.patch, HIVE-4204.D9549.2.patch,
> HIVE-4204.D9549.3.patch
>
>
> Some UDF should take all columns starting from second or third one and in
> this case, star argument(HIVE-3490) cannot be used. It's not pleasant to
> specify all of them especially when the table has many of columns. For
> example,
> {noformat}
> select some_udtf(a2,a3,a4,a5,a6) as (a2,a3,a4,a5,a6) from table;
> {noformat}
> it can be simplified to
> {noformat}
> select some_udtf(a2...) as (a2,a3,a4,a5,a6) from table;
> {noformat}
> if HIVE-2608 would be committed, it can be simplified further
> {noformat}
> select some_udtf(a2...) from table;
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3926) PPD on virtual column of partitioned table is not working
[
https://issues.apache.org/jira/browse/HIVE-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-3926:
--
Attachment: HIVE-3926.D8121.4.patch
navis updated the revision "HIVE-3926 [jira] PPD on virtual column of
partitioned table is not working".
Rebased to trunk
Reviewers: JIRA
REVISION DETAIL
https://reviews.facebook.net/D8121
CHANGE SINCE LAST DIFF
https://reviews.facebook.net/D8121?vs=34797&id=35703#toc
AFFECTED FILES
ql/src/java/org/apache/hadoop/hive/ql/Driver.java
ql/src/java/org/apache/hadoop/hive/ql/exec/MapOperator.java
ql/src/java/org/apache/hadoop/hive/ql/metadata/VirtualColumn.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/AbstractBucketJoinProc.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/AbstractSMBJoinProc.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/AvgPartitionSizeBasedBigTableSelectorForAutoSMJ.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/GlobalLimitOptimizer.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/GroupByOptimizer.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/TableSizeBasedBigTableSelectorForAutoSMJ.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/LBPartitionProcFactory.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcCtx.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcFactory.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrOpProcFactory.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/PartExprEvalUtils.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/PartitionPruner.java
ql/src/java/org/apache/hadoop/hive/ql/parse/ParseContext.java
ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java
ql/src/test/queries/clientpositive/ppd_vc.q
ql/src/test/results/clientpositive/ppd_vc.q.out
To: JIRA, navis
> PPD on virtual column of partitioned table is not working
> -
>
> Key: HIVE-3926
> URL: https://issues.apache.org/jira/browse/HIVE-3926
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
>Reporter: Navis
>Assignee: Navis
>Priority: Minor
> Attachments: HIVE-3926.D8121.1.patch, HIVE-3926.D8121.2.patch,
> HIVE-3926.D8121.3.patch, HIVE-3926.D8121.4.patch
>
>
> {code}
> select * from src where BLOCK__OFFSET__INSIDE__FILE<100;
> {code}
> is working, but
> {code}
> select * from srcpart where BLOCK__OFFSET__INSIDE__FILE<100;
> {code}
> throws SemanticException. Disabling PPD makes it work.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4502) NPE - subquery smb joins fails
[ https://issues.apache.org/jira/browse/HIVE-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4502: -- Attachment: HIVE-4502.D10695.3.patch navis updated the revision "HIVE-4502 [jira] NPE - subquery smb joins fails". Rebased to trunk Reviewers: JIRA REVISION DETAIL https://reviews.facebook.net/D10695 CHANGE SINCE LAST DIFF https://reviews.facebook.net/D10695?vs=34479&id=35697#toc AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/QueryPlan.java ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultGraphWalker.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMROperator.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRProcContext.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRRedSink1.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRRedSink2.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRRedSink3.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRTableScan1.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/MapJoinFactory.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/MapJoinProcessor.java ql/src/java/org/apache/hadoop/hive/ql/parse/GenMapRedWalker.java ql/src/java/org/apache/hadoop/hive/ql/parse/MapReduceCompiler.java ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java ql/src/test/queries/clientpositive/auto_sortmerge_join_6.q ql/src/test/queries/clientpositive/smb_mapjoin_25.q ql/src/test/results/clientpositive/auto_smb_mapjoin_14.q.out ql/src/test/results/clientpositive/auto_sortmerge_join_6.q.out ql/src/test/results/clientpositive/auto_sortmerge_join_9.q.out ql/src/test/results/clientpositive/bucketmapjoin1.q.out ql/src/test/results/clientpositive/bucketmapjoin2.q.out ql/src/test/results/clientpositive/bucketmapjoin3.q.out ql/src/test/results/clientpositive/bucketmapjoin4.q.out ql/src/test/results/clientpositive/bucketmapjoin_negative.q.out ql/src/test/results/clientpositive/bucketmapjoin_negative2.q.out ql/src/test/results/clientpositive/bucketsortoptimize_insert_2.q.out ql/src/test/results/clientpositive/bucketsortoptimize_insert_4.q.out ql/src/test/results/clientpositive/bucketsortoptimize_insert_5.q.out ql/src/test/results/clientpositive/bucketsortoptimize_insert_6.q.out ql/src/test/results/clientpositive/bucketsortoptimize_insert_7.q.out ql/src/test/results/clientpositive/bucketsortoptimize_insert_8.q.out ql/src/test/results/clientpositive/mapjoin_distinct.q.out ql/src/test/results/clientpositive/smb_mapjoin9.q.out ql/src/test/results/clientpositive/smb_mapjoin_11.q.out ql/src/test/results/clientpositive/smb_mapjoin_12.q.out ql/src/test/results/clientpositive/smb_mapjoin_14.q.out ql/src/test/results/clientpositive/smb_mapjoin_25.q.out ql/src/test/results/clientpositive/smb_mapjoin_6.q.out ql/src/test/results/clientpositive/stats11.q.out To: JIRA, navis Cc: brock > NPE - subquery smb joins fails > -- > > Key: HIVE-4502 > URL: https://issues.apache.org/jira/browse/HIVE-4502 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Navis > Attachments: HIVE-4502.D10695.1.patch, HIVE-4502.D10695.2.patch, > HIVE-4502.D10695.3.patch, smb_mapjoin_25.q, smb_mapjoin_25.q > > > Found this issue while running some SMB joins. Attaching test case that > causes this error. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4144) Add "select database()" command to show the current database
[
https://issues.apache.org/jira/browse/HIVE-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-4144:
--
Attachment: HIVE-4144.D9597.3.patch
navis updated the revision "HIVE-4144 [jira] Add "select database()" command to
show the current database".
Rebased to trunk
Reviewers: JIRA
REVISION DETAIL
https://reviews.facebook.net/D9597
CHANGE SINCE LAST DIFF
https://reviews.facebook.net/D9597?vs=30321&id=35691#toc
AFFECTED FILES
ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java
ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java
ql/src/java/org/apache/hadoop/hive/ql/io/NullRowsInputFormat.java
ql/src/java/org/apache/hadoop/hive/ql/io/OneNullRowInputFormat.java
ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g
ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/UDFCurrentDB.java
ql/src/test/queries/clientpositive/select_dummy_source.q
ql/src/test/queries/clientpositive/udf_current_database.q
ql/src/test/results/clientpositive/select_dummy_source.q.out
ql/src/test/results/clientpositive/udf_current_database.q.out
To: JIRA, navis
> Add "select database()" command to show the current database
>
>
> Key: HIVE-4144
> URL: https://issues.apache.org/jira/browse/HIVE-4144
> Project: Hive
> Issue Type: Bug
> Components: SQL
>Reporter: Mark Grover
>Assignee: Navis
> Attachments: HIVE-4144.D9597.1.patch, HIVE-4144.D9597.2.patch,
> HIVE-4144.D9597.3.patch
>
>
> A recent hive-user mailing list conversation asked about having a command to
> show the current database.
> http://mail-archives.apache.org/mod_mbox/hive-user/201303.mbox/%3CCAMGr+0i+CRY69m3id=DxthmUCWLf0NxpKMCtROb=uauh2va...@mail.gmail.com%3E
> MySQL seems to have a command to do so:
> {code}
> select database();
> {code}
> http://dev.mysql.com/doc/refman/5.0/en/information-functions.html#function_database
> We should look into having something similar in Hive.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4728) Add option for skipping build of hcatalogue
[ https://issues.apache.org/jira/browse/HIVE-4728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-4728: Resolution: Duplicate Status: Resolved (was: Patch Available) > Add option for skipping build of hcatalogue > --- > > Key: HIVE-4728 > URL: https://issues.apache.org/jira/browse/HIVE-4728 > Project: Hive > Issue Type: Task > Components: Build Infrastructure >Reporter: Navis >Assignee: Navis >Priority: Trivial > Attachments: HIVE-4728.D11259.1.patch > > > This is a temporal patch until HIVE-4305. It just takes too much time for a > simple build. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4290) Build profiles: Partial builds for quicker dev
[ https://issues.apache.org/jira/browse/HIVE-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-4290: Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks Gunther! > Build profiles: Partial builds for quicker dev > -- > > Key: HIVE-4290 > URL: https://issues.apache.org/jira/browse/HIVE-4290 > Project: Hive > Issue Type: Bug >Reporter: Gunther Hagleitner >Assignee: Gunther Hagleitner > Fix For: 0.12.0 > > Attachments: HIVE-4290.2.patch, HIVE-4290.D11481.1.patch, > HIVE-4290.patch > > > Building is definitely taking longer with hcat, hs2 etc in the build. When > you're working on one area of the system though, it would be easier to have > an option to only build that. Not for pre-commit or build machines, but for > dev this should help. > ant clean package build OR > ant -Dbuild.profile=full clean package test --> build everything > ant -Dbuild.profile=core clean package test --> build just enough to run the > tests in ql > ant -Dbuild.profile=hcat clean package test --> build only hcatalog -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3925) dependencies of fetch task are not shown by explain
[ https://issues.apache.org/jira/browse/HIVE-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707686#comment-13707686 ] Navis commented on HIVE-3925: - Source patch only. The difference of output files would be huge. > dependencies of fetch task are not shown by explain > --- > > Key: HIVE-3925 > URL: https://issues.apache.org/jira/browse/HIVE-3925 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Namit Jain >Assignee: Navis > Attachments: HIVE-3925.D8577.1.patch, HIVE-3925.D8577.2.patch, > HIVE-3925.D8577.3.patch > > > A simple query like: > hive> explain select * from src order by key; > OK > ABSTRACT SYNTAX TREE: > (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT > (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR > TOK_ALLCOLREF)) (TOK_ORDERBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL key) > STAGE DEPENDENCIES: > Stage-1 is a root stage > Stage-0 is a root stage > Stage: Stage-0 > Fetch Operator > limit: -1 > Stage-0 is not a root stage and depends on stage-1. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3925) dependencies of fetch task are not shown by explain
[ https://issues.apache.org/jira/browse/HIVE-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-3925: -- Attachment: HIVE-3925.D8577.3.patch navis updated the revision "HIVE-3925 [jira] dependencies of fetch task are not shown by explain". Rebased to trunk Reviewers: JIRA REVISION DETAIL https://reviews.facebook.net/D8577 CHANGE SINCE LAST DIFF https://reviews.facebook.net/D8577?vs=27741&id=35685#toc AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java ql/src/java/org/apache/hadoop/hive/ql/parse/MapReduceCompiler.java To: JIRA, navis > dependencies of fetch task are not shown by explain > --- > > Key: HIVE-3925 > URL: https://issues.apache.org/jira/browse/HIVE-3925 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Namit Jain >Assignee: Navis > Attachments: HIVE-3925.D8577.1.patch, HIVE-3925.D8577.2.patch, > HIVE-3925.D8577.3.patch > > > A simple query like: > hive> explain select * from src order by key; > OK > ABSTRACT SYNTAX TREE: > (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT > (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR > TOK_ALLCOLREF)) (TOK_ORDERBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL key) > STAGE DEPENDENCIES: > Stage-1 is a root stage > Stage-0 is a root stage > Stage: Stage-0 > Fetch Operator > limit: -1 > Stage-0 is not a root stage and depends on stage-1. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3925) dependencies of fetch task are not shown by explain
[ https://issues.apache.org/jira/browse/HIVE-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-3925: Status: Patch Available (was: Open) > dependencies of fetch task are not shown by explain > --- > > Key: HIVE-3925 > URL: https://issues.apache.org/jira/browse/HIVE-3925 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Namit Jain >Assignee: Navis > Attachments: HIVE-3925.D8577.1.patch, HIVE-3925.D8577.2.patch, > HIVE-3925.D8577.3.patch > > > A simple query like: > hive> explain select * from src order by key; > OK > ABSTRACT SYNTAX TREE: > (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT > (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR > TOK_ALLCOLREF)) (TOK_ORDERBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL key) > STAGE DEPENDENCIES: > Stage-1 is a root stage > Stage-0 is a root stage > Stage: Stage-0 > Fetch Operator > limit: -1 > Stage-0 is not a root stage and depends on stage-1. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4658) Make KW_OUTER optional in outer joins
[ https://issues.apache.org/jira/browse/HIVE-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-4658: Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks Edward! > Make KW_OUTER optional in outer joins > - > > Key: HIVE-4658 > URL: https://issues.apache.org/jira/browse/HIVE-4658 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Navis >Assignee: Edward Capriolo >Priority: Trivial > Fix For: 0.12.0 > > Attachments: hive-4658.2.patch.txt, HIVE-4658.D11091.1.patch > > > For really trivial migration issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
