[jira] [Commented] (HIVE-2036) Update bitmap indexes for automatic usage

2011-05-19 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13036685#comment-13036685 ] Russell Melick commented on HIVE-2036: -- To expand a bit on Marquis' comments

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-05-01 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Status: Patch Available (was: Open) use filter pushdown for automatically accessing indexes

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-05-01 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.19.patch Patch 19 ready for review. https://reviews.apache.org/r/558

Re: Review Request: HIVE-1644 Use filter pushdown for automatically accessing indexes

2011-05-01 Thread Russell Melick
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/558/ --- (Updated 2011-05-01 19:20:02.130293) Review request for hive. Summary ---

[jira] [Created] (HIVE-2138) Exception when no splits returned from index

2011-04-30 Thread Russell Melick (JIRA)
: 0.8.0 Reporter: Russell Melick Running a query that uses indexing but doesn't return any results give an exception. {code} java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82

[jira] [Updated] (HIVE-2138) Exception when no splits returned from index

2011-04-30 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-2138: - Attachment: index_auto_test_if_used.q Attached test file (index_auto_test_if_used) that should

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-04-29 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: hive.log I've attached the hive.log I get from running {{{ ant test -Dtestcase

[jira] [Commented] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-04-29 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13027283#comment-13027283 ] Russell Melick commented on HIVE-1644: -- I can send it back out of the index handler

[jira] [Commented] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-04-29 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13027294#comment-13027294 ] Russell Melick commented on HIVE-1644: -- Unfortunately, having an empty array gives out

Re: Review Request: HIVE-1644 Use filter pushdown for automatically accessing indexes

2011-04-28 Thread Russell Melick
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/558/ --- (Updated 2011-04-29 00:01:06.921150) Review request for hive. Changes ---

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-04-28 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.18.patch patch 18 I moved that logic into a helper method, but I'm

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-04-23 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.16.patch Patch 16 One last problem. It doesn't appear the index

Re: Review Request: HIVE-1644 Use filter pushdown for automatically accessing indexes

2011-04-23 Thread Russell Melick
anything. ql/src/test/results/clientpositive/index_auto_test_if_used.q.out https://reviews.apache.org/r/558/#comment1109 We shouldn't be seeing this output. We're still generating the right plan, but something is wrong when we run it. - Russell On 2011-04-23 06:41:49, Russell Melick

Re: Review Request: HIVE-1644 Use filter pushdown for automatically accessing indexes

2011-04-23 Thread Russell Melick
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/558/ --- (Updated 2011-04-23 06:41:49.007802) Review request for hive. Changes ---

[jira] [Created] (HIVE-2129) Display indexing information for TableScanOperator in plan

2011-04-22 Thread Russell Melick (JIRA)
Components: Indexing Affects Versions: 0.8.0 Reporter: Russell Melick Show the indexInputFormat and indexIntermediateFile in the plan, to indicate that the table scan's input is being filtered by the intermediate file. But, we only want to do this when these values are non-null (could

[jira] [Created] (HIVE-2130) Cost based choice for rewrite during Automatic Indexing

2011-04-22 Thread Russell Melick (JIRA)
: Indexing Affects Versions: 0.8.0 Reporter: Russell Melick After processing a predicate, there are potentially multiple index rewrites possible. Currently, we just choose the first one. However, there are probably heuristics for choosing certain rewrites over others, based

Re: Review Request: HIVE-1644 Use filter pushdown for automatically accessing indexes

2011-04-21 Thread Russell Melick
MapredWork - Russell On 2011-04-22 03:50:54, Russell Melick wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/558/ --- (Updated

Re: Review Request: HIVE-1644 Use filter pushdown for automatically accessing indexes

2011-04-16 Thread Russell Melick
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/558/ --- (Updated 2011-04-16 06:04:26.681814) Review request for hive. Changes ---

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-04-16 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.14.patch Include new unit tests. Also asked a few more questions

Re: Review Request: HIVE-1644 Use filter pushdown for automatically accessing indexes

2011-04-16 Thread Russell Melick
didn't see any way to delay the building, so I don't know how to have an index with unbuilt partitions. - Russell On 2011-04-16 06:04:26, Russell Melick wrote: --- This is an automatically generated e-mail. To reply, visit: https

Re: Review Request: HIVE-1644 Use filter pushdown for automatically accessing indexes

2011-04-15 Thread Russell Melick
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/558/ --- (Updated 2011-04-15 08:08:14.640798) Review request for hive. Changes ---

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-04-15 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.13.patch I have several questions on the review board. I also fixed

[jira] [Created] (HIVE-2115) Process residual predicate during automatic index query

2011-04-15 Thread Russell Melick (JIRA)
: Indexing Affects Versions: 0.8.0 Reporter: Russell Melick During automatic use of indexes, we analyze the query predicate to pull out what we can use the index on. Not all of the predicate can necessarily be processed with a single index. Currently, we return the residual

Review Request: HIVE-1644 Use filter pushdown for automatically accessing indexes

2011-04-06 Thread Russell Melick
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/558/ --- Review request for hive. Summary --- Review request for HIVE-1644.12.patch

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-04-06 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.12.patch Includes check to make sure that all partitions in the query exist

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-04-06 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Affects Version/s: (was: 0.7.0) 0.8.0 Release Note: Enables

[jira] [Commented] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-03-31 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13014394#comment-13014394 ] Russell Melick commented on HIVE-1644: -- I'm having trouble getting the partitions from

[jira] [Created] (HIVE-2081) Prevent automatic indexing from creating worse queries

2011-03-29 Thread Russell Melick (JIRA)
: Indexing Affects Versions: 0.8.0 Reporter: Russell Melick We want to make sure that automatically using indexes doesn't make the query worse. For example, after scanning the index table, it might still need to scan the whole base table. In this case, we would much rather just

[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-03-23 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.10.patch Yongqiang, I think I fixed the double processing by using

[jira] Updated: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-03-17 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.8.patch HIVE-1644.8.patch Fixed unit tests per John and Yonqiang. Cleaned

[jira] Updated: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-03-08 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.7.patch HIVE-1744.7.patch: @Yongqiang, I fixed the problems

[jira] Updated: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-03-05 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.5.patch HIVE-1644.5.path I have moved the processing

[jira] Updated: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-03-05 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.6.patch New patch fixes the NPE by linking the SemanticAnalyzer

[jira] Updated: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-02-25 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.3.patch Much cleaner patch, which includes moving the re-entrant QL

[jira] Commented: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-02-24 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12999206#comment-12999206 ] Russell Melick commented on HIVE-1644: -- Make sure we update the admin configuration

[jira] Updated: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-02-22 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.2.patch Includes modification of MapReduce tasks to use index input format

[jira] Commented: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-02-22 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12998155#comment-12998155 ] Russell Melick commented on HIVE-1644: -- We also spoke about changing the re-entrant

[jira] Work started: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-02-15 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-1644 started by Russell Melick. use filter pushdown for automatically accessing indexes

[jira] Updated: (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-02-15 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.1.patch I'm having trouble joining the operator trees together. Within

Debugging Hive

2010-11-16 Thread Russell Melick
connecting remotely with jdb is not working. Any help is appreciated. I've detailed my process below. Thanks, Russell Melick First, I check out a fresh copy of trunk: svn checkout http://svn.apache.org/repos/asf/hive/trunk hive Then, I compile it for debugging, as I found at http

[jira] Updated: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new command for SHOW INDEXES

2010-11-11 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1497: - Attachment: HIVE-1497.7.patch Pluralized col_names in the FORMATTED column header support

[jira] Updated: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new command for SHOW INDEXES

2010-11-11 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1497: - Status: Patch Available (was: Open) support COMMENT clause on CREATE INDEX, and add new command

[jira] Updated: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new command for SHOW INDEXES

2010-11-10 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1497: - Attachment: HIVE-1497.6.patch * Removed commented out code * Added a test case with index

[jira] Updated: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new command for SHOW INDEXES

2010-11-10 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1497: - Status: Patch Available (was: Open) support COMMENT clause on CREATE INDEX, and add new command

[jira] Commented: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

2010-11-04 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928140#action_12928140 ] Russell Melick commented on HIVE-1497: -- Should also update the Index wiki: http

[jira] Updated: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

2010-11-02 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1497: - Attachment: HIVE-1497.4.patch support COMMENT clause on CREATE INDEX, and add new commands

[jira] Updated: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

2010-10-27 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1497: - Attachment: hive-1497.p3.patch Coding complete, but unit tests not added yet. Does not deal