[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1523: - Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed Committed. Thanks Joy > ql tests no longer work in miniMR mode > -- > > Key: HIVE-1523 > URL: https://issues.apache.org/jira/browse/HIVE-1523 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor >Reporter: Joydeep Sen Sarma >Assignee: Joydeep Sen Sarma > Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch, > hive-1523.4.patch > > > as per title. here's the first exception i see: > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: > java.io.FileNotFoun\ > dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist. > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(746)) - > java.io.FileNotFoundException: Fil\ > e file:/build/ql/test/data/warehouse/dest_j1 does not exist. > at > org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) > at > org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) > at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1523: Attachment: hive-1523.4.patch - added exclude tests - minimr tests are excluded from regular clientpositive tests - did some subtle changes in how fs.default.name and mapred.job.tracker are specified to allow testing against external hadoop clusters > ql tests no longer work in miniMR mode > -- > > Key: HIVE-1523 > URL: https://issues.apache.org/jira/browse/HIVE-1523 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor >Reporter: Joydeep Sen Sarma >Assignee: Joydeep Sen Sarma > Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch, > hive-1523.4.patch > > > as per title. here's the first exception i see: > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: > java.io.FileNotFoun\ > dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist. > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(746)) - > java.io.FileNotFoundException: Fil\ > e file:/build/ql/test/data/warehouse/dest_j1 does not exist. > at > org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) > at > org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) > at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1523: Status: Patch Available (was: Open) > ql tests no longer work in miniMR mode > -- > > Key: HIVE-1523 > URL: https://issues.apache.org/jira/browse/HIVE-1523 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor >Reporter: Joydeep Sen Sarma >Assignee: Joydeep Sen Sarma > Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch, > hive-1523.4.patch > > > as per title. here's the first exception i see: > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: > java.io.FileNotFoun\ > dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist. > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(746)) - > java.io.FileNotFoundException: Fil\ > e file:/build/ql/test/data/warehouse/dest_j1 does not exist. > at > org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) > at > org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) > at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1523: - Status: Open (was: Patch Available) > ql tests no longer work in miniMR mode > -- > > Key: HIVE-1523 > URL: https://issues.apache.org/jira/browse/HIVE-1523 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor >Reporter: Joydeep Sen Sarma >Assignee: Joydeep Sen Sarma > Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch > > > as per title. here's the first exception i see: > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: > java.io.FileNotFoun\ > dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist. > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(746)) - > java.io.FileNotFoundException: Fil\ > e file:/build/ql/test/data/warehouse/dest_j1 does not exist. > at > org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) > at > org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) > at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1523: Attachment: hive-1523.3.patch small change - fix 0.20 version match to pick the right jetty version. > ql tests no longer work in miniMR mode > -- > > Key: HIVE-1523 > URL: https://issues.apache.org/jira/browse/HIVE-1523 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor >Reporter: Joydeep Sen Sarma >Assignee: Joydeep Sen Sarma > Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch > > > as per title. here's the first exception i see: > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: > java.io.FileNotFoun\ > dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist. > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(746)) - > java.io.FileNotFoundException: Fil\ > e file:/build/ql/test/data/warehouse/dest_j1 does not exist. > at > org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) > at > org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) > at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1523: Attachment: hive-1523.2.patch with modified list of minimr tests: + i took the ones that worked from John's list. also added a couple of tests that had 'add jar' and 'add file' commands (since their interaction with real cluster is quite different). > ql tests no longer work in miniMR mode > -- > > Key: HIVE-1523 > URL: https://issues.apache.org/jira/browse/HIVE-1523 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor >Reporter: Joydeep Sen Sarma >Assignee: Joydeep Sen Sarma > Attachments: hive-1523.1.patch, hive-1523.2.patch > > > as per title. here's the first exception i see: > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: > java.io.FileNotFoun\ > dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist. > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(746)) - > java.io.FileNotFoundException: Fil\ > e file:/build/ql/test/data/warehouse/dest_j1 does not exist. > at > org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) > at > org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) > at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1523: Status: Patch Available (was: Open) Assignee: Joydeep Sen Sarma > ql tests no longer work in miniMR mode > -- > > Key: HIVE-1523 > URL: https://issues.apache.org/jira/browse/HIVE-1523 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor >Reporter: Joydeep Sen Sarma >Assignee: Joydeep Sen Sarma > Attachments: hive-1523.1.patch > > > as per title. here's the first exception i see: > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: > java.io.FileNotFoun\ > dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist. > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(746)) - > java.io.FileNotFoundException: Fil\ > e file:/build/ql/test/data/warehouse/dest_j1 does not exist. > at > org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) > at > org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) > at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1523: Attachment: hive-1523.1.patch fixed minimr test mode. enabled a couple of queries to always run (additionally) in minimr mode (like hbase-handler tests) when running standard tests. we should probably expand this to a larger number of queries (especially those requiring multiple reducers). i don't have good insight into this part - if people have ideas - we can expand the list easily. > ql tests no longer work in miniMR mode > -- > > Key: HIVE-1523 > URL: https://issues.apache.org/jira/browse/HIVE-1523 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor >Reporter: Joydeep Sen Sarma > Attachments: hive-1523.1.patch > > > as per title. here's the first exception i see: > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: > java.io.FileNotFoun\ > dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist. > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(746)) - > java.io.FileNotFoundException: Fil\ > e file:/build/ql/test/data/warehouse/dest_j1 does not exist. > at > org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) > at > org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) > at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1523: Component/s: Query Processor (was: Build Infrastructure) > ql tests no longer work in miniMR mode > -- > > Key: HIVE-1523 > URL: https://issues.apache.org/jira/browse/HIVE-1523 > Project: Hadoop Hive > Issue Type: Bug > Components: Query Processor >Reporter: Joydeep Sen Sarma > > as per title. here's the first exception i see: > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: > java.io.FileNotFoun\ > dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist. > 2010-08-09 18:05:11,259 ERROR hive.log > (MetaStoreUtils.java:logAndThrowMetaException(746)) - > java.io.FileNotFoundException: Fil\ > e file:/build/ql/test/data/warehouse/dest_j1 does not exist. > at > org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361) > at > org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) > at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.