[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode

2010-08-25 Thread Namit Jain (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Namit Jain updated HIVE-1523:
-

  Status: Resolved  (was: Patch Available)
Hadoop Flags: [Reviewed]
  Resolution: Fixed

Committed. Thanks Joy

> ql tests no longer work in miniMR mode
> --
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Joydeep Sen Sarma
>Assignee: Joydeep Sen Sarma
> Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch, 
> hive-1523.4.patch
>
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: 
> java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(746)) - 
> java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
>   at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>   at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>   at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode

2010-08-25 Thread Joydeep Sen Sarma (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joydeep Sen Sarma updated HIVE-1523:


Attachment: hive-1523.4.patch

- added exclude tests - minimr tests are excluded from regular clientpositive 
tests
- did some subtle changes in how fs.default.name and mapred.job.tracker are 
specified to allow testing against external hadoop clusters

> ql tests no longer work in miniMR mode
> --
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Joydeep Sen Sarma
>Assignee: Joydeep Sen Sarma
> Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch, 
> hive-1523.4.patch
>
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: 
> java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(746)) - 
> java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
>   at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>   at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>   at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode

2010-08-25 Thread Joydeep Sen Sarma (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joydeep Sen Sarma updated HIVE-1523:


Status: Patch Available  (was: Open)

> ql tests no longer work in miniMR mode
> --
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Joydeep Sen Sarma
>Assignee: Joydeep Sen Sarma
> Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch, 
> hive-1523.4.patch
>
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: 
> java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(746)) - 
> java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
>   at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>   at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>   at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode

2010-08-24 Thread Namit Jain (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Namit Jain updated HIVE-1523:
-

Status: Open  (was: Patch Available)

> ql tests no longer work in miniMR mode
> --
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Joydeep Sen Sarma
>Assignee: Joydeep Sen Sarma
> Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch
>
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: 
> java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(746)) - 
> java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
>   at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>   at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>   at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode

2010-08-18 Thread Joydeep Sen Sarma (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joydeep Sen Sarma updated HIVE-1523:


Attachment: hive-1523.3.patch

small change - fix 0.20 version match to pick the right jetty version. 

> ql tests no longer work in miniMR mode
> --
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Joydeep Sen Sarma
>Assignee: Joydeep Sen Sarma
> Attachments: hive-1523.1.patch, hive-1523.2.patch, hive-1523.3.patch
>
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: 
> java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(746)) - 
> java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
>   at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>   at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>   at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode

2010-08-18 Thread Joydeep Sen Sarma (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joydeep Sen Sarma updated HIVE-1523:


Attachment: hive-1523.2.patch

with modified list of minimr tests:

+  

   

i took the ones that worked from John's list. also added a couple of tests that 
had 'add jar' and 'add file' commands (since their interaction with real 
cluster is quite different).




> ql tests no longer work in miniMR mode
> --
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Joydeep Sen Sarma
>Assignee: Joydeep Sen Sarma
> Attachments: hive-1523.1.patch, hive-1523.2.patch
>
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: 
> java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(746)) - 
> java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
>   at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>   at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>   at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode

2010-08-17 Thread Joydeep Sen Sarma (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joydeep Sen Sarma updated HIVE-1523:


  Status: Patch Available  (was: Open)
Assignee: Joydeep Sen Sarma

> ql tests no longer work in miniMR mode
> --
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Joydeep Sen Sarma
>Assignee: Joydeep Sen Sarma
> Attachments: hive-1523.1.patch
>
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: 
> java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(746)) - 
> java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
>   at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>   at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>   at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode

2010-08-17 Thread Joydeep Sen Sarma (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joydeep Sen Sarma updated HIVE-1523:


Attachment: hive-1523.1.patch

fixed minimr test mode.

enabled a couple of queries to always run (additionally) in minimr mode (like 
hbase-handler tests) when running standard tests. we should probably expand 
this to a larger number of queries (especially those requiring multiple 
reducers). i don't have good insight into this part - if people have ideas - we 
can expand the list easily.

> ql tests no longer work in miniMR mode
> --
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Joydeep Sen Sarma
> Attachments: hive-1523.1.patch
>
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: 
> java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(746)) - 
> java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
>   at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>   at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>   at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1523) ql tests no longer work in miniMR mode

2010-08-09 Thread Joydeep Sen Sarma (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joydeep Sen Sarma updated HIVE-1523:


Component/s: Query Processor
 (was: Build Infrastructure)

> ql tests no longer work in miniMR mode
> --
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Joydeep Sen Sarma
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: 
> java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log 
> (MetaStoreUtils.java:logAndThrowMetaException(746)) - 
> java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
>   at 
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>   at 
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>   at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.