[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12773103#action_12773103 ] Alan Gates commented on PIG-970: When I run TestHBaseStorage now I get: Testcase: testLoadFromHBase took 592.908 sec Caused an ERROR Unable to open iterator for alias a org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias a at org.apache.pig.PigServer.openIterator(PigServer.java:481) at org.apache.pig.test.TestHBaseStorage.testLoadFromHBase(TestHBaseStorage.java:170) Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 6015: During execution, encountered a Hadoop error. at .apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:922) at .apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:573) at .apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:555) at .apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:686) at .apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:582) at .apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:555) at .apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:686) at .apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:586) at .apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:549) at .apache.hadoop.hbase.client.HTable.init(HTable.java:125) at .apache.pig.backend.hadoop.hbase.HBaseSlice.init(HBaseSlice.java:159) at .apache.pig.backend.hadoop.executionengine.mapReduceLayer.SliceWrapper.makeReader(SliceWrapper.java:129) at .apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getRecordReader(PigInputFormat.java:258) at .apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:338) at .apache.hadoop.mapred.MapTask.run(MapTask.java:307) Caused by: org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out trying to locate root region Let me know if you'd like to see the whole log. Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12773348#action_12773348 ] Alan Gates commented on PIG-970: afterside:~/src/pig/PIG-970-3/trunk jar tf pig-withouthadoop.jar | grep hbase org/apache/pig/backend/hadoop/hbase/ org/apache/pig/backend/hadoop/hbase/HBaseSlice.class org/apache/pig/backend/hadoop/hbase/HBaseStorage.class Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, test-output.tgz, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12773309#action_12773309 ] Jeff Zhang commented on PIG-970: Alan, do you have file hbase-site.xml in folder test ? ( I put it in my patch) Because I look into the logs and find that the map task is attempting to connect to zookeeper at port 2181, but the the port of MiniZookeeperCluster is 21810. So there should be a file hbase-site.xml in folder test to override the configuration just like they did in hbase trunk. Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, test-output.tgz, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12773297#action_12773297 ] Jeff Zhang commented on PIG-970: yes, Alan, Could you attach the whole log including the logs of task tracker Thank you. Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12773314#action_12773314 ] Alan Gates commented on PIG-970: Yes, it's there. Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, test-output.tgz, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12773339#action_12773339 ] Jeff Zhang commented on PIG-970: Well, it's weird. Alan, could check again that the pig-0.6.0-dev-withouthadoop.jar have file hbase-site.xml, and in this file hbase.zookeeper.property.clientPort is set to 21810 ? Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, test-output.tgz, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12772461#action_12772461 ] Jeff Zhang commented on PIG-970: Vincent, I do not know how you pass TestHBaseStorage using your patch. Because hbase 0.20 integrate zookeeper , so TestHBaseStorage has to be updated accordingly. I submit the patch including the source code and jars. (one tricky thing is that MiniZookeeperCluster's client port is 21810 which is hard coded in source code level, while the default zookeeper's port is 2181. so I attach hbase-site.xml to override the client port of zookeeper to make it the same as MiniZookeeperCluster) Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12772464#action_12772464 ] Hadoop QA commented on PIG-970: --- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12423811/zookeeper-hbase-1329.jar against trunk revision 831481. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 92 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/136/console This message is automatically generated. Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12772465#action_12772465 ] Jeff Zhang commented on PIG-970: this patch works on my machine, but it seems that I have no right to put the jars into pig trunk, so anyone could help validate the patch on pig trunk ? Thank you in advance. Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12772781#action_12772781 ] Alan Gates commented on PIG-970: Patch doesn't include binary files. I'll pull together the latest patch plus the jars and test it. Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Assignee: Jeff Zhang Fix For: 0.5.0 Attachments: build.xml.path, hbase-0.20.0-test.jar, hbase-0.20.0.jar, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, Pig_HBase_0.20.0.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt, zookeeper-hbase-1329.jar The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12770866#action_12770866 ] Jeff Zhang commented on PIG-970: Any progress on this issue ? It looks like it's still opened Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Attachments: build.xml.path, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12770974#action_12770974 ] Alan Gates commented on PIG-970: I haven't been able to get the unit test to pass in my environment. Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Attachments: build.xml.path, pig-hbase-0.20.0-support.patch, pig-hbase-20-v2.patch, TEST-org.apache.pig.test.TestHBaseStorage.txt, TEST-org.apache.pig.test.TestHBaseStorage.txt The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12759626#action_12759626 ] Alan Gates commented on PIG-970: In addition to adding hbase-0.20.0.jar to the lib directory did you add hbase-0.20.0-test? Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Attachments: pig-hbase-0.20.0-support.patch The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-970) Support of HBase 0.20.0
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12759727#action_12759727 ] Vincent BARAT commented on PIG-970: --- Yes, but I was unable to make the TestHBaseStorage work. I guess it was just a matter of environement, since the errors were related to a classes not found. I didn't waste too much time on that actually... I will try again. Support of HBase 0.20.0 --- Key: PIG-970 URL: https://issues.apache.org/jira/browse/PIG-970 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.3.0 Reporter: Vincent BARAT Attachments: pig-hbase-0.20.0-support.patch The support of HBase is currently very limited and restricted to HBase 0.18.0. Because the next releases of PIG will support Hadoop 0.20.0, they should also support HBase 0.20.0. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
