[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-12-17 Thread Jonathan Hsieh (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850636#comment-13850636
 ] 

Jonathan Hsieh commented on HBASE-9895:
---

[~jeffreyz] This option should be documented in the usage (run with no args) 
and in the refguide here http://hbase.apache.org/book.html#import .  Mind doing 
a follow on and adding documentation (cut and past of new usage would be 
great).  See importTsv for a similar example.

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Fix For: 0.98.0, 0.96.1

 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-12-17 Thread Jeffrey Zhong (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850766#comment-13850766
 ] 

Jeffrey Zhong commented on HBASE-9895:
--

ok, let me add some notes there.

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Fix For: 0.98.0, 0.96.1

 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-13 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821121#comment-13821121
 ] 

Hudson commented on HBASE-9895:
---

SUCCESS: Integrated in hbase-0.96-hadoop2 #118 (See 
[https://builds.apache.org/job/hbase-0.96-hadoop2/118/])
HBASE-9895: 0.96 Import utility can't import an exported file from 0.94 
(jeffreyz: rev 1540927)
* 
/hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java
* 
/hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/ResultSerialization.java
* 
/hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
* 
/hbase/branches/0.96/hbase-server/src/test/resources/org/apache/hadoop/hbase/mapreduce
* 
/hbase/branches/0.96/hbase-server/src/test/resources/org/apache/hadoop/hbase/mapreduce/exportedTableIn94Format


 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Fix For: 0.98.0, 0.96.1

 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-12 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820447#comment-13820447
 ] 

Hudson commented on HBASE-9895:
---

SUCCESS: Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #835 (See 
[https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/835/])
HBASE-9895: 0.96 Import utility can't import an exported file from 0.94 
(jeffreyz: rev 1540926)
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/ResultSerialization.java
* 
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
* /hbase/trunk/hbase-server/src/test/resources/org/apache/hadoop/hbase/mapreduce
* 
/hbase/trunk/hbase-server/src/test/resources/org/apache/hadoop/hbase/mapreduce/exportedTableIn94Format


 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Fix For: 0.98.0, 0.96.1

 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-12 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820548#comment-13820548
 ] 

Hudson commented on HBASE-9895:
---

SUCCESS: Integrated in HBase-TRUNK #4678 (See 
[https://builds.apache.org/job/HBase-TRUNK/4678/])
HBASE-9895: 0.96 Import utility can't import an exported file from 0.94 
(jeffreyz: rev 1540926)
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java
* 
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/ResultSerialization.java
* 
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
* /hbase/trunk/hbase-server/src/test/resources/org/apache/hadoop/hbase/mapreduce
* 
/hbase/trunk/hbase-server/src/test/resources/org/apache/hadoop/hbase/mapreduce/exportedTableIn94Format


 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Fix For: 0.98.0, 0.96.1

 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-12 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820731#comment-13820731
 ] 

Hudson commented on HBASE-9895:
---

SUCCESS: Integrated in hbase-0.96 #187 (See 
[https://builds.apache.org/job/hbase-0.96/187/])
HBASE-9895: 0.96 Import utility can't import an exported file from 0.94 
(jeffreyz: rev 1540927)
* 
/hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java
* 
/hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/ResultSerialization.java
* 
/hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
* 
/hbase/branches/0.96/hbase-server/src/test/resources/org/apache/hadoop/hbase/mapreduce
* 
/hbase/branches/0.96/hbase-server/src/test/resources/org/apache/hadoop/hbase/mapreduce/exportedTableIn94Format


 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Fix For: 0.98.0, 0.96.1

 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-11 Thread Nick Dimiduk (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819156#comment-13819156
 ] 

Nick Dimiduk commented on HBASE-9895:
-

This new test is exactly what I had in mind, perfect. Can you confirm that it's 
cleaning up the temp filesystem after the test ends, make sure it's not 
abandoning any cruft in the run directory.

Was removal of {{testMetaExport}} intentional?

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-11 Thread Nick Dimiduk (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819256#comment-13819256
 ] 

Nick Dimiduk commented on HBASE-9895:
-

Excellent. +1

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-11 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819354#comment-13819354
 ] 

Hadoop QA commented on HBASE-9895:
--

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12613196/hbase-9895-v3.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 5 new 
or modified tests.

{color:green}+1 hadoop1.0{color}.  The patch compiles against the hadoop 
1.0 profile.

{color:green}+1 hadoop2.0{color}.  The patch compiles against the hadoop 
2.0 profile.

{color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 1 
warning messages.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

{color:red}-1 site{color}.  The patch appears to cause mvn site goal to 
fail.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   org.apache.hadoop.hbase.mapreduce.TestImportExport

 {color:red}-1 core zombie tests{color}.  There are 1 zombie test(s):   
at 
org.apache.hadoop.hbase.TestZooKeeper.testRegionAssignmentAfterMasterRecoveryDueToZKExpiry(TestZooKeeper.java:488)

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7813//console

This message is automatically generated.

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-11 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819368#comment-13819368
 ] 

stack commented on HBASE-9895:
--

+1 for trunk and 0.96.  Please add nice release note since it is my guess a few 
folks will be looking to see if this facility is present in 0.96 going forward.

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-11 Thread Enis Soztutar (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819396#comment-13819396
 ] 

Enis Soztutar commented on HBASE-9895:
--

Nice patch +1. 
Please change the param name hbase.input.version, to be hbase.import.version. 
I guess this can be used with -Dhbase.import.version override when launching 
the job.  

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-11 Thread Jeffrey Zhong (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819595#comment-13819595
 ] 

Jeffrey Zhong commented on HBASE-9895:
--

Thanks for all the reviews! [~enis] I'll rename config setting name to 
hbase.import.version when I commit the change.  
[~saint@gmail.com] Yeah, I'll add a release note on this. Thanks.

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895-v3.patch, hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-09 Thread Jeffrey Zhong (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13818372#comment-13818372
 ] 

Jeffrey Zhong commented on HBASE-9895:
--

That's a typo and should be INPUT_FORMAT_VER. I'll fix it and add comment when 
I check in the patch.  Thanks for the good catch!

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-08 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817162#comment-13817162
 ] 

Hadoop QA commented on HBASE-9895:
--

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12612762/hbase-9895.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 hadoop1.0{color}.  The patch compiles against the hadoop 
1.0 profile.

{color:green}+1 hadoop2.0{color}.  The patch compiles against the hadoop 
2.0 profile.

{color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 1 
warning messages.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

{color:red}-1 site{color}.  The patch appears to cause mvn site goal to 
fail.

{color:green}+1 core tests{color}.  The patch passed unit tests in .

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7791//console

This message is automatically generated.

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-08 Thread Nick Dimiduk (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817571#comment-13817571
 ] 

Nick Dimiduk commented on HBASE-9895:
-

This looks like magic to me; where is setConf(Configuration) called on the 
Serialization instance? When will getConf() be non-null?

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-08 Thread Jeffrey Zhong (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817580#comment-13817580
 ] 

Jeffrey Zhong commented on HBASE-9895:
--

class ResultSerialization is extended from Configured. Therefore, when 
mapreduce initializes those class and configuration will be passed to the new 
instance automatically(magically). 

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-08 Thread Nick Dimiduk (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817601#comment-13817601
 ] 

Nick Dimiduk commented on HBASE-9895:
-

Alright then. Any chance of adding some kind of test? Maybe a data blob that 
matches the old format? Looks good otherwise.

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-08 Thread Nick Dimiduk (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817996#comment-13817996
 ] 

Nick Dimiduk commented on HBASE-9895:
-

The sample file is small. Can we add it as a src/test/resource ?

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-08 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13818002#comment-13818002
 ] 

Hadoop QA commented on HBASE-9895:
--

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12612958/hbase-9895-v2.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 5 new 
or modified tests.

{color:green}+1 hadoop1.0{color}.  The patch compiles against the hadoop 
1.0 profile.

{color:green}+1 hadoop2.0{color}.  The patch compiles against the hadoop 
2.0 profile.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

{color:red}-1 site{color}.  The patch appears to cause mvn site goal to 
fail.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   org.apache.hadoop.hbase.mapreduce.TestImportExport

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7803//console

This message is automatically generated.

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-08 Thread Jeffrey Zhong (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13818007#comment-13818007
 ] 

Jeffrey Zhong commented on HBASE-9895:
--

{quote}
The sample file is small. Can we add it as a src/test/resource ?
{quote}
The binary data file is added into 
src/test/resources/org/apache/hadoop/hbase/mapreduce/exportedTableIn94Format. 
As I mentioned above, patch file can't contain binary file so I have to attach 
the binary file separately and QA run will fail. When commit the change, I'll 
commit the binary under 
src/test/resources/org/apache/hadoop/hbase/mapreduce/exportedTableIn94Format 
along with the text patch file. Therefore, there won't be any issue. 

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-08 Thread Ted Yu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13818035#comment-13818035
 ] 

Ted Yu commented on HBASE-9895:
---

{code}
+  public static final String INPUT_FORMT_VER = hbase.input.version;
{code}
There is no comment above the constant definition.
FORMT is not a word. Did you intend to say FORMAT or FROM ?

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: exportedTableIn94Format, hbase-9895-v2.patch, 
 hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Commented] (HBASE-9895) 0.96 Import utility can't import an exported file from 0.94

2013-11-06 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13815697#comment-13815697
 ] 

Hadoop QA commented on HBASE-9895:
--

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12612519/hbase-9895.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 hadoop1.0{color}.  The patch compiles against the hadoop 
1.0 profile.

{color:green}+1 hadoop2.0{color}.  The patch compiles against the hadoop 
2.0 profile.

{color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 1 
warning messages.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:red}-1 findbugs{color}.  The patch appears to introduce 4 new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

{color:red}-1 site{color}.  The patch appears to cause mvn site goal to 
fail.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   
org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort

 {color:red}-1 core zombie tests{color}.  There are 1 zombie test(s):   
at 
org.apache.hadoop.hbase.TestZooKeeper.testRegionAssignmentAfterMasterRecoveryDueToZKExpiry(TestZooKeeper.java:488)

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/7771//console

This message is automatically generated.

 0.96 Import utility can't import an exported file from 0.94
 ---

 Key: HBASE-9895
 URL: https://issues.apache.org/jira/browse/HBASE-9895
 Project: HBase
  Issue Type: Bug
  Components: mapreduce
Affects Versions: 0.96.0
Reporter: Jeffrey Zhong
Assignee: Jeffrey Zhong
 Attachments: hbase-9895.patch


 Basically we PBed org.apache.hadoop.hbase.client.Result so a 0.96 cluster 
 cannot import 0.94 exported files. This issue is annoying because a user 
 can't import his old archive files after upgrade or archives from others who 
 are using 0.94.
 The ideal way is to catch deserialization error and then fall back to 0.94 
 format for importing.



--
This message was sent by Atlassian JIRA
(v6.1#6144)