[jira] [Commented] (HBASE-19169) Rowcounter job fails against hadoop3 beta1

2021-03-18 Thread Midhun P (Jira) 


[ 
https://issues.apache.org/jira/browse/HBASE-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303921#comment-17303921
 ] 

Midhun P commented on HBASE-19169:
--

Could you please let me know the resolution

> Rowcounter job fails against hadoop3 beta1
> --
>
> Key: HBASE-19169
> URL: https://issues.apache.org/jira/browse/HBASE-19169
> Project: HBase
>  Issue Type: Bug
>Reporter: Ted Yu
>Priority: Major
>
> I got the following error running rowcounter against hadoop3 beta1 based on 
> commit a9f0c5d4e2c85c1faae1b4b277e3c290c8b81d2a :
> {code}
> 2017-11-03 17:10:59,583 INFO  [main] mapreduce.Job: Task Id : 
> attempt_1509641483571_0006_m_29_1, Status : FAILED
> Error: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit$Version.fromCode(TableSplit.java:77)
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit.readFields(TableSplit.java:285)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42)
>   at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:760)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (HBASE-19169) Rowcounter job fails against hadoop3 beta1

2017-11-18 Thread Ted Yu (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16258307#comment-16258307
 ] 

Ted Yu commented on HBASE-19169:


Possibly related to the presence of hbase 1.2.6 jars (from ATS v2) in 
mapreduce.tar.gz

> Rowcounter job fails against hadoop3 beta1
> --
>
> Key: HBASE-19169
> URL: https://issues.apache.org/jira/browse/HBASE-19169
> Project: HBase
>  Issue Type: Bug
>Reporter: Ted Yu
>
> I got the following error running rowcounter against hadoop3 beta1 based on 
> commit a9f0c5d4e2c85c1faae1b4b277e3c290c8b81d2a :
> {code}
> 2017-11-03 17:10:59,583 INFO  [main] mapreduce.Job: Task Id : 
> attempt_1509641483571_0006_m_29_1, Status : FAILED
> Error: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit$Version.fromCode(TableSplit.java:77)
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit.readFields(TableSplit.java:285)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42)
>   at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:760)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HBASE-19169) Rowcounter job fails against hadoop3 beta1

2017-11-04 Thread Chia-Ping Tsai (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239391#comment-16239391
 ] 

Chia-Ping Tsai commented on HBASE-19169:


bq. Is this same or different RowCounter failure as HBASE-19167?
 HBASE-19167 is resolved by HBASE-18803, so it should be unrelated to this 
issue.

> Rowcounter job fails against hadoop3 beta1
> --
>
> Key: HBASE-19169
> URL: https://issues.apache.org/jira/browse/HBASE-19169
> Project: HBase
>  Issue Type: Bug
>Reporter: Ted Yu
>
> I got the following error running rowcounter against hadoop3 beta1 based on 
> commit a9f0c5d4e2c85c1faae1b4b277e3c290c8b81d2a :
> {code}
> 2017-11-03 17:10:59,583 INFO  [main] mapreduce.Job: Task Id : 
> attempt_1509641483571_0006_m_29_1, Status : FAILED
> Error: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit$Version.fromCode(TableSplit.java:77)
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit.readFields(TableSplit.java:285)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42)
>   at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:760)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HBASE-19169) Rowcounter job fails against hadoop3 beta1

2017-11-03 Thread Ted Yu (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238050#comment-16238050
 ] 

Ted Yu commented on HBASE-19169:


I don't know how the tar ball was built for HBASE-19167

I didn't see the same exception.

> Rowcounter job fails against hadoop3 beta1
> --
>
> Key: HBASE-19169
> URL: https://issues.apache.org/jira/browse/HBASE-19169
> Project: HBase
>  Issue Type: Bug
>Reporter: Ted Yu
>Priority: Major
>
> I got the following error running rowcounter against hadoop3 beta1 based on 
> commit a9f0c5d4e2c85c1faae1b4b277e3c290c8b81d2a :
> {code}
> 2017-11-03 17:10:59,583 INFO  [main] mapreduce.Job: Task Id : 
> attempt_1509641483571_0006_m_29_1, Status : FAILED
> Error: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit$Version.fromCode(TableSplit.java:77)
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit.readFields(TableSplit.java:285)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42)
>   at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:760)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HBASE-19169) Rowcounter job fails against hadoop3 beta1

2017-11-03 Thread Mike Drob (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238042#comment-16238042
 ] 

Mike Drob commented on HBASE-19169:
---

Is this same or different RowCounter failure as HBASE-19167?

> Rowcounter job fails against hadoop3 beta1
> --
>
> Key: HBASE-19169
> URL: https://issues.apache.org/jira/browse/HBASE-19169
> Project: HBase
>  Issue Type: Bug
>Reporter: Ted Yu
>Priority: Major
>
> I got the following error running rowcounter against hadoop3 beta1 based on 
> commit a9f0c5d4e2c85c1faae1b4b277e3c290c8b81d2a :
> {code}
> 2017-11-03 17:10:59,583 INFO  [main] mapreduce.Job: Task Id : 
> attempt_1509641483571_0006_m_29_1, Status : FAILED
> Error: java.lang.ArrayIndexOutOfBoundsException: 2
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit$Version.fromCode(TableSplit.java:77)
>   at 
> org.apache.hadoop.hbase.mapreduce.TableSplit.readFields(TableSplit.java:285)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71)
>   at 
> org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42)
>   at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:760)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HBASE-19169) Rowcounter job fails against hadoop3 beta1

2017-11-03 Thread Ted Yu (JIRA) 

[ 
https://issues.apache.org/jira/browse/HBASE-19169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238026#comment-16238026
 ] 

Ted Yu commented on HBASE-19169:


Task log didn't reveal much beyond the exception:
{code}
2017-11-03 17:10:46,416 INFO [IPC Server handler 0 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1509641483571_0006_m_02 given task: 
attempt_1509641483571_0006_m_00_0
2017-11-03 17:10:46,661 INFO [Socket Reader #1 for port 41432] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1509641483571_0006 (auth:SIMPLE)
2017-11-03 17:10:46,674 INFO [IPC Server handler 2 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1509641483571_0006_m_08 asked for a task
2017-11-03 17:10:46,674 INFO [IPC Server handler 2 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1509641483571_0006_m_08 given task: 
attempt_1509641483571_0006_m_06_0
2017-11-03 17:10:46,702 INFO [Socket Reader #1 for port 41432] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1509641483571_0006 (auth:SIMPLE)
2017-11-03 17:10:46,705 INFO [Socket Reader #1 for port 41432] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1509641483571_0006 (auth:SIMPLE)
2017-11-03 17:10:46,711 INFO [Socket Reader #1 for port 41432] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1509641483571_0006 (auth:SIMPLE)
2017-11-03 17:10:46,712 INFO [Socket Reader #1 for port 41432] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1509641483571_0006 (auth:SIMPLE)
2017-11-03 17:10:46,716 INFO [IPC Server handler 0 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1509641483571_0006_m_07 asked for a task
2017-11-03 17:10:46,716 INFO [IPC Server handler 0 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1509641483571_0006_m_07 given task: 
attempt_1509641483571_0006_m_01_0
2017-11-03 17:10:46,717 INFO [IPC Server handler 3 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1509641483571_0006_m_09 asked for a task
2017-11-03 17:10:46,717 INFO [IPC Server handler 3 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1509641483571_0006_m_09 given task: 
attempt_1509641483571_0006_m_11_0
2017-11-03 17:10:46,725 INFO [IPC Server handler 1 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1509641483571_0006_m_05 asked for a task
2017-11-03 17:10:46,725 INFO [IPC Server handler 1 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1509641483571_0006_m_05 given task: 
attempt_1509641483571_0006_m_09_0
2017-11-03 17:10:46,725 INFO [IPC Server handler 4 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1509641483571_0006_m_04 asked for a task
2017-11-03 17:10:46,725 INFO [IPC Server handler 4 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1509641483571_0006_m_04 given task: 
attempt_1509641483571_0006_m_04_0
2017-11-03 17:10:46,749 INFO [Socket Reader #1 for port 41432] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1509641483571_0006 (auth:SIMPLE)
2017-11-03 17:10:46,764 INFO [IPC Server handler 7 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1509641483571_0006_m_06 asked for a task
2017-11-03 17:10:46,764 INFO [IPC Server handler 7 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1509641483571_0006_m_06 given task: 
attempt_1509641483571_0006_m_14_0
2017-11-03 17:10:47,651 INFO [IPC Server handler 2 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1509641483571_0006_m_00_0 is : 0.0
2017-11-03 17:10:47,655 ERROR [IPC Server handler 0 on 41432] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1509641483571_0006_m_00_0 - exited : 
java.lang.ArrayIndexOutOfBoundsException: 2
at 
org.apache.hadoop.hbase.mapreduce.TableSplit$Version.fromCode(TableSplit.java:77)
at 
org.apache.hadoop.hbase.mapreduce.TableSplit.readFields(TableSplit.java:285)
at 
org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71)
at 
org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42)
at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:760)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
at java.security.AccessController.doPrivileged(Native