[jira] [Commented] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414878#comment-16414878 ] LiXin Ge commented on MAPREDUCE-6903: - No fail or error tests, some test skipped because of the {{Ignore}} label: seems the judgement standard of {{hadoop-mapreduce-client-jobclient}} needs update. Hi [~xgong], any suggestion for the last patch of this easy fix? Many thanks. > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch, > MAPREDUCE-6903.003.patch, MAPREDUCE-6903.004.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413711#comment-16413711 ] LiXin Ge commented on MAPREDUCE-6903: - just rebase the patch to see if the unit test always fails. > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch, > MAPREDUCE-6903.003.patch, MAPREDUCE-6903.004.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Attachment: MAPREDUCE-6903.004.patch > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch, > MAPREDUCE-6903.003.patch, MAPREDUCE-6903.004.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Status: Patch Available (was: Open) > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch, > MAPREDUCE-6903.003.patch, MAPREDUCE-6903.004.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Status: Open (was: Patch Available) > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch, > MAPREDUCE-6903.003.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382982#comment-16382982 ] LiXin Ge commented on MAPREDUCE-6903: - Can't find why the unit test report a failure status, seems because of some skipped tests? {quote}[INFO] Results: [INFO] [WARNING] Tests run: 564, Failures: 0, Errors: 0, Skipped: 10 [INFO] [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:05 h [INFO] Finished at: 2018-03-01T12:55:38+00:00 [INFO] Final Memory: 22M/462M [INFO] {quote} > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch, > MAPREDUCE-6903.003.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Status: Patch Available (was: Open) > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch, > MAPREDUCE-6903.003.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381727#comment-16381727 ] LiXin Ge commented on MAPREDUCE-6903: - [~xgong] Thanks for your review and kindly advise. I honestly a newbie in MapReduce when I create the original patch and didn't go a step further to make the patch better when rebase it these days. patch 003 have fixed the issue according to your hint, thanks. BTW, {{TimelineServicePerformance}} can run with {{SimpleEntityWriterV1}} now, but still have some exception with {{SimpleEntityWriterV2}}, if needed, maybe another Jira to fix that? > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch, > MAPREDUCE-6903.003.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Attachment: MAPREDUCE-6903.003.patch > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch, > MAPREDUCE-6903.003.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Status: Open (was: Patch Available) > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379710#comment-16379710 ] LiXin Ge commented on MAPREDUCE-6903: - Hi, [~arpitagarwal], [~ste...@apache.org], [~xgong], would you please help to review this easy fix and let it move on? Many thanks! > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378187#comment-16378187 ] LiXin Ge commented on MAPREDUCE-6903: - clear the unnecessary checkstyle fix and rebase the patch. > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Status: Patch Available (was: Open) > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Attachment: MAPREDUCE-6903.002.patch > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch, MAPREDUCE-6903.002.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Status: Open (was: Patch Available) > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge >Priority: Major > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6905) Fix meaningless operations in TestDFSIO in some situation.
[ https://issues.apache.org/jira/browse/MAPREDUCE-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072305#comment-16072305 ] LiXin Ge commented on MAPREDUCE-6905: - That's my pleasure, [~Naganarasimha]. Thanks for your review. > Fix meaningless operations in TestDFSIO in some situation. > -- > > Key: MAPREDUCE-6905 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6905 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: tools/rumen >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge > Labels: patch > Fix For: 3.0.0-beta1, 2.8.2, 2.9 > > Attachments: MAPREDUCE-6905.001.patch > > > When run TestDFSIO in write mode with 2 million nrFiles, it will *takes > hours* to create control files and get IOException as last because of > directory item limit is exceeded. And, it will leave over 1 million useless > files which will be deleted when run TestDFSIO again with acceptable nrFiles. > > {quote} > 17/06/21 09:12:16 INFO fs.TestDFSIO: creating control file: 1024 bytes, > 200 files > java.io.IOException: The directory item limit of > /benchmarks/TestDFSIO/io_control is exceeded: limit=1048576 items=1048576 > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.verifyMaxDirItems(FSDirectory.java:2033) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:2084) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addLastINode(FSDirectory.java:2053) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addINode(FSDirectory.java:1873) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addFile(FSDirectory.java:327) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:2750) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:2632) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:2520) > at > org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:579) > at > org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:394) > at > org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034) > at org.apache.hadoop.fs.TestDFSIO.createControlFile(TestDFSIO.java:302) > at org.apache.hadoop.fs.TestDFSIO.run(TestDFSIO.java:751) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:650) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71) > at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) > at > org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:118) > at > org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:126) > {quote} > In brief, we'd better check the parameter of nrFiles before it waste our time > and hurt our feelings. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6905) Fix meaningless operations in TestDFSIO in some situation.
[ https://issues.apache.org/jira/browse/MAPREDUCE-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064621#comment-16064621 ] LiXin Ge commented on MAPREDUCE-6905: - Thanks for your review, [~Naganarasimha]. I'm glad to see my patch get through to work :) > Fix meaningless operations in TestDFSIO in some situation. > -- > > Key: MAPREDUCE-6905 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6905 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: tools/rumen >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge > Labels: patch > Attachments: MAPREDUCE-6905.001.patch > > > When run TestDFSIO in write mode with 2 million nrFiles, it will *takes > hours* to create control files and get IOException as last because of > directory item limit is exceeded. And, it will leave over 1 million useless > files which will be deleted when run TestDFSIO again with acceptable nrFiles. > > {quote} > 17/06/21 09:12:16 INFO fs.TestDFSIO: creating control file: 1024 bytes, > 200 files > java.io.IOException: The directory item limit of > /benchmarks/TestDFSIO/io_control is exceeded: limit=1048576 items=1048576 > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.verifyMaxDirItems(FSDirectory.java:2033) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:2084) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addLastINode(FSDirectory.java:2053) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addINode(FSDirectory.java:1873) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addFile(FSDirectory.java:327) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:2750) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:2632) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:2520) > at > org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:579) > at > org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:394) > at > org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034) > at org.apache.hadoop.fs.TestDFSIO.createControlFile(TestDFSIO.java:302) > at org.apache.hadoop.fs.TestDFSIO.run(TestDFSIO.java:751) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:650) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71) > at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) > at > org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:118) > at > org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:126) > {quote} > In brief, we'd better check the parameter of nrFiles before it waste our time > and hurt our feelings. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6905) Fix meaningless operations in TestDFSIO in some situation.
[ https://issues.apache.org/jira/browse/MAPREDUCE-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6905: Attachment: MAPREDUCE-6905.001.patch > Fix meaningless operations in TestDFSIO in some situation. > -- > > Key: MAPREDUCE-6905 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6905 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: tools/rumen >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge > Labels: patch > Attachments: MAPREDUCE-6905.001.patch > > > When run TestDFSIO in write mode with 2 million nrFiles, it will *takes > hours* to create control files and get IOException as last because of > directory item limit is exceeded. And, it will leave over 1 million useless > files which will be deleted when run TestDFSIO again with acceptable nrFiles. > > {quote} > 17/06/21 09:12:16 INFO fs.TestDFSIO: creating control file: 1024 bytes, > 200 files > java.io.IOException: The directory item limit of > /benchmarks/TestDFSIO/io_control is exceeded: limit=1048576 items=1048576 > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.verifyMaxDirItems(FSDirectory.java:2033) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:2084) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addLastINode(FSDirectory.java:2053) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addINode(FSDirectory.java:1873) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addFile(FSDirectory.java:327) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:2750) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:2632) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:2520) > at > org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:579) > at > org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:394) > at > org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034) > at org.apache.hadoop.fs.TestDFSIO.createControlFile(TestDFSIO.java:302) > at org.apache.hadoop.fs.TestDFSIO.run(TestDFSIO.java:751) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:650) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71) > at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) > at > org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:118) > at > org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:126) > {quote} > In brief, we'd better check the parameter of nrFiles before it waste our time > and hurt our feelings. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6905) Fix meaningless operations in TestDFSIO in some situation.
[ https://issues.apache.org/jira/browse/MAPREDUCE-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6905: Status: Patch Available (was: Open) > Fix meaningless operations in TestDFSIO in some situation. > -- > > Key: MAPREDUCE-6905 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6905 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: tools/rumen >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge > Labels: patch > Attachments: MAPREDUCE-6905.001.patch > > > When run TestDFSIO in write mode with 2 million nrFiles, it will *takes > hours* to create control files and get IOException as last because of > directory item limit is exceeded. And, it will leave over 1 million useless > files which will be deleted when run TestDFSIO again with acceptable nrFiles. > > {quote} > 17/06/21 09:12:16 INFO fs.TestDFSIO: creating control file: 1024 bytes, > 200 files > java.io.IOException: The directory item limit of > /benchmarks/TestDFSIO/io_control is exceeded: limit=1048576 items=1048576 > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.verifyMaxDirItems(FSDirectory.java:2033) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:2084) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addLastINode(FSDirectory.java:2053) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addINode(FSDirectory.java:1873) > at > org.apache.hadoop.hdfs.server.namenode.FSDirectory.addFile(FSDirectory.java:327) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:2750) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:2632) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:2520) > at > org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:579) > at > org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:394) > at > org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034) > at org.apache.hadoop.fs.TestDFSIO.createControlFile(TestDFSIO.java:302) > at org.apache.hadoop.fs.TestDFSIO.run(TestDFSIO.java:751) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:650) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71) > at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) > at > org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:118) > at > org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:126) > {quote} > In brief, we'd better check the parameter of nrFiles before it waste our time > and hurt our feelings. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-6905) Fix meaningless operations in TestDFSIO in some situation.
LiXin Ge created MAPREDUCE-6905: --- Summary: Fix meaningless operations in TestDFSIO in some situation. Key: MAPREDUCE-6905 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6905 Project: Hadoop Map/Reduce Issue Type: Bug Components: tools/rumen Affects Versions: 3.0.0-alpha4 Reporter: LiXin Ge Assignee: LiXin Ge When run TestDFSIO in write mode with 2 million nrFiles, it will *takes hours* to create control files and get IOException as last because of directory item limit is exceeded. And, it will leave over 1 million useless files which will be deleted when run TestDFSIO again with acceptable nrFiles. {quote} 17/06/21 09:12:16 INFO fs.TestDFSIO: creating control file: 1024 bytes, 200 files java.io.IOException: The directory item limit of /benchmarks/TestDFSIO/io_control is exceeded: limit=1048576 items=1048576 at org.apache.hadoop.hdfs.server.namenode.FSDirectory.verifyMaxDirItems(FSDirectory.java:2033) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:2084) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addLastINode(FSDirectory.java:2053) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addINode(FSDirectory.java:1873) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addFile(FSDirectory.java:327) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:2750) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:2632) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:2520) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:579) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:394) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034) at org.apache.hadoop.fs.TestDFSIO.createControlFile(TestDFSIO.java:302) at org.apache.hadoop.fs.TestDFSIO.run(TestDFSIO.java:751) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:650) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71) at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:118) at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:126) {quote} In brief, we'd better check the parameter of nrFiles before it waste our time and hurt our feelings. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Status: Patch Available (was: Open) > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
[ https://issues.apache.org/jira/browse/MAPREDUCE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6903: Attachment: MAPREDUCE-6903.001.patch PS:some checkstyle warnings were fixed in passing. > NPE occured when run MapredTestDriver's testcase > > > Key: MAPREDUCE-6903 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 3.0.0-alpha4 >Reporter: LiXin Ge >Assignee: LiXin Ge > Labels: easyfix > Attachments: MAPREDUCE-6903.001.patch > > > When runing the timelineperformance test from MapredTestDriver without input > parameter, an NPE was throwed: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance > ... > 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the > timeline service failed > java.lang.NullPointerException > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) > at > org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > {quote} > That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-6903) NPE occured when run MapredTestDriver's testcase
LiXin Ge created MAPREDUCE-6903: --- Summary: NPE occured when run MapredTestDriver's testcase Key: MAPREDUCE-6903 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6903 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Affects Versions: 3.0.0-alpha4 Reporter: LiXin Ge Assignee: LiXin Ge When runing the timelineperformance test from MapredTestDriver without input parameter, an NPE was throwed: {quote} ./hadoop org.apache.hadoop.test.MapredTestDriver timelineperformance ... 2017-06-08 09:32:13,194 ERROR mapreduce.SimpleEntityWriterV1: writing to the timeline service failed java.lang.NullPointerException at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:178) at org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:82) at org.apache.hadoop.mapreduce.SimpleEntityWriterV1.map(SimpleEntityWriterV1.java:41) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) {quote} That's better to add a protection of NULL pointer check. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-6896) Document wrong spelling in usage of MapredTestDriver tools.
[ https://issues.apache.org/jira/browse/MAPREDUCE-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048567#comment-16048567 ] LiXin Ge commented on MAPREDUCE-6896: - Thanks [~templedf], that's my pleasure. > Document wrong spelling in usage of MapredTestDriver tools. > --- > > Key: MAPREDUCE-6896 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6896 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: documentation >Affects Versions: 3.0.0-alpha3 >Reporter: LiXin Ge >Assignee: LiXin Ge > Labels: easyfix > Fix For: 3.0.0-alpha4 > > Attachments: MAPREDUCE-6896.001.patch > > > When the user run performance test of MapredTestDriver, a spelling mistake > seems exposed to user: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver > An example program must be given as the first argument. > Valid program names are: > .. > timelineperformance: A job that launches mappers to test *timline* service > performance. > {quote} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6896) Document wrong spelling in usage of MapredTestDriver tools.
[ https://issues.apache.org/jira/browse/MAPREDUCE-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6896: Status: Patch Available (was: Open) > Document wrong spelling in usage of MapredTestDriver tools. > --- > > Key: MAPREDUCE-6896 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6896 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: documentation >Affects Versions: 3.0.0-alpha3 >Reporter: LiXin Ge > Labels: easyfix > Attachments: MAPREDUCE-6896.001.patch > > > When the user run performance test of MapredTestDriver, a spelling mistake > seems exposed to user: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver > An example program must be given as the first argument. > Valid program names are: > .. > timelineperformance: A job that launches mappers to test *timline* service > performance. > {quote} -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6896) Document wrong spelling in usage of MapredTestDriver tools.
[ https://issues.apache.org/jira/browse/MAPREDUCE-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiXin Ge updated MAPREDUCE-6896: Attachment: MAPREDUCE-6896.001.patch > Document wrong spelling in usage of MapredTestDriver tools. > --- > > Key: MAPREDUCE-6896 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6896 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: documentation >Affects Versions: 3.0.0-alpha3 >Reporter: LiXin Ge > Labels: easyfix > Attachments: MAPREDUCE-6896.001.patch > > > When the user run performance test of MapredTestDriver, a spelling mistake > seems exposed to user: > {quote} > ./hadoop org.apache.hadoop.test.MapredTestDriver > An example program must be given as the first argument. > Valid program names are: > .. > timelineperformance: A job that launches mappers to test *timline* service > performance. > {quote} -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-6896) Document wrong spelling in usage of MapredTestDriver tools.
LiXin Ge created MAPREDUCE-6896: --- Summary: Document wrong spelling in usage of MapredTestDriver tools. Key: MAPREDUCE-6896 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6896 Project: Hadoop Map/Reduce Issue Type: Bug Components: documentation Affects Versions: 3.0.0-alpha3 Reporter: LiXin Ge When the user run performance test of MapredTestDriver, a spelling mistake seems exposed to user: {quote} ./hadoop org.apache.hadoop.test.MapredTestDriver An example program must be given as the first argument. Valid program names are: .. timelineperformance: A job that launches mappers to test *timline* service performance. {quote} -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org