[jira] Updated: (MAPREDUCE-2139) Gridmix test for submitting jobs with different traces and runtime options.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-2139: - Attachment: MAPREDUCE-2139.patch Comments given by Ranjit against MAPREDCUE-2138 is affected to this patch. So attached new patch. > Gridmix test for submitting jobs with different traces and runtime options. > --- > > Key: MAPREDUCE-2139 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2139 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: test >Reporter: Vinay Kumar Thota >Assignee: Vinay Kumar Thota > Attachments: MAPREDUCE-2139.patch, MAPREDUCE-2139.patch > > > 1.Generate input data based on cluster size and create the synthetic jobs by > using the 7 min folded MR trace and submit > the jobs with below arguments. > GRIDMIX_JOB_TYPE = SleepJob > GRIDMIX_USER_RESOLVER = SubmitterUserResolver > GRIDMIX_MIN_FILE = 200 MB > GRIDMIX_SUBMISSION_POLICY = STRESS > GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false > Input Size = 400 MB * No. of nodes in cluster. > TRACE_FILE = 7 min folded trace. > Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, > maps, reducers and counters etc) after > completion of execution. Make sure the queue should be default queue name. > 2. Generate input data based on cluster size and create the synthetic jobs by > using the 10 min folded MR trace and > submit the jobs with below arguments. > GRIDMIX_JOB_TYPE = SleepJob > GRIDMIX_USER_RESOLVER = RoundRobinUserResolver > GRIDMIX_MIN_FILE = 200 MB > GRIDMIX_SUBMISSION_POLICY = SERIAL > GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false > SLEEPJOB_MAPTASK_ONLY = true > GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec > Input Size = 250 MB * No. of nodes in cluster. > TRACE_FILE = 10 min folded trace. > Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, > maps and counters etc) after completion of > execution. Make sure the reducers should be zero. > 3. Generate input data based on cluster size and create the synthetic jobs by > using the 12 min folded MR trace and submit the jobs with below arguments. > GRIDMIX_JOB_TYPE = SleepJob > GRIDMIX_USER_RESOLVER = SubmitterUserResolver > GRIDMIX_MIN_FILE = 200 MB > GRIDMIX_SUBMISSION_POLICY = STRESS > GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec > GRIDMIX_SLEEP_MAX_REDUCE_TIME = 5 sec > Input Size = 150 MB * No. of nodes in cluster. > TRACE_FILE = 12 min folded trace. > Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, > maps,reducers and counters etc) after completion of execution. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2139) Gridmix test for submitting jobs with different traces and runtime options.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-2139: - Description: 1.Generate input data based on cluster size and create the synthetic jobs by using the 7 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false Input Size = 400 MB * No. of nodes in cluster. TRACE_FILE = 7 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps, reducers and counters etc) after completion of execution. Make sure the queue should be default queue name. 2. Generate input data based on cluster size and create the synthetic jobs by using the 10 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = RoundRobinUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = SERIAL GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false SLEEPJOB_MAPTASK_ONLY = true GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec Input Size = 250 MB * No. of nodes in cluster. TRACE_FILE = 10 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps and counters etc) after completion of execution. Make sure the reducers should be zero. 3. Generate input data based on cluster size and create the synthetic jobs by using the 12 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec GRIDMIX_SLEEP_MAX_REDUCE_TIME = 5 sec Input Size = 150 MB * No. of nodes in cluster. TRACE_FILE = 12 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps,reducers and counters etc) after completion of execution. was: 1.Generate input data based on cluster size and create the synthetic jobs by using the 7 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false Input Size = 400 MB * No. of nodes in cluster. TRACE_FILE = 7 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps, reducers and counters etc) after completion of execution. Make sure the queue should be default queue name. 2. Generate input data based on cluster size and create the synthetic jobs by using the 10 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false SLEEPJOB_MAPTASK_ONLY = true GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec Input Size = 250 MB * No. of nodes in cluster. TRACE_FILE = 7 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps and counters etc) after completion of execution. Make sure the reducers should be zero. 3. Generate input data based on cluster size and create the synthetic jobs by using the 12 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec Input Size = 150 MB * No. of nodes in cluster. TRACE_FILE = 12 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps and counters etc) after completion of execution. Make sure the reducers should be zero. > Gridmix test for submitting jobs with different traces and runtime options. > --- > > Key: MAPREDUCE-2139 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2139 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: test >Reporter: Vinay Kumar Thota >Assignee: Vinay Kumar Thota > Attachments: MAPREDUCE-2139.patch > > > 1.Generate input data based on cluster size and create the synthetic jobs by > using the 7 min folded MR trace and submit > the jobs with below arguments. > GRIDMIX_JOB_TYPE = SleepJob > GRIDMIX_USER_RESOLVER = SubmitterUserResolver > GRIDMIX_MIN_FILE = 200 MB > GRIDMIX_SUBMISSION_POLICY = STRESS > GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false > Input Size = 400 MB * No. of nodes in cluster. > TRACE_FILE = 7 min folded trace. > Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, > maps, reducers and counters etc
[jira] Updated: (MAPREDUCE-2139) Gridmix test for submitting jobs with different traces and runtime options.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-2139: - Description: 1.Generate input data based on cluster size and create the synthetic jobs by using the 7 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false Input Size = 400 MB * No. of nodes in cluster. TRACE_FILE = 7 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps, reducers and counters etc) after completion of execution. Make sure the queue should be default queue name. 2. Generate input data based on cluster size and create the synthetic jobs by using the 10 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false SLEEPJOB_MAPTASK_ONLY = true GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec Input Size = 250 MB * No. of nodes in cluster. TRACE_FILE = 7 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps and counters etc) after completion of execution. Make sure the reducers should be zero. 3. Generate input data based on cluster size and create the synthetic jobs by using the 12 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec Input Size = 150 MB * No. of nodes in cluster. TRACE_FILE = 12 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps and counters etc) after completion of execution. Make sure the reducers should be zero. was: 1.Generate input data based on cluster size and create the synthetic jobs by using the 7 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false Input Size = 400 MB * No. of nodes in cluster. TRACE_FILE = 7 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps, reducers and counters etc) after completion of execution. Make sure the queue should be default queue name. 2. Generate input data based on cluster size and create the synthetic jobs by using the 10 min folded MR trace and submit the jobs with below arguments. GRIDMIX_JOB_TYPE = SleepJob GRIDMIX_USER_RESOLVER = SubmitterUserResolver GRIDMIX_MIN_FILE = 200 MB GRIDMIX_SUBMISSION_POLICY = STRESS GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false SLEEPJOB_MAPTASK_ONLY = true GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec Input Size = 250 MB * No. of nodes in cluster. TRACE_FILE = 7 min folded trace. Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, maps and counters etc) after completion of execution. Make sure the reducers should be zero. > Gridmix test for submitting jobs with different traces and runtime options. > --- > > Key: MAPREDUCE-2139 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2139 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: test >Reporter: Vinay Kumar Thota >Assignee: Vinay Kumar Thota > Attachments: MAPREDUCE-2139.patch > > > 1.Generate input data based on cluster size and create the synthetic jobs by > using the 7 min folded MR trace and submit > the jobs with below arguments. > GRIDMIX_JOB_TYPE = SleepJob > GRIDMIX_USER_RESOLVER = SubmitterUserResolver > GRIDMIX_MIN_FILE = 200 MB > GRIDMIX_SUBMISSION_POLICY = STRESS > GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false > Input Size = 400 MB * No. of nodes in cluster. > TRACE_FILE = 7 min folded trace. > Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, > maps, reducers and counters etc) after > completion of execution. Make sure the queue should be default queue name. > 2. Generate input data based on cluster size and create the synthetic jobs by > using the 10 min folded MR trace and > submit the jobs with below arguments. > GRIDMIX_JOB_TYPE = SleepJob > GRIDMIX_USER_RESOLVER = SubmitterUserResolver > GRIDMIX_MIN_FILE = 200 MB > GRIDMIX_SUBMISSION_POLICY = STRESS > GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false > SLEEPJOB_MAPTASK_ONLY = true > GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec > Input Size = 250 MB * No. of nodes in cluster. > TRACE_FILE = 7 min folded trac
[jira] Updated: (MAPREDUCE-2139) Gridmix test for submitting jobs with different traces and runtime options.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-2139: - Attachment: MAPREDUCE-2139.patch Initial patch. > Gridmix test for submitting jobs with different traces and runtime options. > --- > > Key: MAPREDUCE-2139 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2139 > Project: Hadoop Map/Reduce > Issue Type: Task > Components: test >Reporter: Vinay Kumar Thota >Assignee: Vinay Kumar Thota > Attachments: MAPREDUCE-2139.patch > > > 1.Generate input data based on cluster size and create the synthetic jobs by > using the 7 min folded MR trace and submit > the jobs with below arguments. > GRIDMIX_JOB_TYPE = SleepJob > GRIDMIX_USER_RESOLVER = SubmitterUserResolver > GRIDMIX_MIN_FILE = 200 MB > GRIDMIX_SUBMISSION_POLICY = STRESS > GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false > Input Size = 400 MB * No. of nodes in cluster. > TRACE_FILE = 7 min folded trace. > Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, > maps, reducers and counters etc) after > completion of execution. Make sure the queue should be default queue name. > 2. Generate input data based on cluster size and create the synthetic jobs by > using the 10 min folded MR trace and > submit the jobs with below arguments. > GRIDMIX_JOB_TYPE = SleepJob > GRIDMIX_USER_RESOLVER = SubmitterUserResolver > GRIDMIX_MIN_FILE = 200 MB > GRIDMIX_SUBMISSION_POLICY = STRESS > GRIDMIX_JOB_SUBMISSION_QUEUE_IN_TRACE = false > SLEEPJOB_MAPTASK_ONLY = true > GRIDMIX_SLEEP_MAX_MAP_TIME = 10 sec > Input Size = 250 MB * No. of nodes in cluster. > TRACE_FILE = 7 min folded trace. > Verify each job status, summary(QueueName, UserName, StatTime, FinishTime, > maps and counters etc) after completion of > execution. Make sure the reducers should be zero. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
