See <https://builds.apache.org/job/Crunch-master-integration/org.apache.crunch$crunch/209/changes>
Changes: [matt] CRUNCH-168: Update metadata to reflect graduation. [jwills] CRUNCH-167: Re-write the sorting strategy for tuples to only select the fields that ------------------------------------------ [...truncated 1085 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.144 sec Running org.apache.crunch.lib.SortIT 875485 [Thread-2540] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 875517 [Thread-2540] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 875536 [Thread-2540] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit2550447821255909138/docs.txt)+S0+sort-pre+GBK+ungroup+PTables.keys+SeqFile(/tmp/junit2550447821255909138/tmp-crunch.tmp.dir/crunch-1521205364/p1)" 875536 [Thread-2540] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 882504 [Thread-2558] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 882535 [Thread-2558] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 882555 [Thread-2558] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit5860464405760243065/docs.txt)+S0+sort-pre+GBK+ungroup+PTables.keys+SeqFile(/tmp/junit5860464405760243065/tmp-crunch.tmp.dir/crunch-93589661/p1)" 882555 [Thread-2558] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 889526 [Thread-2576] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 889554 [Thread-2576] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 889572 [Thread-2576] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit8618237437350314556/docs.txt)+S0+S1+GBK+ungroup+PTables.values+SeqFile(/tmp/junit8618237437350314556/tmp-crunch.tmp.dir/crunch-201179673/p1)" 889572 [Thread-2576] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 896545 [Thread-2594] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 896576 [Thread-2594] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 896596 [Thread-2594] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit8812617661625125033/docs.txt)+S0+S1+GBK+ungroup+PTables.values+SeqFile(/tmp/junit8812617661625125033/tmp-crunch.tmp.dir/crunch-580852115/p1)" 896596 [Thread-2594] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 903564 [Thread-2612] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 903595 [Thread-2612] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 903615 [Thread-2612] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit4328344228634114228/docs.txt)+S0+S1+GBK+ungroup+PTables.values+SeqFile(/tmp/junit4328344228634114228/tmp-crunch.tmp.dir/crunch-521469982/p1)" 903615 [Thread-2612] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 910585 [Thread-2630] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 910616 [Thread-2630] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 910635 [Thread-2630] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit159428703432140186/docs.txt)+S0+S1+GBK+ungroup+PTables.values+SeqFile(/tmp/junit159428703432140186/tmp-crunch.tmp.dir/crunch-1170275874/p1)" 910636 [Thread-2630] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 917604 [Thread-2648] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 917636 [Thread-2648] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 917655 [Thread-2648] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit8258815365275907815/docs.txt)+S0+S1+GBK+ungroup+PTables.values+SeqFile(/tmp/junit8258815365275907815/tmp-crunch.tmp.dir/crunch-978172820/p1)" 917656 [Thread-2648] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 924624 [Thread-2666] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 924655 [Thread-2666] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 924675 [Thread-2666] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit129227279756891192/docs.txt)+S0+GBK+ungroup+SeqFile(/tmp/junit129227279756891192/tmp-crunch.tmp.dir/crunch-1466569062/p1)" 924675 [Thread-2666] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 931643 [Thread-2684] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 931675 [Thread-2684] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 931695 [Thread-2684] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit7339069919141749703/docs.txt)+S0+sort-pre+GBK+ungroup+PTables.keys+Avro(/tmp/junit7339069919141749703/tmp-crunch.tmp.dir/crunch-921995074/p1)" 931695 [Thread-2684] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 938660 [Thread-2702] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 938691 [Thread-2702] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 938711 [Thread-2702] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit4917750527544971561/docs.txt)+S0+sort-pre+GBK+ungroup+PTables.keys+Avro(/tmp/junit4917750527544971561/tmp-crunch.tmp.dir/crunch-1546580927/p1)" 938712 [Thread-2702] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 945680 [Thread-2720] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 945712 [Thread-2720] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 945732 [Thread-2720] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit5412040992964613568/docs.txt)+S0+S1+GBK+ungroup+PTables.values+Avro(/tmp/junit5412040992964613568/tmp-crunch.tmp.dir/crunch-360975024/p1)" 945732 [Thread-2720] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 952722 [Thread-2738] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 952754 [Thread-2738] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 952774 [Thread-2738] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit779119214736774079/docs.txt)+S0+S1+GBK+ungroup+PTables.values+Avro(/tmp/junit779119214736774079/tmp-crunch.tmp.dir/crunch-72490318/p1)" 952774 [Thread-2738] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 959744 [Thread-2756] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 959777 [Thread-2756] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 959797 [Thread-2756] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit5233745464188363909/docs.txt)+S0+S1+GBK+ungroup+PTables.values+Avro(/tmp/junit5233745464188363909/tmp-crunch.tmp.dir/crunch-189034739/p1)" 959797 [Thread-2756] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 966764 [Thread-2774] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 966795 [Thread-2774] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 966815 [Thread-2774] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit4033731163587065929/docs.txt)+S0+S1+GBK+ungroup+PTables.values+Avro(/tmp/junit4033731163587065929/tmp-crunch.tmp.dir/crunch-2043840849/p1)" 966815 [Thread-2774] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 973783 [Thread-2792] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 973814 [Thread-2792] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 973835 [Thread-2792] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit1639674061068255379/docs.txt)+S0+S1+GBK+ungroup+PTables.values+Avro(/tmp/junit1639674061068255379/tmp-crunch.tmp.dir/crunch-932183378/p1)" 973835 [Thread-2792] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 980803 [Thread-2810] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 980835 [Thread-2810] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 980855 [Thread-2810] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit340486166899930413/set2.txt)+S0+sort-pre+GBK+ungroup+PTables.keys+Avro(/tmp/junit340486166899930413/tmp-crunch.tmp.dir/crunch-247310283/p1)" 980855 [Thread-2810] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 987822 [Thread-2828] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 987854 [Thread-2828] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 987875 [Thread-2828] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit3779872199889674318/set2.txt)+S0+GBK+ungroup+Avro(/tmp/junit3779872199889674318/tmp-crunch.tmp.dir/crunch-1613636335/p1)" 987875 [Thread-2828] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 994840 [Thread-2846] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 994872 [Thread-2846] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 994893 [Thread-2846] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SortIT: Text(/tmp/junit132563817916792199/docs.txt)+S0+GBK+ungroup+Avro(/tmp/junit132563817916792199/tmp-crunch.tmp.dir/crunch-926416157/p1)" 994893 [Thread-2846] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 126.376 sec Running org.apache.crunch.lib.SpecificAvroGroupByIT 1001858 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1001861 [Thread-2864] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1001893 [Thread-2864] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1001914 [Thread-2864] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SpecificAvroGroupByIT: Avro(/tmp/avrotest3057420340272065292.avro)+S0+GBK+ungroup+Avro(/tmp/junit6758806234372043824/tmp-crunch.tmp.dir/crunch-1659449885/p1)" 1001914 [Thread-2864] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.021 sec Running org.apache.crunch.lib.SecondarySortIT 1008882 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1008887 [Thread-2882] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1008918 [Thread-2882] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1008938 [Thread-2882] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.lib.SecondarySortIT: Text(/tmp/junit5071463722039964730/secondary_sort_input.txt)+S0+SecondarySort.format+GBK+SecondarySort.apply+Avro(/tmp/junit5071463722039964730/tmp-crunch.tmp.dir/crunch-1654555508/p1)" 1008938 [Thread-2882] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.025 sec Running org.apache.crunch.MultipleOutputIT 1015896 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit7617820131176288443/even 1015896 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit7617820131176288443/odd 1015905 [Thread-2900] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1015922 [Thread-2900] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1015940 [Thread-2900] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MultipleOutputIT: Text(/tmp/junit7617820131176288443/letters.txt)+[[odd+asText+Text(/tmp/junit7617820131176288443/odd)]/[even+asText+Text(/tmp/junit7617820131176288443/even)]]" 1015940 [Thread-2900] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1019912 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit6241860752371677215/even 1019912 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit6241860752371677215/odd 1019921 [Thread-2910] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1019939 [Thread-2910] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1019958 [Thread-2910] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MultipleOutputIT: Text(/tmp/junit6241860752371677215/letters.txt)+[[odd+asText+Text(/tmp/junit6241860752371677215/odd)]/[even+asText+Text(/tmp/junit6241860752371677215/even)]]" 1019959 [Thread-2910] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1023928 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit332692924604320523/even 1023928 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit332692924604320523/odd 1023938 [Thread-2920] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1023954 [Thread-2920] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1023971 [Thread-2920] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MultipleOutputIT: Text(/tmp/junit332692924604320523/letters.txt)+[[odd+asText+Text(/tmp/junit332692924604320523/odd)]/[even+asText+Text(/tmp/junit332692924604320523/even)]]" 1023971 [Thread-2920] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1027945 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit803973187011337287/stringsA 1027945 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit803973187011337287/stringsB 1027957 [Thread-2930] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1027973 [Thread-2930] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1027990 [Thread-2930] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MultipleOutputIT: Text(/tmp/junit803973187011337287/set2.txt)+S0+[[S1+S2+asText+Text(/tmp/junit803973187011337287/stringsA)]/[S3+S4+asText+Text(/tmp/junit803973187011337287/stringsB)]]" 1027990 [Thread-2930] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.067 sec Running org.apache.crunch.TfIdfIT 1031965 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit7607645465804142145/termfreq 1031966 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit7607645465804142145/output1 1031966 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit7607645465804142145/output2 1031976 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1031981 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1031989 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1031992 [Thread-2940] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1032031 [Thread-2940] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1032051 [Thread-2940] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.TfIdfIT: Text(/tmp/junit7607645465804142145/docs.txt)+term document frequency+Aggregate.count+GBK+combine+[[little n (# of docs contain word)+Aggregate.count+SeqFile(/tmp/junit7607645465804142145/tmp-crunch.tmp.dir/crunch-277855240/p1)]/[transform wordDocumentPairCount+joinTagRight+SeqFile(/tmp/junit7607645465804142145/tmp-crunch.tmp.dir/crunch-277855240/p2)]/[SeqFile(/tmp/junit7607645465804142145/termfreq)]]" 1032051 [Thread-2940] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1038557 [Thread-2940] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1038604 [Thread-2940] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1038626 [Thread-2940] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.TfIdfIT: SeqFile(/tmp/junit7607645465804142145/tmp-crunch.tmp.dir/crunch-277855240/p1)+GBK+combine+joinTagLeft+SeqFile(/tmp/junit7607645465804142145/tmp-crunch.tmp.dir/crunch-277855240/p3)" 1038626 [Thread-2940] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1045130 [Thread-2940] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1045161 [Thread-2940] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1045185 [Thread-2940] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.TfIdfIT: [[SeqFile(/tmp/junit7607645465804142145/tmp-crunch.tmp.dir/crunch-277855240/p3)]/[SeqFile(/tmp/junit7607645465804142145/tmp-crunch.tmp.dir/crunch-277855240/p2)]]+GBK+innerJoinGBK+calculate tfidf+[[asText+Text(/tmp/junit7607645465804142145/output1)]/[S0+asText+Text(/tmp/junit7607645465804142145/output2)]]" 1045185 [Thread-2940] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1055004 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit1132018197815315201/termfreq 1055005 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit1132018197815315201/output1 1055013 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1055017 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1055020 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1055024 [Thread-3000] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1055056 [Thread-3000] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1055076 [Thread-3000] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.TfIdfIT: Text(/tmp/junit1132018197815315201/docs.txt)+term document frequency+Aggregate.count+GBK+combine+[[transform wordDocumentPairCount+joinTagRight+SeqFile(/tmp/junit1132018197815315201/tmp-crunch.tmp.dir/crunch-550966577/p1)]/[little n (# of docs contain word)+Aggregate.count+SeqFile(/tmp/junit1132018197815315201/tmp-crunch.tmp.dir/crunch-550966577/p2)]/[SeqFile(/tmp/junit1132018197815315201/termfreq)]]" 1055076 [Thread-3000] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1061582 [Thread-3000] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1061629 [Thread-3000] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1061652 [Thread-3000] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.TfIdfIT: SeqFile(/tmp/junit1132018197815315201/tmp-crunch.tmp.dir/crunch-550966577/p2)+GBK+combine+joinTagLeft+SeqFile(/tmp/junit1132018197815315201/tmp-crunch.tmp.dir/crunch-550966577/p3)" 1061652 [Thread-3000] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1068156 [Thread-3000] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1068187 [Thread-3000] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1068208 [Thread-3000] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.TfIdfIT: [[SeqFile(/tmp/junit1132018197815315201/tmp-crunch.tmp.dir/crunch-550966577/p3)]/[SeqFile(/tmp/junit1132018197815315201/tmp-crunch.tmp.dir/crunch-550966577/p1)]]+GBK+innerJoinGBK+calculate tfidf+asText+Text(/tmp/junit1132018197815315201/output1)" 1068208 [Thread-3000] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1078024 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit1132018197815315201/output2 1078035 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1078038 [Thread-3060] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1078071 [Thread-3060] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1078091 [Thread-3060] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.TfIdfIT: [[SeqFile(/tmp/junit1132018197815315201/tmp-crunch.tmp.dir/crunch-550966577/p3)]/[SeqFile(/tmp/junit1132018197815315201/tmp-crunch.tmp.dir/crunch-550966577/p1)]]+GBK+innerJoinGBK+calculate tfidf+S0+asText+Text(/tmp/junit1132018197815315201/output2)" 1078091 [Thread-3060] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.06 sec Running org.apache.crunch.TextPairIT 1088060 [Thread-3079] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1088077 [Thread-3079] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1088095 [Thread-3079] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.TextPairIT: Text(/tmp/junit5003202683995798612/shakes.txt)+my word duplicator+SeqFile(/tmp/junit5003202683995798612/tmp-crunch.tmp.dir/crunch-2053008671/p1)" 1088095 [Thread-3079] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.015 sec Running org.apache.crunch.WordCountIT 1092070 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit2334253776246582990/output 1092077 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1092080 [Thread-3089] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1092127 [Thread-3089] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1092149 [Thread-3089] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: Text(/tmp/junit2334253776246582990/shakes.txt)+S0+Aggregate.count+GBK+combine+asText+Text(/tmp/junit2334253776246582990/output)" 1092149 [Thread-3089] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1099096 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit7473194979892469649/output 1099103 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1099106 [Thread-3114] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1099152 [Thread-3114] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1099175 [Thread-3114] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: Text(/tmp/junit7473194979892469649/shakes.txt)+S0+Aggregate.count+GBK+combine+asText+Text(/tmp/junit7473194979892469649/output)" 1099176 [Thread-3114] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1106122 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit5168476784735700466/output 1106122 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit5168476784735700466/substr 1106129 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1106133 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1106136 [Thread-3139] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1106184 [Thread-3139] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1106207 [Thread-3139] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: Text(/tmp/junit5168476784735700466/shakes.txt)+S0+Aggregate.count+GBK+combine+[[S1+SeqFile(/tmp/junit5168476784735700466/tmp-crunch.tmp.dir/crunch-643349725/p1)]/[asText+Text(/tmp/junit5168476784735700466/output)]]" 1106207 [Thread-3139] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1112712 [Thread-3139] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1112759 [Thread-3139] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1112782 [Thread-3139] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: SeqFile(/tmp/junit5168476784735700466/tmp-crunch.tmp.dir/crunch-643349725/p1)+GBK+combine+asText+Text(/tmp/junit5168476784735700466/substr)" 1112782 [Thread-3139] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1120149 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit5890696692121744479/output 1120150 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit5890696692121744479/substr 1120157 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1120161 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1120164 [Thread-3188] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1120211 [Thread-3188] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1120234 [Thread-3188] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: Text(/tmp/junit5890696692121744479/shakes.txt)+S0+Aggregate.count+GBK+combine+[[Text(/tmp/junit5890696692121744479/output)]/[S1+SeqFile(/tmp/junit5890696692121744479/tmp-crunch.tmp.dir/crunch-1924824514/p1)]]" 1120234 [Thread-3188] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1126739 [Thread-3188] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1126786 [Thread-3188] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1126807 [Thread-3188] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: SeqFile(/tmp/junit5890696692121744479/tmp-crunch.tmp.dir/crunch-1924824514/p1)+GBK+combine+asText+Text(/tmp/junit5890696692121744479/substr)" 1126807 [Thread-3188] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1134176 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit6293798427878378991/output 1134176 [main] INFO org.apache.crunch.io.impl.FileTargetImpl - Will write output files to new path: /tmp/junit6293798427878378991/substr 1134185 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1134188 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1134192 [Thread-3237] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1134238 [Thread-3237] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1134262 [Thread-3237] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: Text(/tmp/junit6293798427878378991/shakes.txt)+S0+Aggregate.count+GBK+combine+[[S1+Avro(/tmp/junit6293798427878378991/tmp-crunch.tmp.dir/crunch-1751503762/p1)]/[asText+Text(/tmp/junit6293798427878378991/output)]]" 1134262 [Thread-3237] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1140766 [Thread-3237] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1140813 [Thread-3237] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1140834 [Thread-3237] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: Avro(/tmp/junit6293798427878378991/tmp-crunch.tmp.dir/crunch-1751503762/p1)+GBK+combine+asText+Text(/tmp/junit6293798427878378991/substr)" 1140835 [Thread-3237] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1148213 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1148220 [Thread-3286] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1148267 [Thread-3286] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1148290 [Thread-3286] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: Text(/tmp/junit1069475858620543464/shakes.txt)+S0+Aggregate.count+GBK+combine+top5map+SeqFile(/tmp/junit1069475858620543464/tmp-crunch.tmp.dir/crunch-2103657042/p2)" 1148290 [Thread-3286] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1154794 [Thread-3286] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1154842 [Thread-3286] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1154863 [Thread-3286] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: SeqFile(/tmp/junit1069475858620543464/tmp-crunch.tmp.dir/crunch-2103657042/p2)+GBK+combine+top5reduce+SeqFile(/tmp/junit1069475858620543464/tmp-crunch.tmp.dir/crunch-2103657042/p1)" 1154863 [Thread-3286] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1162240 [main] INFO org.apache.crunch.impl.mr.collect.PGroupedTableImpl - Setting num reduce tasks to 1 1162247 [Thread-3335] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1162294 [Thread-3335] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1162318 [Thread-3335] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: Text(/tmp/junit3291793010846067338/shakes.txt)+S0+Aggregate.count+GBK+combine+top5map+Avro(/tmp/junit3291793010846067338/tmp-crunch.tmp.dir/crunch-622570904/p2)" 1162318 [Thread-3335] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1168822 [Thread-3335] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1168868 [Thread-3335] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1168890 [Thread-3335] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.WordCountIT: Avro(/tmp/junit3291793010846067338/tmp-crunch.tmp.dir/crunch-622570904/p2)+GBK+combine+top5reduce+Avro(/tmp/junit3291793010846067338/tmp-crunch.tmp.dir/crunch-622570904/p1)" 1168890 [Thread-3335] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.19 sec Running org.apache.crunch.CollectionPObjectIT Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec Running org.apache.crunch.MapPObjectIT 1176299 [Thread-3386] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1176315 [Thread-3386] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1176333 [Thread-3386] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MaterializeToMapIT: Text(/tmp/junit2990074259515840372/set1.txt)+S0+SeqFile(/tmp/junit2990074259515840372/tmp-crunch.tmp.dir/crunch-401905911/p1)" 1176333 [Thread-3386] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ 1180313 [Thread-3396] WARN org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 1180330 [Thread-3396] WARN org.apache.hadoop.mapred.JobClient - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 1180346 [Thread-3396] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Running job "org.apache.crunch.MaterializeToMapIT: Text(/tmp/junit8117119565455320745/set1.txt)+S0+SeqFile(/tmp/junit8117119565455320745/tmp-crunch.tmp.dir/crunch-617898136/p1)" 1180346 [Thread-3396] INFO org.apache.crunch.impl.mr.exec.CrunchJob - Job status available at: http://localhost:8080/ Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.03 sec Results : Tests run: 157, Failures: 0, Errors: 0, Skipped: 1
