See <https://builds.apache.org/job/Tajo-master-CODEGEN-build/145/changes>
Changes: [jhkim] Fix the broken unit test of TAJO-1242 ------------------------------------------ [...truncated 1144 lines...] [INFO] Compiling 17 source files to <https://builds.apache.org/job/Tajo-master-CODEGEN-build/ws/tajo-storage/tajo-storage-hdfs/target/test-classes> [INFO] [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ tajo-storage-hdfs --- [INFO] Surefire report directory: <https://builds.apache.org/job/Tajo-master-CODEGEN-build/ws/tajo-storage/tajo-storage-hdfs/target/surefire-reports> ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.tajo.storage.TestLineReader log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.605 sec - in org.apache.tajo.storage.TestLineReader Running org.apache.tajo.storage.TestCompressionStorages Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.726 sec - in org.apache.tajo.storage.TestCompressionStorages Running org.apache.tajo.storage.index.TestSingleCSVFileBSTIndex Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.116 sec - in org.apache.tajo.storage.index.TestSingleCSVFileBSTIndex Running org.apache.tajo.storage.index.TestBSTIndex Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.249 sec - in org.apache.tajo.storage.index.TestBSTIndex Running org.apache.tajo.storage.parquet.TestSchemaConverter Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec - in org.apache.tajo.storage.parquet.TestSchemaConverter Running org.apache.tajo.storage.parquet.TestReadWrite Dec 12, 2014 8:19:11 AM parquet.Log info INFO: Flushing mem store to file. allocated memory: 48,824,426 SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 34B for [myboolean] BOOLEAN: 1 values, 7B raw, 7B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 43B for [mybit] INT32: 1 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 38B for [mychar] BINARY: 1 values, 11B raw, 11B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 43B for [myint2] INT32: 1 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 43B for [myint4] INT32: 1 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 55B for [myint8] INT64: 1 values, 14B raw, 14B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 43B for [myfloat4] FLOAT: 1 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 55B for [myfloat8] DOUBLE: 1 values, 14B raw, 14B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 50B for [mytext] BINARY: 1 values, 15B raw, 15B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: written 50B for [myblob] BINARY: 1 values, 15B raw, 15B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:11 AM parquet.Log info INFO: RecordReader initialized will read a total of 1 records. Dec 12, 2014 8:19:11 AM parquet.Log info INFO: at row 0. reading next block Dec 12, 2014 8:19:11 AM parquet.Log info INFO: block read in memory in 7 ms. row count = 1 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.464 sec - in org.apache.tajo.storage.parquet.TestReadWrite Running org.apache.tajo.storage.json.TestJsonSerDe Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec - in org.apache.tajo.storage.json.TestJsonSerDe Running org.apache.tajo.storage.avro.TestAvroUtil Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.249 sec - in org.apache.tajo.storage.avro.TestAvroUtil Running org.apache.tajo.storage.TestDelimitedTextFile java.io.IOException: org.apache.tajo.storage.text.TextLineParsingError: Unexpected End Of File position 160: null, Error line: {"col1": "true", "col2": "hyunsik", "col3": 17, "col4": 59, "col5": 23, "col6": 77.9, "col7": 271.9, "col8": "hyunsik", "col9": "hyunsik", "col10": "192.168.0.1" Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.149 sec <<< FAILURE! - in org.apache.tajo.storage.TestDelimitedTextFile testIgnoreTruncatedValueErrorTolerance(org.apache.tajo.storage.TestDelimitedTextFile) Time elapsed: 0.026 sec <<< ERROR! java.io.FileNotFoundException: File <https://builds.apache.org/job/Tajo-master-CODEGEN-build/ws/tajo-storage/tajo-storage-hdfs/target/test-classes/dataset/TestDelimitedTextFile/testErrorTolerance3.json> does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:524) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:737) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:514) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:397) at org.apache.tajo.storage.TestDelimitedTextFile.getFileFragment(TestDelimitedTextFile.java:96) at org.apache.tajo.storage.TestDelimitedTextFile.testIgnoreTruncatedValueErrorTolerance(TestDelimitedTextFile.java:169) Running org.apache.tajo.storage.TestFileStorageManager Formatting using clusterid: testClusterID Formatting using clusterid: testClusterID Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.65 sec - in org.apache.tajo.storage.TestFileStorageManager Running org.apache.tajo.storage.TestMergeScanner Dec 12, 2014 8:19:17 AM parquet.Log info INFO: Flushing mem store to file. allocated memory: 36,271,037 Dec 12, 2014 8:19:17 AM parquet.Log info INFO: written 40,047B for [id] INT32: 10,000 values, 40,008B raw, 40,008B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:17 AM parquet.Log info INFO: written 53B for [file] BINARY: 10,000 values, 12B raw, 12B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 11B raw, 1B comp} Dec 12, 2014 8:19:17 AM parquet.Log info INFO: written 51B for [name] BINARY: 10,000 values, 12B raw, 12B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 10B raw, 1B comp} Dec 12, 2014 8:19:17 AM parquet.Log info INFO: written 55B for [age] INT64: 10,000 values, 12B raw, 12B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 8B raw, 1B comp} Dec 12, 2014 8:19:17 AM parquet.Log info INFO: Flushing mem store to file. allocated memory: 36,271,037 Dec 12, 2014 8:19:17 AM parquet.Log info INFO: written 40,047B for [id] INT32: 10,000 values, 40,008B raw, 40,008B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:17 AM parquet.Log info INFO: written 53B for [file] BINARY: 10,000 values, 12B raw, 12B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 11B raw, 1B comp} Dec 12, 2014 8:19:17 AM parquet.Log info INFO: written 51B for [name] BINARY: 10,000 values, 12B raw, 12B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 10B raw, 1B comp} Dec 12, 2014 8:19:17 AM parquet.Log info INFO: written 55B for [age] INT64: 10,000 values, 12B raw, 12B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 8B raw, 1B comp} Dec 12, 2014 8:19:17 AM parquet.Log info INFO: RecordReader initialized will read a total of 10000 records. Dec 12, 2014 8:19:17 AM parquet.Log info INFO: at row 0. reading next block Dec 12, 2014 8:19:17 AM parquet.Log info INFO: block read in memory in 0 ms. row count = 10000 Dec 12, 2014 8:19:17 AM parquet.Log info INFO: RecordReader initialized will read a total of 10000 records. Dec 12, 2014 8:19:17 AM parquet.Log info INFO: at row 0. reading next block Dec 12, 2014 8:19:17 AM parquet.Log info INFO: block read in memory in 0 ms. row count = 10000 Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.127 sec - in org.apache.tajo.storage.TestMergeScanner Running org.apache.tajo.storage.TestSplitProcessor Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in org.apache.tajo.storage.TestSplitProcessor Running org.apache.tajo.storage.TestFileSystems Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in org.apache.tajo.storage.TestFileSystems Running org.apache.tajo.storage.TestStorages Dec 12, 2014 8:19:21 AM parquet.Log info INFO: Flushing mem store to file. allocated memory: 51,131,325 Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 34B for [col1] BOOLEAN: 1 values, 7B raw, 7B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 56B for [col2] BINARY: 1 values, 17B raw, 17B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 43B for [col3] INT32: 1 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 43B for [col4] INT32: 1 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 55B for [col5] INT64: 1 values, 14B raw, 14B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 43B for [col6] FLOAT: 1 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 55B for [col7] DOUBLE: 1 values, 14B raw, 14B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 56B for [col8] BINARY: 1 values, 17B raw, 17B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 56B for [col9] BINARY: 1 values, 17B raw, 17B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 47B for [col10] BINARY: 1 values, 14B raw, 14B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 62B for [col12] BINARY: 1 values, 19B raw, 19B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: RecordReader initialized will read a total of 1 records. Dec 12, 2014 8:19:21 AM parquet.Log info INFO: at row 0. reading next block Dec 12, 2014 8:19:21 AM parquet.Log info INFO: block read in memory in 1 ms. row count = 1 Dec 12, 2014 8:19:21 AM parquet.Log info INFO: Flushing mem store to file. allocated memory: 34,044,142 Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 40,047B for [id] INT32: 10,000 values, 40,008B raw, 40,008B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 80,055B for [age] INT64: 10,000 values, 80,008B raw, 80,008B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 40,047B for [score] FLOAT: 10,000 values, 40,008B raw, 40,008B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: RecordReader initialized will read a total of 10000 records. Dec 12, 2014 8:19:21 AM parquet.Log info INFO: at row 0. reading next block Dec 12, 2014 8:19:21 AM parquet.Log info INFO: block read in memory in 1 ms. row count = 10000 Dec 12, 2014 8:19:21 AM parquet.Log info INFO: Flushing mem store to file. allocated memory: 51,131,725 Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 36B for [col1] BOOLEAN: 12 values, 9B raw, 9B comp, 1 pages, encodings: [PLAIN, RLE, BIT_PACKED] Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 48B for [col2] BINARY: 12 values, 9B raw, 9B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 11B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 42B for [col3] INT32: 12 values, 9B raw, 9B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 4B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 42B for [col4] INT32: 12 values, 9B raw, 9B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 4B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 50B for [col5] INT64: 12 values, 9B raw, 9B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 8B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 42B for [col6] FLOAT: 12 values, 9B raw, 9B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 4B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 50B for [col7] DOUBLE: 12 values, 9B raw, 9B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 8B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 48B for [col8] BINARY: 12 values, 9B raw, 9B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 11B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 49B for [col9] BINARY: 12 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 11B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 43B for [col10] BINARY: 12 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 8B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: written 53B for [col12] BINARY: 12 values, 10B raw, 10B comp, 1 pages, encodings: [PLAIN_DICTIONARY, RLE, BIT_PACKED], dic { 1 entries, 13B raw, 1B comp} Dec 12, 2014 8:19:21 AM parquet.Log info INFO: RecordReader initialized will read a total of 12 records. Dec 12, 2014 8:19:21 AM parquet.Log info INFO: at row 0. reading next block Dec 12, 2014 8:19:21 AM parquet.Log info INFO: block read in memory in 2 ms. row count = 12 Tests run: 88, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.499 sec - in org.apache.tajo.storage.TestStorages Dec 12, 2014 8:19:11 AM INFO: parquet.hadoop.ParquetFileReader: reading another 1 footers Dec 12, 2014 8:19:17 AM INFO: parquet.hadoop.ParquetFileReader: reading another 1 footers Dec 12, 2014 8:19:17 AM INFO: parquet.hadoop.ParquetFileReader: reading another 1 footers Dec 12, 2014 8:19:21 AM INFO: parquet.hadoop.ParquetFileReader: reading another 1 footers Dec 12, 2014 8:19:21 AM INFO: parquet.hadoop.ParquetFileReader: reading another 1 footers Dec 12, 2014 8:19:21 AM INFO: parquet.hadoop.ParquetFileReader: reading another 1 footers Results : Tests in error: TestDelimitedTextFile.testIgnoreTruncatedValueErrorTolerance:169->getFileFragment:96 ยป FileNotFound Tests run: 153, Failures: 0, Errors: 1, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Tajo Main ......................................... SUCCESS [ 1.660 s] [INFO] Tajo Project POM .................................. SUCCESS [ 1.157 s] [INFO] Tajo Maven Plugins ................................ SUCCESS [ 2.828 s] [INFO] Tajo Common ....................................... SUCCESS [ 24.533 s] [INFO] Tajo Algebra ...................................... SUCCESS [ 1.309 s] [INFO] Tajo Catalog Common ............................... SUCCESS [ 5.643 s] [INFO] Tajo Plan ......................................... SUCCESS [ 3.478 s] [INFO] Tajo Rpc .......................................... SUCCESS [ 26.489 s] [INFO] Tajo Catalog Client ............................... SUCCESS [ 0.972 s] [INFO] Tajo Catalog Server ............................... SUCCESS [ 10.249 s] [INFO] Tajo Storage Common ............................... SUCCESS [ 10.440 s] [INFO] Tajo HDFS Storage ................................. FAILURE [ 38.752 s] [INFO] Tajo HBase Storage ................................ SKIPPED [INFO] Tajo PullServer ................................... SKIPPED [INFO] Tajo Client ....................................... SKIPPED [INFO] Tajo JDBC Driver .................................. SKIPPED [INFO] ASM (thirdparty) .................................. SKIPPED [INFO] Tajo Core ......................................... SKIPPED [INFO] Tajo Catalog Drivers .............................. SKIPPED [INFO] Tajo Catalog ...................................... SKIPPED [INFO] Tajo Storage ...................................... SKIPPED [INFO] Tajo Distribution ................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:08 min [INFO] Finished at: 2014-12-12T08:19:24+00:00 [INFO] Final Memory: 64M/1202M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project tajo-storage-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Tajo-master-CODEGEN-build/ws/tajo-storage/tajo-storage-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :tajo-storage-hdfs Build step 'Execute shell' marked build as failure Updating TAJO-1242
