[jira] [Commented] (HIVE-4558) mapreduce_stack_trace_hadoop20 in TestNegativeMinimrCliDriver fails on Windows
[ https://issues.apache.org/jira/browse/HIVE-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882100#comment-13882100 ] Hive QA commented on HIVE-4558: --- {color:red}Overall{color}: -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12583228/HIVE-4558.1.patch Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1029/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1029/console Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n '' ]] + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + cd /data/hive-ptest/working/ + tee /data/hive-ptest/logs/PreCommit-HIVE-Build-1029/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ svn = \s\v\n ]] + [[ -n '' ]] + [[ -d apache-svn-trunk-source ]] + [[ ! -d apache-svn-trunk-source/.svn ]] + [[ ! -d apache-svn-trunk-source ]] + cd apache-svn-trunk-source + svn revert -R . Reverted 'ql/src/java/org/apache/hadoop/hive/ql/io/orc/RecordReaderImpl.java' ++ awk '{print $2}' ++ egrep -v '^X|^Performing status on external' ++ svn status --no-ignore + rm -rf target datanucleus.log ant/target shims/target shims/0.20/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/common-secure/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit/target itests/custom-serde/target itests/util/target hcatalog/target hcatalog/storage-handlers/hbase/target hcatalog/server-extensions/target hcatalog/core/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hcatalog/hcatalog-pig-adapter/target hwi/target common/target common/src/gen service/target contrib/target serde/target beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target ql/src/test/results/clientpositive/orc_vectorization_ppd.q.out ql/src/test/queries/clientpositive/orc_vectorization_ppd.q + svn update Fetching external item into 'hcatalog/src/test/e2e/harness' External at revision 1561419. At revision 1561419. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' {noformat} This message is automatically generated. ATTACHMENT ID: 12583228 > mapreduce_stack_trace_hadoop20 in TestNegativeMinimrCliDriver fails on Windows > -- > > Key: HIVE-4558 > URL: https://issues.apache.org/jira/browse/HIVE-4558 > Project: Hive > Issue Type: Bug > Components: Tests >Affects Versions: 0.11.0 > Environment: Windows >Reporter: Xi Fang >Assignee: Xi Fang > Attachments: HIVE-4558.1.patch > > > testNegativeCliDriver_mapreduce_stack_trace_hadoop20 fails because group > information is printed out on Windows. Here is the example of > mapreduce_stack_trace_hadoop20.q.out.orig: > -- > PREHOOK: query: FROM src SELECT TRANSFORM(key, value) USING > 'script_does_not_exist' AS (key, value) > PREHOOK: type: QUERY > PREHOOK: Input: default@src > PREHOOK: Output: > hdfs://127.0.0.1:25477/code/HWX/hive-monarch/build/ql/scratchdir/hive_2013-05-14_15-21-00_075_593034964465269090/-mr-1 > Ended Job = job_20130514152027587_0001 with errors > FATAL ExecMapper: org.apache.hadoop.hive.ql.metadata.HiveException: Hive > Runtime Error while processing row {"key":"238","value":"val_238"} > groups found for user Administrators > Hive Runtime Error while processing row {"key":"238","value":"val_238"} > -- > However, it is supposed to look like: > -- > PREHOOK: query: FROM src SELECT TRANSFORM(key, value) USING > 'script_does_not_exist' AS (key, value) > PREHOOK: type: QUERY > PREHOOK: Input: default@src > \ A masked pattern was here > FATAL ExecMapper: org.a
[jira] [Commented] (HIVE-4558) mapreduce_stack_trace_hadoop20 in TestNegativeMinimrCliDriver fails on Windows
[ https://issues.apache.org/jira/browse/HIVE-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657631#comment-13657631 ] Xi Fang commented on HIVE-4558: --- The testcase on Windows prints out one new line and one sentence "groups found for user Administrators". The current method used in QTestUtil.java (i.e. maskPatterns(String[] patterns, String fname)) can't make an appropriate mask pattern for this case. I added another method called maskPatternsForWindows(), specifically for Windows. We can specify a pattern, which may include one line or multiple lines. For example, in this case, the pattern is composed of one empty line and one sentence "groups found for user Administrators". Once such a pattern is found in the *.q.out.orig file, we directly skip this part. This ensures that "diff" will skip checking the content in output that matches this pattern. > mapreduce_stack_trace_hadoop20 in TestNegativeMinimrCliDriver fails on Windows > -- > > Key: HIVE-4558 > URL: https://issues.apache.org/jira/browse/HIVE-4558 > Project: Hive > Issue Type: Bug > Components: Tests >Affects Versions: 0.11.0 > Environment: Windows >Reporter: Xi Fang > Attachments: HIVE-4558.1.patch > > > testNegativeCliDriver_mapreduce_stack_trace_hadoop20 fails because group > information is printed out on Windows. Here is the example of > mapreduce_stack_trace_hadoop20.q.out.orig: > -- > PREHOOK: query: FROM src SELECT TRANSFORM(key, value) USING > 'script_does_not_exist' AS (key, value) > PREHOOK: type: QUERY > PREHOOK: Input: default@src > PREHOOK: Output: > hdfs://127.0.0.1:25477/code/HWX/hive-monarch/build/ql/scratchdir/hive_2013-05-14_15-21-00_075_593034964465269090/-mr-1 > Ended Job = job_20130514152027587_0001 with errors > FATAL ExecMapper: org.apache.hadoop.hive.ql.metadata.HiveException: Hive > Runtime Error while processing row {"key":"238","value":"val_238"} > groups found for user Administrators > Hive Runtime Error while processing row {"key":"238","value":"val_238"} > -- > However, it is supposed to look like: > -- > PREHOOK: query: FROM src SELECT TRANSFORM(key, value) USING > 'script_does_not_exist' AS (key, value) > PREHOOK: type: QUERY > PREHOOK: Input: default@src > \ A masked pattern was here > FATAL ExecMapper: org.apache.hadoop.hive.ql.metadata.HiveException: Hive > Runtime Error while processing row {"key":"238","value":"val_238"} > Hive Runtime Error while processing row {"key":"238","value":"val_238"} > -- -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira