[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[ https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507960#comment-14507960 ] Jason Dere commented on HIVE-8307: -- I had created HIVE-10428 and added a patch, but I see that this also relates to columns.comments. So this fix will basically revert the changes from HIVE-6681? Can you re-submit the patch so we can see that the patch still works on trunk? > null character in columns.comments schema property breaks jobconf.xml > - > > Key: HIVE-8307 > URL: https://issues.apache.org/jira/browse/HIVE-8307 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.13.0, 0.14.0, 0.13.1 >Reporter: Carl Laird >Assignee: Ashutosh Chauhan > Attachments: HIVE-8307.1.patch, HIVE-8307.2.patch, HIVE-8307.patch > > > It would appear that the fix for > https://issues.apache.org/jira/browse/HIVE-6681 is causing the null character > to show up in job config xml files: > I get the following when trying to insert into an elasticsearch backed table: > [Fatal Error] :336:51: Character reference " > 14/06/17 14:40:11 FATAL conf.Configuration: error parsing conf file: > org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character > reference " > Exception in thread "main" java.lang.RuntimeException: > org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character > reference " > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1263) > at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1129) > at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1063) > at org.apache.hadoop.conf.Configuration.get(Configuration.java:416) > at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:604) > at org.apache.hadoop.hive.conf.HiveConf.getBoolVar(HiveConf.java:1273) > at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:667) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > Caused by: org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; > Character reference " > at > com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:251) > at > com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:300) > at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121) > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1181) > ... 11 more > Execution failed with exit status: 1 > Line 336 of jobconf.xml: > columns.comments > See > https://groups.google.com/forum/#!msg/mongodb-user/lKbha0SzMP8/jvE8ZrJom4AJ > for more discussion. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[ https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532123#comment-14532123 ] Sivaramakrishnan Narayanan commented on HIVE-8307: -- We're running into this problem with other StorageHandlers - any ETA on the patch? > null character in columns.comments schema property breaks jobconf.xml > - > > Key: HIVE-8307 > URL: https://issues.apache.org/jira/browse/HIVE-8307 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.13.0, 0.14.0, 0.13.1 >Reporter: Carl Laird >Assignee: Ashutosh Chauhan > Attachments: HIVE-8307.1.patch, HIVE-8307.2.patch, HIVE-8307.patch > > > It would appear that the fix for > https://issues.apache.org/jira/browse/HIVE-6681 is causing the null character > to show up in job config xml files: > I get the following when trying to insert into an elasticsearch backed table: > [Fatal Error] :336:51: Character reference " > 14/06/17 14:40:11 FATAL conf.Configuration: error parsing conf file: > org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character > reference " > Exception in thread "main" java.lang.RuntimeException: > org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character > reference " > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1263) > at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1129) > at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1063) > at org.apache.hadoop.conf.Configuration.get(Configuration.java:416) > at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:604) > at org.apache.hadoop.hive.conf.HiveConf.getBoolVar(HiveConf.java:1273) > at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:667) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > Caused by: org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; > Character reference " > at > com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:251) > at > com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:300) > at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121) > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1181) > ... 11 more > Execution failed with exit status: 1 > Line 336 of jobconf.xml: > columns.comments > See > https://groups.google.com/forum/#!msg/mongodb-user/lKbha0SzMP8/jvE8ZrJom4AJ > for more discussion. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[ https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293244#comment-16293244 ] Hive QA commented on HIVE-8307: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Findbugs executables are not available. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 38s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 55s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 6s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 36s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 22s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 21s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 7s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 8s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 8s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 13s{color} | {color:red} serde: The patch generated 3 new + 31 unchanged - 3 fixed = 34 total (was 34) {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 8s{color} | {color:red} itests/test-serde: The patch generated 2 new + 5 unchanged - 2 fixed = 7 total (was 7) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 24s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 15m 52s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus/dev-support/hive-personality.sh | | git revision | master / f52e8b4 | | Default Java | 1.8.0_111 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-8275/yetus/diff-checkstyle-serde.txt | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-8275/yetus/diff-checkstyle-itests_test-serde.txt | | modules | C: serde standalone-metastore itests/test-serde U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-8275/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > null character in columns.comments schema property breaks jobconf.xml > - > > Key: HIVE-8307 > URL: https://issues.apache.org/jira/browse/HIVE-8307 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.13.0, 0.14.0, 0.13.1 >Reporter: Carl Laird >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-8307.03.patch, HIVE-8307.1.patch, > HIVE-8307.2.patch, HIVE-8307.patch > > > It would appear that the fix for > https://issues.apache.org/jira/browse/HIVE-6681 is causing the null character > to show up in job config xml files: > I get the following when trying to insert into an elasticsearch backed table: > [Fatal Error] :336:51: Character reference " > 14/06/17 14:40:11 FATAL conf.Configuration: error parsing conf file: > org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character > reference " > Exception in thread "main" java.lang.RuntimeException: > org.xml.sax.SAXParse
[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[ https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293327#comment-16293327 ] Hive QA commented on HIVE-8307: --- Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12902162/HIVE-8307.03.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 329 failed/errored test(s), 11528 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestBeeLineDriver.testCliDriver[smb_mapjoin_11] (batchId=246) org.apache.hadoop.hive.cli.TestBeeLineDriver.testCliDriver[smb_mapjoin_12] (batchId=246) org.apache.hadoop.hive.cli.TestBeeLineDriver.testCliDriver[smb_mapjoin_13] (batchId=246) org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_into_dynamic_partitions] (batchId=249) org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_into_table] (batchId=249) org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_directory] (batchId=249) org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_dynamic_partitions] (batchId=249) org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_table] (batchId=249) org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[write_final_output_blobstore] (batchId=249) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[alter1] (batchId=85) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[alter_partition_coltype] (batchId=26) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[analyze_table_null_partition] (batchId=81) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[autoColumnStats_5a] (batchId=53) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[autoColumnStats_8] (batchId=14) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_join25] (batchId=72) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_join_reordering_values] (batchId=6) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_11] (batchId=85) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_12] (batchId=33) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_1] (batchId=45) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_2] (batchId=48) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_3] (batchId=2) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_4] (batchId=62) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_5] (batchId=87) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_7] (batchId=89) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_comments] (batchId=60) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_decimal_old] (batchId=46) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_joins_native] (batchId=87) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_partitioned_native] (batchId=6) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_schema_evolution_native] (batchId=56) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[binary_output_format] (batchId=86) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket1] (batchId=42) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket2] (batchId=50) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket3] (batchId=16) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_1] (batchId=66) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_2] (batchId=57) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_spark1] (batchId=67) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_spark2] (batchId=3) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_spark3] (batchId=44) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_spark4] (batchId=1) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_1] (batchId=32) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_2] (batchId=65) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_3] (batchId=67) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_4] (batchId=41) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_5] (batchId=23) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_6] (batchId=83) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_7] (batchId=38) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_8] (batchId=37) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketmapjoin10] (batchId=51) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketmapjoin11
[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[ https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294492#comment-16294492 ] Hive QA commented on HIVE-8307: --- Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12902582/HIVE-8307.04.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8295/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8295/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8295/ Messages: {noformat} This message was trimmed, see log for full details error: a/ql/src/test/results/clientpositive/pointlookup4.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/ppd_join_filter.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/ppd_vc.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/push_or.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/quotedid_tblproperty.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/rand_partitionpruner1.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/rand_partitionpruner2.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/rand_partitionpruner3.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/regexp_extract.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/router_join_ppr.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sample1.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sample2.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sample4.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sample5.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sample6.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sample7.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sample8.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sample9.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/serde_user_properties.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/smb_mapjoin_11.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/smb_mapjoin_12.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/smb_mapjoin_13.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/auto_join_reordering_values.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_1.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_12.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_2.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_3.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_4.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_5.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_7.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_8.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/avro_joins_native.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/bucket2.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/bucket3.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/bucket4.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/bucket5.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_1.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_2.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_spark1.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_spark2.q.out: does not exist in index error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_spark3.q.out