[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[ https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507960#comment-14507960 ] Jason Dere commented on HIVE-8307: -- I had created HIVE-10428 and added a patch, but I see that this also relates to columns.comments. So this fix will basically revert the changes from HIVE-6681? Can you re-submit the patch so we can see that the patch still works on trunk? > null character in columns.comments schema property breaks jobconf.xml > - > > Key: HIVE-8307 > URL: https://issues.apache.org/jira/browse/HIVE-8307 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.13.0, 0.14.0, 0.13.1 >Reporter: Carl Laird >Assignee: Ashutosh Chauhan > Attachments: HIVE-8307.1.patch, HIVE-8307.2.patch, HIVE-8307.patch > > > It would appear that the fix for > https://issues.apache.org/jira/browse/HIVE-6681 is causing the null character > to show up in job config xml files: > I get the following when trying to insert into an elasticsearch backed table: > [Fatal Error] :336:51: Character reference "&# > 14/06/17 14:40:11 FATAL conf.Configuration: error parsing conf file: > org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character > reference "&# > Exception in thread "main" java.lang.RuntimeException: > org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character > reference "&# > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1263) > at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1129) > at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1063) > at org.apache.hadoop.conf.Configuration.get(Configuration.java:416) > at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:604) > at org.apache.hadoop.hive.conf.HiveConf.getBoolVar(HiveConf.java:1273) > at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:667) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > Caused by: org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; > Character reference "&# > at > com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:251) > at > com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:300) > at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121) > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1181) > ... 11 more > Execution failed with exit status: 1 > Line 336 of jobconf.xml: > columns.comments > See > https://groups.google.com/forum/#!msg/mongodb-user/lKbha0SzMP8/jvE8ZrJom4AJ > for more discussion. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[ https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532123#comment-14532123 ] Sivaramakrishnan Narayanan commented on HIVE-8307: -- We're running into this problem with other StorageHandlers - any ETA on the patch? > null character in columns.comments schema property breaks jobconf.xml > - > > Key: HIVE-8307 > URL: https://issues.apache.org/jira/browse/HIVE-8307 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.13.0, 0.14.0, 0.13.1 >Reporter: Carl Laird >Assignee: Ashutosh Chauhan > Attachments: HIVE-8307.1.patch, HIVE-8307.2.patch, HIVE-8307.patch > > > It would appear that the fix for > https://issues.apache.org/jira/browse/HIVE-6681 is causing the null character > to show up in job config xml files: > I get the following when trying to insert into an elasticsearch backed table: > [Fatal Error] :336:51: Character reference "&# > 14/06/17 14:40:11 FATAL conf.Configuration: error parsing conf file: > org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character > reference "&# > Exception in thread "main" java.lang.RuntimeException: > org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character > reference "&# > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1263) > at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1129) > at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1063) > at org.apache.hadoop.conf.Configuration.get(Configuration.java:416) > at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:604) > at org.apache.hadoop.hive.conf.HiveConf.getBoolVar(HiveConf.java:1273) > at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:667) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > Caused by: org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; > Character reference "&# > at > com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:251) > at > com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:300) > at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121) > at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1181) > ... 11 more > Execution failed with exit status: 1 > Line 336 of jobconf.xml: > columns.comments > See > https://groups.google.com/forum/#!msg/mongodb-user/lKbha0SzMP8/jvE8ZrJom4AJ > for more discussion. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[
https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293244#comment-16293244
]
Hive QA commented on HIVE-8307:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
38s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
55s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
36s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
22s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
21s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
8s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
13s{color} | {color:red} serde: The patch generated 3 new + 31 unchanged - 3
fixed = 34 total (was 34) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
8s{color} | {color:red} itests/test-serde: The patch generated 2 new + 5
unchanged - 2 fixed = 7 total (was 7) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
24s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
12s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 15m 52s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /data/hiveptest/working/yetus/dev-support/hive-personality.sh |
| git revision | master / f52e8b4 |
| Default Java | 1.8.0_111 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-8275/yetus/diff-checkstyle-serde.txt
|
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-8275/yetus/diff-checkstyle-itests_test-serde.txt
|
| modules | C: serde standalone-metastore itests/test-serde U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-8275/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> null character in columns.comments schema property breaks jobconf.xml
> -
>
> Key: HIVE-8307
> URL: https://issues.apache.org/jira/browse/HIVE-8307
> Project: Hive
> Issue Type: Bug
> Components: Metastore
>Affects Versions: 0.13.0, 0.14.0, 0.13.1
>Reporter: Carl Laird
>Assignee: Jesus Camacho Rodriguez
> Attachments: HIVE-8307.03.patch, HIVE-8307.1.patch,
> HIVE-8307.2.patch, HIVE-8307.patch
>
>
> It would appear that the fix for
> https://issues.apache.org/jira/browse/HIVE-6681 is causing the null character
> to show up in job config xml files:
> I get the following when trying to insert into an elasticsearch backed table:
> [Fatal Error] :336:51: Character reference "&#
> 14/06/17 14:40:11 FATAL conf.Configuration: error parsing conf file:
> org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character
> reference "&#
> Exception in thread "main" java.lang.RuntimeException:
> org.xml.sax.SAXParse
[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[
https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293327#comment-16293327
]
Hive QA commented on HIVE-8307:
---
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12902162/HIVE-8307.03.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 329 failed/errored test(s), 11528 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestBeeLineDriver.testCliDriver[smb_mapjoin_11]
(batchId=246)
org.apache.hadoop.hive.cli.TestBeeLineDriver.testCliDriver[smb_mapjoin_12]
(batchId=246)
org.apache.hadoop.hive.cli.TestBeeLineDriver.testCliDriver[smb_mapjoin_13]
(batchId=246)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_into_dynamic_partitions]
(batchId=249)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_into_table]
(batchId=249)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_directory]
(batchId=249)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_dynamic_partitions]
(batchId=249)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_table]
(batchId=249)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[write_final_output_blobstore]
(batchId=249)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[alter1] (batchId=85)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[alter_partition_coltype]
(batchId=26)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[analyze_table_null_partition]
(batchId=81)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[autoColumnStats_5a]
(batchId=53)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[autoColumnStats_8]
(batchId=14)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_join25] (batchId=72)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_join_reordering_values]
(batchId=6)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_11]
(batchId=85)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_12]
(batchId=33)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_1]
(batchId=45)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_2]
(batchId=48)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_3]
(batchId=2)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_4]
(batchId=62)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_5]
(batchId=87)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_7]
(batchId=89)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_comments]
(batchId=60)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_decimal_old]
(batchId=46)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_joins_native]
(batchId=87)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_partitioned_native]
(batchId=6)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[avro_schema_evolution_native]
(batchId=56)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[binary_output_format]
(batchId=86)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket1] (batchId=42)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket2] (batchId=50)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket3] (batchId=16)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_1]
(batchId=66)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_2]
(batchId=57)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_spark1]
(batchId=67)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_spark2]
(batchId=3)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_spark3]
(batchId=44)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucket_map_join_spark4]
(batchId=1)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_1]
(batchId=32)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_2]
(batchId=65)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_3]
(batchId=67)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_4]
(batchId=41)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_5]
(batchId=23)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_6]
(batchId=83)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_7]
(batchId=38)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketcontext_8]
(batchId=37)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketmapjoin10]
(batchId=51)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[bucketmapjoin11
[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml
[
https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294492#comment-16294492
]
Hive QA commented on HIVE-8307:
---
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12902582/HIVE-8307.04.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8295/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8295/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8295/
Messages:
{noformat}
This message was trimmed, see log for full details
error: a/ql/src/test/results/clientpositive/pointlookup4.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/ppd_join_filter.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/ppd_vc.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/push_or.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/quotedid_tblproperty.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/rand_partitionpruner1.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/rand_partitionpruner2.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/rand_partitionpruner3.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/regexp_extract.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/router_join_ppr.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/sample1.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/sample2.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/sample4.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/sample5.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/sample6.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/sample7.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/sample8.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/sample9.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/serde_user_properties.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/smb_mapjoin_11.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/smb_mapjoin_12.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/smb_mapjoin_13.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out: does
not exist in index
error:
a/ql/src/test/results/clientpositive/spark/auto_join_reordering_values.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_12.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_3.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_4.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_5.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_7.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/auto_sortmerge_join_8.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/avro_joins_native.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/spark/bucket2.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/spark/bucket3.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/spark/bucket4.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/spark/bucket5.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_1.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_2.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_spark1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_spark2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_spark3.q.out
