[jira] [Commented] (HIVE-20603) "Wrong FS" error when inserting to partition after changing table location filesystem
[ https://issues.apache.org/jira/browse/HIVE-20603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16627011#comment-16627011 ] Hive QA commented on HIVE-20603: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12941109/HIVE-20603.3.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 14998 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/14034/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/14034/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-14034/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12941109 - PreCommit-HIVE-Build > "Wrong FS" error when inserting to partition after changing table location > filesystem > - > > Key: HIVE-20603 > URL: https://issues.apache.org/jira/browse/HIVE-20603 > Project: Hive > Issue Type: Bug >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > Attachments: HIVE-20603.1.patch, HIVE-20603.2.patch, > HIVE-20603.3.patch > > > Inserting into an existing partition, after changing a table's location to > point to a different HDFS filesystem: > {noformat} >query += "CREATE TABLE test_managed_tbl (id int, name string, dept string) > PARTITIONED BY (year int);\n" > query += "INSERT INTO test_managed_tbl PARTITION (year=2016) VALUES > (8,'Henry','CSE');\n" > query += "ALTER TABLE test_managed_tbl ADD PARTITION (year=2017);\n" > query += "ALTER TABLE test_managed_tbl SET LOCATION > > 'hdfs://ns2/warehouse/tablespace/managed/hive/test_managed_tbl'" > query += "INSERT INTO test_managed_tbl PARTITION (year=2017) VALUES > (9,'Harris','CSE');\n" > {noformat} > Results in the following error: > {noformat} > java.lang.IllegalArgumentException: Wrong FS: > hdfs://ns1/warehouse/tablespace/managed/hive/test_managed_tbl/year=2017, > expected: hdfs://ns2 > at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1583) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1580) > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1595) > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1734) > at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:4141) > at > org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1966) > at > org.apache.hadoop.hive.ql.exec.MoveTask.handleStaticParts(MoveTask.java:477) > at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:397) > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:210) > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2701) > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2372) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2048) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1746) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1740) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20603) "Wrong FS" error when inserting to partition after changing table location filesystem
[ https://issues.apache.org/jira/browse/HIVE-20603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626971#comment-16626971 ] Hive QA commented on HIVE-20603: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 41s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 39s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 31s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 52s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m 27s{color} | {color:blue} standalone-metastore/metastore-common in master has 28 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 52s{color} | {color:blue} ql in master has 2326 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 49s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 10s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 59s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 31s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 31s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 53s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 6m 32s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 49s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 32m 37s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-14034/dev-support/hive-personality.sh | | git revision | master / e161b01 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: standalone-metastore/metastore-common itests ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-14034/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > "Wrong FS" error when inserting to partition after changing table location > filesystem > - > > Key: HIVE-20603 > URL: https://issues.apache.org/jira/browse/HIVE-20603 > Project: Hive > Issue Type: Bug >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > Attachments: HIVE-20603.1.patch, HIVE-20603.2.patch, > HIVE-20603.3.patch > > > Inserting into an existing partition, after changing a table's location to > point to a different HDFS filesystem: > {noformat} >query += "CREATE TABLE test_managed_tbl (id int, name string, dept string) > PARTITIONED BY (year int);\n" > query += "INSERT INTO test_managed_tbl PARTITION (year=2016) VALUES > (8,'Henry','CSE');\n" > query += "ALTER TABLE test_managed_tbl ADD PARTITION (year=2017);\n" > query += "ALTER TABLE test_managed_tbl SET LOCATION > > 'hdfs://ns2/warehouse/tablespace/managed/hive/test_managed_tbl'" > query += "INSERT INTO test_managed_tbl PARTITION (year=2017) VALU
[jira] [Commented] (HIVE-20603) "Wrong FS" error when inserting to partition after changing table location filesystem
[ https://issues.apache.org/jira/browse/HIVE-20603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16624483#comment-16624483 ] Hive QA commented on HIVE-20603: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12940703/HIVE-20603.2.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 14995 tests executed *Failed tests:* {noformat} org.apache.hive.jdbc.TestActivePassiveHA.testActivePassiveHA (batchId=251) org.apache.hive.jdbc.TestActivePassiveHA.testClientConnectionsOnFailover (batchId=251) org.apache.hive.jdbc.TestActivePassiveHA.testConnectionActivePassiveHAServiceDiscovery (batchId=251) org.apache.hive.jdbc.TestActivePassiveHA.testManualFailover (batchId=251) org.apache.hive.jdbc.TestActivePassiveHA.testManualFailoverUnauthorized (batchId=251) org.apache.hive.jdbc.TestActivePassiveHA.testNoConnectionOnPassive (batchId=251) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/13964/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13964/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13964/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 6 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12940703 - PreCommit-HIVE-Build > "Wrong FS" error when inserting to partition after changing table location > filesystem > - > > Key: HIVE-20603 > URL: https://issues.apache.org/jira/browse/HIVE-20603 > Project: Hive > Issue Type: Bug >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > Attachments: HIVE-20603.1.patch, HIVE-20603.2.patch > > > Inserting into an existing partition, after changing a table's location to > point to a different HDFS filesystem: > {noformat} >query += "CREATE TABLE test_managed_tbl (id int, name string, dept string) > PARTITIONED BY (year int);\n" > query += "INSERT INTO test_managed_tbl PARTITION (year=2016) VALUES > (8,'Henry','CSE');\n" > query += "ALTER TABLE test_managed_tbl ADD PARTITION (year=2017);\n" > query += "ALTER TABLE test_managed_tbl SET LOCATION > > 'hdfs://ns2/warehouse/tablespace/managed/hive/test_managed_tbl'" > query += "INSERT INTO test_managed_tbl PARTITION (year=2017) VALUES > (9,'Harris','CSE');\n" > {noformat} > Results in the following error: > {noformat} > java.lang.IllegalArgumentException: Wrong FS: > hdfs://ns1/warehouse/tablespace/managed/hive/test_managed_tbl/year=2017, > expected: hdfs://ns2 > at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1583) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1580) > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1595) > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1734) > at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:4141) > at > org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1966) > at > org.apache.hadoop.hive.ql.exec.MoveTask.handleStaticParts(MoveTask.java:477) > at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:397) > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:210) > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2701) > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2372) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2048) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1746) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1740) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20603) "Wrong FS" error when inserting to partition after changing table location filesystem
[ https://issues.apache.org/jira/browse/HIVE-20603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16624474#comment-16624474 ] Hive QA commented on HIVE-20603: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 43s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 0s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 37s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 53s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m 33s{color} | {color:blue} standalone-metastore/metastore-common in master has 28 extant Findbugs warnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 9s{color} | {color:blue} ql in master has 2326 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 47s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 10s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 1s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 36s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 36s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 54s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 6m 57s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 50s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 34m 6s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-13964/dev-support/hive-personality.sh | | git revision | master / cdba00c | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: standalone-metastore/metastore-common itests ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-13964/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > "Wrong FS" error when inserting to partition after changing table location > filesystem > - > > Key: HIVE-20603 > URL: https://issues.apache.org/jira/browse/HIVE-20603 > Project: Hive > Issue Type: Bug >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > Attachments: HIVE-20603.1.patch, HIVE-20603.2.patch > > > Inserting into an existing partition, after changing a table's location to > point to a different HDFS filesystem: > {noformat} >query += "CREATE TABLE test_managed_tbl (id int, name string, dept string) > PARTITIONED BY (year int);\n" > query += "INSERT INTO test_managed_tbl PARTITION (year=2016) VALUES > (8,'Henry','CSE');\n" > query += "ALTER TABLE test_managed_tbl ADD PARTITION (year=2017);\n" > query += "ALTER TABLE test_managed_tbl SET LOCATION > > 'hdfs://ns2/warehouse/tablespace/managed/hive/test_managed_tbl'" > query += "INSERT INTO test_managed_tbl PARTITION (year=2017) VALUES > (9,'Harris','CSE'
[jira] [Commented] (HIVE-20603) "Wrong FS" error when inserting to partition after changing table location filesystem
[ https://issues.apache.org/jira/browse/HIVE-20603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622950#comment-16622950 ] Jason Dere commented on HIVE-20603: --- updated patch to fix archive_insert tests. Other failures don't appear related. > "Wrong FS" error when inserting to partition after changing table location > filesystem > - > > Key: HIVE-20603 > URL: https://issues.apache.org/jira/browse/HIVE-20603 > Project: Hive > Issue Type: Bug >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > Attachments: HIVE-20603.1.patch, HIVE-20603.2.patch > > > Inserting into an existing partition, after changing a table's location to > point to a different HDFS filesystem: > {noformat} >query += "CREATE TABLE test_managed_tbl (id int, name string, dept string) > PARTITIONED BY (year int);\n" > query += "INSERT INTO test_managed_tbl PARTITION (year=2016) VALUES > (8,'Henry','CSE');\n" > query += "ALTER TABLE test_managed_tbl ADD PARTITION (year=2017);\n" > query += "ALTER TABLE test_managed_tbl SET LOCATION > > 'hdfs://ns2/warehouse/tablespace/managed/hive/test_managed_tbl'" > query += "INSERT INTO test_managed_tbl PARTITION (year=2017) VALUES > (9,'Harris','CSE');\n" > {noformat} > Results in the following error: > {noformat} > java.lang.IllegalArgumentException: Wrong FS: > hdfs://ns1/warehouse/tablespace/managed/hive/test_managed_tbl/year=2017, > expected: hdfs://ns2 > at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1583) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1580) > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1595) > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1734) > at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:4141) > at > org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1966) > at > org.apache.hadoop.hive.ql.exec.MoveTask.handleStaticParts(MoveTask.java:477) > at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:397) > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:210) > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2701) > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2372) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2048) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1746) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1740) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20603) "Wrong FS" error when inserting to partition after changing table location filesystem
[ https://issues.apache.org/jira/browse/HIVE-20603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622791#comment-16622791 ] Hive QA commented on HIVE-20603: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12940516/HIVE-20603.1.patch {color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 9 failed/errored test(s), 14990 tests executed *Failed tests:* {noformat} TestAlterTableMetadata - did not produce a TEST-*.xml file (likely timed out) (batchId=243) TestAutoPurgeTables - did not produce a TEST-*.xml file (likely timed out) (batchId=243) TestLocationQueries - did not produce a TEST-*.xml file (likely timed out) (batchId=243) TestReplicationScenariosIncrementalLoadAcidTables - did not produce a TEST-*.xml file (likely timed out) (batchId=243) TestSemanticAnalyzerHookLoading - did not produce a TEST-*.xml file (likely timed out) (batchId=243) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[archive_insert1] (batchId=97) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[archive_insert2] (batchId=98) org.apache.hadoop.hive.ql.exec.spark.TestSparkSessionTimeout.testMultiSparkSessionTimeout (batchId=245) org.apache.hive.jdbc.TestJdbcDriver2.testSelectExecAsync2 (batchId=252) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/13939/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/13939/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-13939/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 9 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12940516 - PreCommit-HIVE-Build > "Wrong FS" error when inserting to partition after changing table location > filesystem > - > > Key: HIVE-20603 > URL: https://issues.apache.org/jira/browse/HIVE-20603 > Project: Hive > Issue Type: Bug >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > Attachments: HIVE-20603.1.patch > > > Inserting into an existing partition, after changing a table's location to > point to a different HDFS filesystem: > {noformat} >query += "CREATE TABLE test_managed_tbl (id int, name string, dept string) > PARTITIONED BY (year int);\n" > query += "INSERT INTO test_managed_tbl PARTITION (year=2016) VALUES > (8,'Henry','CSE');\n" > query += "ALTER TABLE test_managed_tbl ADD PARTITION (year=2017);\n" > query += "ALTER TABLE test_managed_tbl SET LOCATION > > 'hdfs://ns2/warehouse/tablespace/managed/hive/test_managed_tbl'" > query += "INSERT INTO test_managed_tbl PARTITION (year=2017) VALUES > (9,'Harris','CSE');\n" > {noformat} > Results in the following error: > {noformat} > java.lang.IllegalArgumentException: Wrong FS: > hdfs://ns1/warehouse/tablespace/managed/hive/test_managed_tbl/year=2017, > expected: hdfs://ns2 > at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1583) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1580) > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1595) > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1734) > at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:4141) > at > org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1966) > at > org.apache.hadoop.hive.ql.exec.MoveTask.handleStaticParts(MoveTask.java:477) > at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:397) > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:210) > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2701) > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2372) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2048) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1746) > at org.apache.hadoop.hive
[jira] [Commented] (HIVE-20603) "Wrong FS" error when inserting to partition after changing table location filesystem
[ https://issues.apache.org/jira/browse/HIVE-20603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622730#comment-16622730 ] Hive QA commented on HIVE-20603: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 1s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 47s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 20s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 2s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 43s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 55s{color} | {color:blue} ql in master has 2326 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 54s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 10s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 22s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 44s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m 6s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 55s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 23m 46s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-13939/dev-support/hive-personality.sh | | git revision | master / 208e202f | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: itests ql U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-13939/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > "Wrong FS" error when inserting to partition after changing table location > filesystem > - > > Key: HIVE-20603 > URL: https://issues.apache.org/jira/browse/HIVE-20603 > Project: Hive > Issue Type: Bug >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > Attachments: HIVE-20603.1.patch > > > Inserting into an existing partition, after changing a table's location to > point to a different HDFS filesystem: > {noformat} >query += "CREATE TABLE test_managed_tbl (id int, name string, dept string) > PARTITIONED BY (year int);\n" > query += "INSERT INTO test_managed_tbl PARTITION (year=2016) VALUES > (8,'Henry','CSE');\n" > query += "ALTER TABLE test_managed_tbl ADD PARTITION (year=2017);\n" > query += "ALTER TABLE test_managed_tbl SET LOCATION > > 'hdfs://ns2/warehouse/tablespace/managed/hive/test_managed_tbl'" > query += "INSERT INTO test_managed_tbl PARTITION (year=2017) VALUES > (9,'Harris','CSE');\n" > {noformat} > Results in the following error: > {noformat} > java.lang.IllegalArgumentException: Wrong FS: > hdfs://ns1/warehouse/tablespace/managed/hive/test_managed_tbl/year=2017, > expected: hdfs://ns2 > at org.apache.hadoop.fs.Fi
[jira] [Commented] (HIVE-20603) "Wrong FS" error when inserting to partition after changing table location filesystem
[ https://issues.apache.org/jira/browse/HIVE-20603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621343#comment-16621343 ] Sergey Shelukhin commented on HIVE-20603: - Wow, this is even funnier than the old issue... so it used to just arbitrarily append partition path to table FS schema and authority? I wonder what the logic behind that is. +1 pending tests, if I understand this correctly. > "Wrong FS" error when inserting to partition after changing table location > filesystem > - > > Key: HIVE-20603 > URL: https://issues.apache.org/jira/browse/HIVE-20603 > Project: Hive > Issue Type: Bug >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > Attachments: HIVE-20603.1.patch > > > Inserting into an existing partition, after changing a table's location to > point to a different HDFS filesystem: > {noformat} >query += "CREATE TABLE test_managed_tbl (id int, name string, dept string) > PARTITIONED BY (year int);\n" > query += "INSERT INTO test_managed_tbl PARTITION (year=2016) VALUES > (8,'Henry','CSE');\n" > query += "ALTER TABLE test_managed_tbl ADD PARTITION (year=2017);\n" > query += "ALTER TABLE test_managed_tbl SET LOCATION > > 'hdfs://ns2/warehouse/tablespace/managed/hive/test_managed_tbl'" > query += "INSERT INTO test_managed_tbl PARTITION (year=2017) VALUES > (9,'Harris','CSE');\n" > {noformat} > Results in the following error: > {noformat} > java.lang.IllegalArgumentException: Wrong FS: > hdfs://ns1/warehouse/tablespace/managed/hive/test_managed_tbl/year=2017, > expected: hdfs://ns2 > at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1583) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1580) > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1595) > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1734) > at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:4141) > at > org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1966) > at > org.apache.hadoop.hive.ql.exec.MoveTask.handleStaticParts(MoveTask.java:477) > at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:397) > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:210) > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2701) > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2372) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2048) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1746) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1740) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-20603) "Wrong FS" error when inserting to partition after changing table location filesystem
[ https://issues.apache.org/jira/browse/HIVE-20603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621336#comment-16621336 ] Jason Dere commented on HIVE-20603: --- Looks like HIVE-19891 changed some behavior relevant to this, but missed out on the case where the new table location used a different FS. cc [~sershe] [~ashutoshc] > "Wrong FS" error when inserting to partition after changing table location > filesystem > - > > Key: HIVE-20603 > URL: https://issues.apache.org/jira/browse/HIVE-20603 > Project: Hive > Issue Type: Bug >Reporter: Jason Dere >Assignee: Jason Dere >Priority: Major > > Inserting into an existing partition, after changing a table's location to > point to a different HDFS filesystem: > {noformat} >query += "CREATE TABLE test_managed_tbl (id int, name string, dept string) > PARTITIONED BY (year int);\n" > query += "INSERT INTO test_managed_tbl PARTITION (year=2016) VALUES > (8,'Henry','CSE');\n" > query += "ALTER TABLE test_managed_tbl ADD PARTITION (year=2017);\n" > query += "ALTER TABLE test_managed_tbl SET LOCATION > > 'hdfs://ns2/warehouse/tablespace/managed/hive/test_managed_tbl'" > query += "INSERT INTO test_managed_tbl PARTITION (year=2017) VALUES > (9,'Harris','CSE');\n" > {noformat} > Results in the following error: > {noformat} > java.lang.IllegalArgumentException: Wrong FS: > hdfs://ns1/warehouse/tablespace/managed/hive/test_managed_tbl/year=2017, > expected: hdfs://ns2 > at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1583) > at > org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1580) > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1595) > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1734) > at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:4141) > at > org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1966) > at > org.apache.hadoop.hive.ql.exec.MoveTask.handleStaticParts(MoveTask.java:477) > at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:397) > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:210) > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2701) > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2372) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2048) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1746) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1740) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)