[jira] [Updated] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3107: - Story Points: 1 > Fix HiveSyncTool drop partitions using JDBC > --- > > Key: HUDI-3107 > URL: https://issues.apache.org/jira/browse/HUDI-3107 > Project: Apache Hudi > Issue Type: Bug > Components: Hive Integration >Reporter: Yue Zhang >Assignee: Yue Zhang >Priority: Major > Labels: pull-request-available > Fix For: 0.11.0, 0.10.1 > > > ``` > org.apache.hudi.exception.HoodieException: Unable to delete table partitions > in /Users/yuezhang/tmp/hudiAfTable/forecast_agg > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:240) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.main(HoodieDropPartitionsTool.java:212) > at HoodieDropPartitionsToolTest.main(HoodieDropPartitionsToolTest.java:31) > Caused by: org.apache.hudi.exception.HoodieException: Got runtime exception > when hive syncing forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:119) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncHive(HoodieDropPartitionsTool.java:404) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncToHiveIfNecessary(HoodieDropPartitionsTool.java:270) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.doDeleteTablePartitionsEager(HoodieDropPartitionsTool.java:252) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:230) > ... 2 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed to sync > partitions for table forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:368) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:202) > at org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:116) > ... 6 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed in executing > SQL ALTER TABLE `forecast_agg` DROP PARTITION (20210623/0/20210623) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:64) > at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) > at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) > at > java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) > at > java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) > at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) > at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) > at > org.apache.hudi.hive.ddl.JDBCExecutor.dropPartitionsToTable(JDBCExecutor.java:149) > at > org.apache.hudi.hive.HoodieHiveClient.dropPartitionsToTable(HoodieHiveClient.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:363) > ... 9 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:256) > at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:242) > at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:254) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:62) > ... 21 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at > org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380) > at > org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206) > at > org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290) > at org.apache.hive.service.cli.operation.Operation.run(Operation.java:320) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517) > at > org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310) > at > org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:530) > at > org.apache.hive.service.rpc.thrift.TCL
[jira] [Updated] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3107: - Reviewers: Raymond Xu > Fix HiveSyncTool drop partitions using JDBC > --- > > Key: HUDI-3107 > URL: https://issues.apache.org/jira/browse/HUDI-3107 > Project: Apache Hudi > Issue Type: Bug > Components: Hive Integration >Reporter: Yue Zhang >Assignee: Yue Zhang >Priority: Major > Labels: pull-request-available > Fix For: 0.11.0, 0.10.1 > > > ``` > org.apache.hudi.exception.HoodieException: Unable to delete table partitions > in /Users/yuezhang/tmp/hudiAfTable/forecast_agg > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:240) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.main(HoodieDropPartitionsTool.java:212) > at HoodieDropPartitionsToolTest.main(HoodieDropPartitionsToolTest.java:31) > Caused by: org.apache.hudi.exception.HoodieException: Got runtime exception > when hive syncing forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:119) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncHive(HoodieDropPartitionsTool.java:404) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncToHiveIfNecessary(HoodieDropPartitionsTool.java:270) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.doDeleteTablePartitionsEager(HoodieDropPartitionsTool.java:252) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:230) > ... 2 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed to sync > partitions for table forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:368) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:202) > at org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:116) > ... 6 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed in executing > SQL ALTER TABLE `forecast_agg` DROP PARTITION (20210623/0/20210623) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:64) > at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) > at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) > at > java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) > at > java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) > at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) > at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) > at > org.apache.hudi.hive.ddl.JDBCExecutor.dropPartitionsToTable(JDBCExecutor.java:149) > at > org.apache.hudi.hive.HoodieHiveClient.dropPartitionsToTable(HoodieHiveClient.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:363) > ... 9 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:256) > at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:242) > at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:254) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:62) > ... 21 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at > org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380) > at > org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206) > at > org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290) > at org.apache.hive.service.cli.operation.Operation.run(Operation.java:320) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517) > at > org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310) > at > org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:530) > at > org.apache.hive.service.rpc.thri
[jira] [Updated] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3107: - Sprint: Hudi-Sprint-0.10.1 > Fix HiveSyncTool drop partitions using JDBC > --- > > Key: HUDI-3107 > URL: https://issues.apache.org/jira/browse/HUDI-3107 > Project: Apache Hudi > Issue Type: Bug > Components: Hive Integration >Reporter: Yue Zhang >Assignee: Yue Zhang >Priority: Major > Labels: pull-request-available > Fix For: 0.11.0, 0.10.1 > > > ``` > org.apache.hudi.exception.HoodieException: Unable to delete table partitions > in /Users/yuezhang/tmp/hudiAfTable/forecast_agg > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:240) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.main(HoodieDropPartitionsTool.java:212) > at HoodieDropPartitionsToolTest.main(HoodieDropPartitionsToolTest.java:31) > Caused by: org.apache.hudi.exception.HoodieException: Got runtime exception > when hive syncing forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:119) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncHive(HoodieDropPartitionsTool.java:404) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncToHiveIfNecessary(HoodieDropPartitionsTool.java:270) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.doDeleteTablePartitionsEager(HoodieDropPartitionsTool.java:252) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:230) > ... 2 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed to sync > partitions for table forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:368) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:202) > at org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:116) > ... 6 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed in executing > SQL ALTER TABLE `forecast_agg` DROP PARTITION (20210623/0/20210623) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:64) > at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) > at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) > at > java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) > at > java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) > at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) > at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) > at > org.apache.hudi.hive.ddl.JDBCExecutor.dropPartitionsToTable(JDBCExecutor.java:149) > at > org.apache.hudi.hive.HoodieHiveClient.dropPartitionsToTable(HoodieHiveClient.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:363) > ... 9 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:256) > at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:242) > at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:254) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:62) > ... 21 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at > org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380) > at > org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206) > at > org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290) > at org.apache.hive.service.cli.operation.Operation.run(Operation.java:320) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517) > at > org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310) > at > org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:530) > at > org.apache.hive.service.rpc
[jira] [Updated] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3107: - Component/s: Hive Integration > Fix HiveSyncTool drop partitions using JDBC > --- > > Key: HUDI-3107 > URL: https://issues.apache.org/jira/browse/HUDI-3107 > Project: Apache Hudi > Issue Type: Bug > Components: Hive Integration >Reporter: Yue Zhang >Assignee: Yue Zhang >Priority: Major > Labels: pull-request-available > Fix For: 0.11.0, 0.10.1 > > > ``` > org.apache.hudi.exception.HoodieException: Unable to delete table partitions > in /Users/yuezhang/tmp/hudiAfTable/forecast_agg > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:240) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.main(HoodieDropPartitionsTool.java:212) > at HoodieDropPartitionsToolTest.main(HoodieDropPartitionsToolTest.java:31) > Caused by: org.apache.hudi.exception.HoodieException: Got runtime exception > when hive syncing forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:119) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncHive(HoodieDropPartitionsTool.java:404) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncToHiveIfNecessary(HoodieDropPartitionsTool.java:270) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.doDeleteTablePartitionsEager(HoodieDropPartitionsTool.java:252) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:230) > ... 2 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed to sync > partitions for table forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:368) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:202) > at org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:116) > ... 6 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed in executing > SQL ALTER TABLE `forecast_agg` DROP PARTITION (20210623/0/20210623) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:64) > at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) > at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) > at > java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) > at > java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) > at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) > at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) > at > org.apache.hudi.hive.ddl.JDBCExecutor.dropPartitionsToTable(JDBCExecutor.java:149) > at > org.apache.hudi.hive.HoodieHiveClient.dropPartitionsToTable(HoodieHiveClient.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:363) > ... 9 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:256) > at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:242) > at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:254) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:62) > ... 21 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at > org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380) > at > org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206) > at > org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290) > at org.apache.hive.service.cli.operation.Operation.run(Operation.java:320) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517) > at > org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310) > at > org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:530) > at > org.apache.hive.service.
[jira] [Updated] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3107: - Fix Version/s: 0.11.0 0.10.1 > Fix HiveSyncTool drop partitions using JDBC > --- > > Key: HUDI-3107 > URL: https://issues.apache.org/jira/browse/HUDI-3107 > Project: Apache Hudi > Issue Type: Bug >Reporter: Yue Zhang >Assignee: Yue Zhang >Priority: Major > Labels: pull-request-available > Fix For: 0.11.0, 0.10.1 > > > ``` > org.apache.hudi.exception.HoodieException: Unable to delete table partitions > in /Users/yuezhang/tmp/hudiAfTable/forecast_agg > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:240) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.main(HoodieDropPartitionsTool.java:212) > at HoodieDropPartitionsToolTest.main(HoodieDropPartitionsToolTest.java:31) > Caused by: org.apache.hudi.exception.HoodieException: Got runtime exception > when hive syncing forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:119) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncHive(HoodieDropPartitionsTool.java:404) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncToHiveIfNecessary(HoodieDropPartitionsTool.java:270) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.doDeleteTablePartitionsEager(HoodieDropPartitionsTool.java:252) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:230) > ... 2 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed to sync > partitions for table forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:368) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:202) > at org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:116) > ... 6 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed in executing > SQL ALTER TABLE `forecast_agg` DROP PARTITION (20210623/0/20210623) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:64) > at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) > at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) > at > java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) > at > java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) > at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) > at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) > at > org.apache.hudi.hive.ddl.JDBCExecutor.dropPartitionsToTable(JDBCExecutor.java:149) > at > org.apache.hudi.hive.HoodieHiveClient.dropPartitionsToTable(HoodieHiveClient.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:363) > ... 9 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:256) > at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:242) > at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:254) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:62) > ... 21 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at > org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380) > at > org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206) > at > org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290) > at org.apache.hive.service.cli.operation.Operation.run(Operation.java:320) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517) > at > org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310) > at > org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:530) > at > org.apache.hive.service.rpc.thrift.TCLIService
[jira] [Updated] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3107: - Labels: pull-request-available (was: ) > Fix HiveSyncTool drop partitions using JDBC > --- > > Key: HUDI-3107 > URL: https://issues.apache.org/jira/browse/HUDI-3107 > Project: Apache Hudi > Issue Type: Bug >Reporter: Yue Zhang >Priority: Major > Labels: pull-request-available > > ``` > org.apache.hudi.exception.HoodieException: Unable to delete table partitions > in /Users/yuezhang/tmp/hudiAfTable/forecast_agg > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:240) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.main(HoodieDropPartitionsTool.java:212) > at HoodieDropPartitionsToolTest.main(HoodieDropPartitionsToolTest.java:31) > Caused by: org.apache.hudi.exception.HoodieException: Got runtime exception > when hive syncing forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:119) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncHive(HoodieDropPartitionsTool.java:404) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.syncToHiveIfNecessary(HoodieDropPartitionsTool.java:270) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.doDeleteTablePartitionsEager(HoodieDropPartitionsTool.java:252) > at > org.apache.hudi.utilities.HoodieDropPartitionsTool.run(HoodieDropPartitionsTool.java:230) > ... 2 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed to sync > partitions for table forecast_agg > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:368) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:202) > at org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:116) > ... 6 more > Caused by: org.apache.hudi.hive.HoodieHiveSyncException: Failed in executing > SQL ALTER TABLE `forecast_agg` DROP PARTITION (20210623/0/20210623) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:64) > at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) > at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) > at > java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) > at > java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) > at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) > at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) > at > org.apache.hudi.hive.ddl.JDBCExecutor.dropPartitionsToTable(JDBCExecutor.java:149) > at > org.apache.hudi.hive.HoodieHiveClient.dropPartitionsToTable(HoodieHiveClient.java:130) > at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:363) > ... 9 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:256) > at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:242) > at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:254) > at org.apache.hudi.hive.ddl.JDBCExecutor.runSQL(JDBCExecutor.java:62) > ... 21 more > Caused by: org.apache.hive.service.cli.HiveSQLException: Error while > compiling statement: FAILED: ParseException line 1:43 cannot recognize input > near '20210623' '/' '0' in drop partition statement > at > org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380) > at > org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:206) > at > org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:290) > at org.apache.hive.service.cli.operation.Operation.run(Operation.java:320) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530) > at > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:517) > at > org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:310) > at > org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:530) > at > org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437) > at > or