[ https://issues.apache.org/jira/browse/HUDI-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Udit Mehrotra resolved HUDI-2195. --------------------------------- Fix Version/s: 0.9.0 Resolution: Fixed > Sync Hive Failed When Execute CTAS In Spark2 And Spark3 > -------------------------------------------------------- > > Key: HUDI-2195 > URL: https://issues.apache.org/jira/browse/HUDI-2195 > Project: Apache Hudi > Issue Type: Bug > Components: Spark Integration > Reporter: pengzhiwei > Assignee: pengzhiwei > Priority: Major > Labels: pull-request-available > Fix For: 0.9.0 > > > When execute CTAS in spark2, the follow exception will throw out: > {code:java} > java.lang.NoClassDefFoundError: org/json/JSONException > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeCreateTable(SemanticAnalyzer.java:10847) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genResolvedParseTree(SemanticAnalyzer.java:10047) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10128) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:209) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) > {code} > While executing CTAS in spark3, the follow exception throw out: > {code:java} > java.lang.NoClassDefFoundError: > org/apache/calcite/rel/type/RelDataTypeSystemjava.lang.NoClassDefFoundError: > org/apache/calcite/rel/type/RelDataTypeSystem at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzerFactory.get(SemanticAnalyzerFactory.java:318) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:484) at > org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317) at > org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457) at > org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237) at > org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227) at > org.apache.hudi.hive.HoodieHiveClient.updateHiveSQLs(HoodieHiveClient.java:458) > at > org.apache.hudi.hive.HoodieHiveClient.updateHiveSQLUsingHiveDriver(HoodieHiveClient.java:448) > at > org.apache.hudi.hive.HoodieHiveClient.updateHiveSQL(HoodieHiveClient.java:426) > at > org.apache.hudi.hive.HoodieHiveClient.createTable(HoodieHiveClient.java:322) > at org.apache.hudi.hive.HiveSyncTool.syncSchema(HiveSyncTool.java:234) at > org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:179) at > org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:130) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)