Hi Zx, The source code of 1.13.0-kylin-r4. is in Kyligence's fork: https://github.com/Kyligence/calcite Please provide the full kylin.log, maybe we can find new clue there.
liuzhixin <liuz...@163.com> 于2018年10月15日周一 下午3:06写道： > Hi ShaoFeng Shi: > > This is the original error, > > When I build the cube and give the error: java.lang.NoClassDefFoundError: > com/google/protobuf/GeneratedMessageV3, > > The GeneratedMessageV3 from protobuf-java-3.1.0, and there is really no it > in hive. > > Maybe I should assembly it to the atopcalcite. > > But I can run the hive -e command success. > > # > Time taken: 0.218 seconds > Exception in thread "main" java.lang.NoClassDefFoundError: > com/google/protobuf/GeneratedMessageV3 > at java.lang.ClassLoader.defineClass1(Native Method) > at java.lang.ClassLoader.defineClass(ClassLoader.java:763) > at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:467) > at java.net.URLClassLoader.access$100(URLClassLoader.java:73) > at java.net.URLClassLoader$1.run(URLClassLoader.java:368) > at java.net.URLClassLoader$1.run(URLClassLoader.java:362) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:361) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > at > org.apache.calcite.avatica.ConnectionPropertiesImpl.<clinit>(ConnectionPropertiesImpl.java:38) > at org.apache.calcite.avatica.MetaImpl.<init>(MetaImpl.java:72) > at org.apache.calcite.jdbc.CalciteMetaImpl.<init>(CalciteMetaImpl.java:88) > at org.apache.calcite.jdbc.Driver.createMeta(Driver.java:169) > at > org.apache.calcite.avatica.AvaticaConnection.<init>(AvaticaConnection.java:121) > at > org.apache.calcite.jdbc.CalciteConnectionImpl.<init>(CalciteConnectionImpl.java:113) > at > org.apache.calcite.jdbc.CalciteJdbc41Factory$CalciteJdbc41Connection.<init>(CalciteJdbc41Factory.java:114) > at > org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:59) > at > org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:44) > at > org.apache.calcite.jdbc.CalciteFactory.newConnection(CalciteFactory.java:53) > at > org.apache.calcite.avatica.UnregisteredDriver.connect(UnregisteredDriver.java:138) > at java.sql.DriverManager.getConnection(DriverManager.java:664) > at java.sql.DriverManager.getConnection(DriverManager.java:208) > at org.apache.calcite.tools.Frameworks.withPrepare(Frameworks.java:145) > at org.apache.calcite.tools.Frameworks.withPlanner(Frameworks.java:106) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.logicalPlan(CalcitePlanner.java:1069) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.getOptimizedAST(CalcitePlanner.java:1085) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:364) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:11138) > at > org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:286) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:512) > at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227) > at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336) > at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:787) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:686) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:318) > at org.apache.hadoop.util.RunJar.main(RunJar.java:232) > Caused by: java.lang.ClassNotFoundException: > com.google.protobuf.GeneratedMessageV3 > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 51 more > The command is: > hive -e "USE default; > > > 在 2018年10月15日，下午2:35，liuzhixin <liuz...@163.com> 写道： > > Hi shaofeng: > > Yes, I can run the command well in hive shell. > > I can’t find calcite-core version 1.13.0-kylin-r4. > > Best wishes. > > 在 2018年10月15日，下午2:20，ShaoFeng Shi <shaofeng...@apache.org> 写道： > > Hive version 2.3.3 can work well with HDP 3? Can you try the HiveQL that > Kylin executed out of Kylin, if it works, then there should be something > wrong in Kylin. > > liuzhixin <liuz...@163.com> 于2018年10月15日周一 下午1:47写道： > > Thank you for the answer! > > I can’t decide the hive version. > > And the hive version 2.3.3 can work well with HDP 3. > > Perhaps you can test the Kylin with hive version 2.3.3. > > Maybe it’s other error. Thanks! > > Best wishes! > > > 在 2018年10月15日，下午1:24，ShaoFeng Shi <shaofeng...@apache.org> 写道： > > Hi zhixin, > > I think the problem is how to run Hive 2 with HDP 3, no relation with > Kylin. > > Usually, we don't encourage user to customize the component version in a > release, because that may bring dependency conflicts. > > I suggest you use the original Hive version in HDP 3. > > liuzhixin <liuz...@163.com> 于2018年10月15日周一 上午11:25写道： > > Hi ShaoFeng Shi > > Yes, the error from hive version 2.3.3, > > And Kylin need hive version 3.1.0. > > So how to solve the question? > > Best wishes! > > 在 2018年10月15日，上午11:10，ShaoFeng Shi <shaofeng...@apache.org> 写道： > > Hi Zhixin, > > The error log is thrown from Hive, not from Kylin I think. Please verify > your hive is properly installed; You can manually run that hive command > > : > > > hive -e "use default; xxx" > > Lijun Cao <641507...@qq.com> 于2018年10月15日周一 上午11:01写道： > > Hi liuzhixin: > > As I remember, the Hive version in HDP 3 is 3.1.0 . > > You can update Hive to 3.1.0 and then have another try. > > And according to my previous test, the binary package > apache-kylin-2.5.0-bin-hadoop3.tar.gz can work properly on HDP 3. You > > can > > get it form official site. > > Best Regards > > Lijun Cao > > 在 2018年10月15日，10:22，liuzhixin <liuz...@163.com> 写道： > > hi cao lijun， > # > the platform is ambari hdp3.0, and hive is 2.3.3, hbase version is 2.0 > > I have compile the source code with hive 2.3.3, > > but the module atopcalcite depends on protobuf 3.1.0, > > other module depends on protobuf 2.5.0. > > > 在 2018年10月15日，上午8:40，Lijun Cao <641507...@qq.com> 写道： > > Hi liuzhixin: > > Which platform did you use? > > The CDH 6.0.x or HDP 3.0 ? > > Best Regards > > Lijun Cao > > 在 2018年10月12日，21:14，liuzhixin <liuz...@163.com> 写道： > > Logging initialized using configuration in > > > file:/data/hadoop-enviorment/apache-hive-2.3.3/conf/hive-log4j2.properties > > Async: true > > OK > Time taken: 4.512 seconds > OK > Time taken: 1.511 seconds > OK > Time taken: 0.272 seconds > OK > Time taken: 0.185 seconds > Exception in thread "main" java.lang.NoSuchMethodError: > > com.google.protobuf.Descriptors$Descriptor.getOneofs()Ljava/util/List; > > at > > > > com.google.protobuf.GeneratedMessageV3$FieldAccessorTable.<init>(GeneratedMessageV3.java:1704) > > at > > org.apache.calcite.avatica.proto.Common.<clinit>(Common.java:18927) > > at > > > > org.apache.calcite.avatica.proto.Common$ConnectionProperties.getDescriptor(Common.java:1264) > > at > > > > org.apache.calcite.avatica.ConnectionPropertiesImpl.<clinit>(ConnectionPropertiesImpl.java:38) > > at org.apache.calcite.avatica.MetaImpl.<init>(MetaImpl.java:72) > at > > org.apache.calcite.jdbc.CalciteMetaImpl.<init>(CalciteMetaImpl.java:88) > > at org.apache.calcite.jdbc.Driver.createMeta(Driver.java:169) > at > > > > org.apache.calcite.avatica.AvaticaConnection.<init>(AvaticaConnection.java:121) > > at > > > > org.apache.calcite.jdbc.CalciteConnectionImpl.<init>(CalciteConnectionImpl.java:113) > > at > > > > org.apache.calcite.jdbc.CalciteJdbc41Factory$CalciteJdbc41Connection.<init>(CalciteJdbc41Factory.java:114) > > at > > > > org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:59) > > at > > > > org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:44) > > at > > > > org.apache.calcite.jdbc.CalciteFactory.newConnection(CalciteFactory.java:53) > > at > > > > org.apache.calcite.avatica.UnregisteredDriver.connect(UnregisteredDriver.java:138) > > at java.sql.DriverManager.getConnection(DriverManager.java:664) > at java.sql.DriverManager.getConnection(DriverManager.java:208) > at > > org.apache.calcite.tools.Frameworks.withPrepare(Frameworks.java:145) > > at > > org.apache.calcite.tools.Frameworks.withPlanner(Frameworks.java:106) > > at > > > > org.apache.hadoop.hive.ql.parse.CalcitePlanner.logicalPlan(CalcitePlanner.java:1069) > > at > > > > org.apache.hadoop.hive.ql.parse.CalcitePlanner.getOptimizedAST(CalcitePlanner.java:1085) > > at > > > > org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:364) > > at > > > > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:11138) > > at > > > > org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:286) > > at > > > > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258) > > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:512) > at > > org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317) > > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227) > at > > > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233) > > at > > org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184) > > at > > org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > > at > > org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336) > > at > > org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:787) > > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:686) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > at > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:318) > at org.apache.hadoop.util.RunJar.main(RunJar.java:232) > The command is: > hive -e "USE default; > > > > > > > > -- > Best regards, > > Shaofeng Shi 史少锋 > > > > > > -- > Best regards, > > Shaofeng Shi 史少锋 > > > > > -- > Best regards, > > Shaofeng Shi 史少锋 > > > > -- Best regards, Shaofeng Shi 史少锋
