error execute org.apache.kylin.storage. hbase.util.StorageCleanupJob
hi， Run StorageCleanupJob error： 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table SLF4J: Class path contains multiple SLF4J bindings. 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table SLF4J: Found binding in [jar:file:/opt/apps/apache-hive-2.0.1-bin/lib/log4j-slf4j-impl-2.4.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table SLF4J: Found binding in [jar:file:/opt/apps/apache-kylin-2.0.0-bin/spark/lib/spark-assembly-1.6.3-hadoop2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table SLF4J: Found binding in [jar:file:/opt/apps/tez-0.8.4/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table SLF4J: Found binding in [jar:file:/opt/apps/hadoop-2.7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table Logging initialized using configuration in jar:file:/opt/apps/apache-hive-2.0.1-bin/lib/hive-common-2.0.1.jar!/hive-log4j2.properties 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table OK 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table Time taken: 0.924 seconds 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table OK 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table kylin_intermediate_cube_dsp_report_f92212f6_738d_4ef2_a727_1796e30c6cb0 Exception in thread "main" java.lang.RuntimeException: error execute org.apache.kylin.storage.hbase.util.StorageCleanupJob at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42) at org.apache.kylin.storage.hbase.util.StorageCleanupJob.main(StorageCleanupJob.java:362) Caused by: java.lang.NullPointerException at org.apache.kylin.common.util.ClassUtil.forRenamedClass(ClassUtil.java:84) at org.apache.kylin.common.util.ClassUtil.forName(ClassUtil.java:76) at org.apache.kylin.job.execution.ExecutableManager.parseTo(ExecutableManager.java:439) at org.apache.kylin.job.execution.ExecutableManager.getJob(ExecutableManager.java:129) at org.apache.kylin.storage.hbase.util.StorageCleanupJob.isTableInUse(StorageCleanupJob.java:347) at org.apache.kylin.storage.hbase.util.StorageCleanupJob.cleanUnusedIntermediateHiveTable(StorageCleanupJob.java:302) at org.apache.kylin.storage.hbase.util.StorageCleanupJob.execute(StorageCleanupJob.java:153) at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37) ... 1 more 2017-07-24 16:04:28,652 INFO [Thread-0 ConnectionManager$HConnectionImplementation:2068]: Closing master protocol: MasterService 2017-07-24 16:04:28,656 INFO [Thread-0 ConnectionManager$HConnectionImplementation:1676]: Closing zookeeper sessionid=0x15c4288a5da15f6 2017-07-24 16:04:28,683 INFO [Thread-0 ZooKeeper:684]: Session: 0x15c4288a5da15f6 closed 2017-07-24 16:04:28,683 INFO [main-EventThread ClientCnxn:512]: EventThread shut down Thanks。
Re: error execute org.apache.kylin.storage. hbase.util.StorageCleanupJob
I think the issue has been fixed in latest master code. Could you pull the code and have a try? 2017-07-24 18:24 GMT+08:00 liulang : > hi， > Run StorageCleanupJob error： > > 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table > SLF4J: Class path contains multiple SLF4J bindings. > 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table > SLF4J: Found binding in [jar:file:/opt/apps/apache- > hive-2.0.1-bin/lib/log4j-slf4j-impl-2.4.1.jar!/org/ > slf4j/impl/StaticLoggerBinder.class] > 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table > SLF4J: Found binding in [jar:file:/opt/apps/apache- > kylin-2.0.0-bin/spark/lib/spark-assembly-1.6.3-hadoop2. > 6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] > 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table > SLF4J: Found binding in [jar:file:/opt/apps/tez-0.8.4/ > lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] > 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table > SLF4J: Found binding in [jar:file:/opt/apps/hadoop-2. > 7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/ > slf4j/impl/StaticLoggerBinder.class] > 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table > SLF4J: Actual binding is of type [org.apache.logging.slf4j. > Log4jLoggerFactory] > 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table > 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table > Logging initialized using configuration in jar:file:/opt/apps/apache- > hive-2.0.1-bin/lib/hive-common-2.0.1.jar!/hive-log4j2.properties > 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table > OK > 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table > Time taken: 0.924 seconds > 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table > OK > 2017-07-24 16:04:28,646 INFO [main StorageCleanupJob:283]: Checking table > kylin_intermediate_cube_dsp_report_f92212f6_738d_4ef2_a727_1796e30c6cb0 > Exception in thread "main" java.lang.RuntimeException: error execute > org.apache.kylin.storage.hbase.util.StorageCleanupJob > at org.apache.kylin.common.util.AbstractApplication.execute( > AbstractApplication.java:42) > at org.apache.kylin.storage.hbase.util.StorageCleanupJob. > main(StorageCleanupJob.java:362) > Caused by: java.lang.NullPointerException > at org.apache.kylin.common.util.ClassUtil.forRenamedClass( > ClassUtil.java:84) > at org.apache.kylin.common.util.ClassUtil.forName(ClassUtil.java:76) > at org.apache.kylin.job.execution.ExecutableManager. > parseTo(ExecutableManager.java:439) > at org.apache.kylin.job.execution.ExecutableManager. > getJob(ExecutableManager.java:129) > at org.apache.kylin.storage.hbase.util.StorageCleanupJob.isTableInUse( > StorageCleanupJob.java:347) > at org.apache.kylin.storage.hbase.util.StorageCleanupJob. > cleanUnusedIntermediateHiveTable(StorageCleanupJob.java:302) > at org.apache.kylin.storage.hbase.util.StorageCleanupJob. > execute(StorageCleanupJob.java:153) > at org.apache.kylin.common.util.AbstractApplication.execute( > AbstractApplication.java:37) > ... 1 more > 2017-07-24 16:04:28,652 INFO [Thread-0 ConnectionManager$ > HConnectionImplementation:2068]: Closing master protocol: MasterService > 2017-07-24 16:04:28,656 INFO [Thread-0 ConnectionManager$ > HConnectionImplementation:1676]: Closing zookeeper > sessionid=0x15c4288a5da15f6 > 2017-07-24 16:04:28,683 INFO [Thread-0 ZooKeeper:684]: Session: > 0x15c4288a5da15f6 closed > 2017-07-24 16:04:28,683 INFO [main-EventThread ClientCnxn:512]: > EventThread shut down > > Thanks。 > > > > > > > > > > > > > > > >
Kylin window function
Anyone familiar with kylin window function? I am trying to get running total of past 12 months sales based on sql below and I am having difficulties getting the correct syntax. The tech blog below mentioned kylin syntax follow calcite but on the calcite function page, it does not specify the syntax within the window. select g.categ_lvl3_name ,c.month_id ,sum(price) as sales from KYLIN_Sales s join KYLIN_CAL_DT c on s.part_dt=c.cal_dt join KYLIN_CATEGORY_GROUPINGS g on s.leaf_categ_id=g.leaf_categ_id and s.LSTG_SITE_ID=g.SITE_ID group by g.categ_lvl3_name, month_id order by g.categ_lvl3_name,month_id 何京珂 Joanna He
Re: Kylin window function
The tech blog I referred. http://kylin.apache.org/blog/2016/11/16/window-function/ 何京珂 Joanna He From: "Joanna He (Jingke He)" Reply-To: "user@kylin.apache.org" Date: Tuesday, 25 July 2017 at 9:41 AM To: "user@kylin.apache.org" Subject: Kylin window function Anyone familiar with kylin window function? I am trying to get running total of past 12 months sales based on sql below and I am having difficulties getting the correct syntax. The tech blog below mentioned kylin syntax follow calcite but on the calcite function page, it does not specify the syntax within the window. select g.categ_lvl3_name ,c.month_id ,sum(price) as sales from KYLIN_Sales s join KYLIN_CAL_DT c on s.part_dt=c.cal_dt join KYLIN_CATEGORY_GROUPINGS g on s.leaf_categ_id=g.leaf_categ_id and s.LSTG_SITE_ID=g.SITE_ID group by g.categ_lvl3_name, month_id order by g.categ_lvl3_name,month_id 何京珂 Joanna He
Re: Kylin window function
+ Yerui. Do you have any idea? 2017-07-25 11:25 GMT+08:00 Joanna He (Jingke He) : > The tech blog I referred. > > http://kylin.apache.org/blog/2016/11/16/window-function/ > > > > > > 何京珂 > > Joanna He > > > > > > *From: *"Joanna He (Jingke He)" > *Reply-To: *"user@kylin.apache.org" > *Date: *Tuesday, 25 July 2017 at 9:41 AM > *To: *"user@kylin.apache.org" > *Subject: *Kylin window function > > > > Anyone familiar with kylin window function? I am trying to get running > total of past 12 months sales based on sql below and I am having > difficulties getting the correct syntax. > > The tech blog below mentioned kylin syntax follow calcite but on the > calcite function page, it does not specify the syntax within the window. > > > > > > > > select g.categ_lvl3_name > > ,c.month_id > > ,sum(price) as sales > > from KYLIN_Sales s > > join KYLIN_CAL_DT c > > on s.part_dt=c.cal_dt > > join KYLIN_CATEGORY_GROUPINGS g > > on s.leaf_categ_id=g.leaf_categ_id > > and s.LSTG_SITE_ID=g.SITE_ID > > group by g.categ_lvl3_name, month_id > > order by g.categ_lvl3_name,month_id > > > > > > 何京珂 > > Joanna He > > >
