Sidonet opened a new pull request #494: KYLIN-3727 Check if where is no 
directories, then finish job successf…
URL: https://github.com/apache/kylin/pull/494
 
 
   …ully.
   
   Input path for HBase load consists
   _SUCCESS
   F1
   F2
   etc...
   
   So, check if no folders exist, then skip loading step.
   
   Test for non-empty cube:
   2019-02-28 14:56:20,333 INFO  [Scheduler 136668115 Job 
0143a095-92fe-c8e0-a919-428682e2f15d-238] execution.ExecutableManager:453 : job 
id:0143a095-92fe-c8e0-a919-428682e2f15d-08 from READY to RUNNING
   2019-02-28 14:56:20,354 INFO  [Scheduler 136668115 Job 
0143a095-92fe-c8e0-a919-428682e2f15d-238] common.HadoopShellExecutable:59 : 
parameters of the HadoopShellExecutable:  -input 
hdfs://***:8020/kylin/kylin_metadata/kylin-0143a095-92fe-c8e0-a919-428682e2f15d/ORCTESTCUBE/hfile
 -htablename KYLIN_D9OV6ZF44W -cubename ORCTESTCUBE
   2019-02-28 14:56:25,416 DEBUG [Scheduler 136668115 Job 
0143a095-92fe-c8e0-a919-428682e2f15d-238] steps.BulkLoadJob:95 : Start to run 
LoadIncrementalHFiles
   
   Test in my env for empty cube:
   2019-02-28 14:42:15,699 INFO  [Scheduler 136668115 Job 
199180ac-8ab3-708f-c89c-6f2166a7d27d-102] execution.ExecutableManager:453 : job 
id:199180ac-8ab3-708f-c89c-6f2166a7d27d-08 from READY to RUNNING
   2019-02-28 14:42:15,784 INFO  [Scheduler 136668115 Job 
199180ac-8ab3-708f-c89c-6f2166a7d27d-102] common.HadoopShellExecutable:59 : 
parameters of the HadoopShellExecutable:  -input 
hdfs://***:8020/kylin/kylin_metadata/kylin-199180ac-8ab3-708f-c89c-6f2166a7d27d/kylin_sales_cube_orc/hfile
 -htablename KYLIN_MP2UWUVS0X -cubename kylin_sales_cube_orc
   2019-02-28 14:42:21,402 DEBUG [Scheduler 136668115 Job 
199180ac-8ab3-708f-c89c-6f2166a7d27d-102] steps.BulkLoadJob:100 : Nothing to 
load, cube is empty
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to