[jira] [Commented] (KYLIN-3850) Flink cubing step : merge by layer
[ https://issues.apache.org/jira/browse/KYLIN-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794064#comment-16794064 ] ASF subversion and git services commented on KYLIN-3850: Commit 04394df3b3a5bb664fbd66d323a7769d431692d8 in kylin's branch refs/heads/engine-flink from yanghua [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=04394df ] KYLIN-3850 Flink cubing step : merge by layer > Flink cubing step : merge by layer > -- > > Key: KYLIN-3850 > URL: https://issues.apache.org/jira/browse/KYLIN-3850 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3850) Flink cubing step : merge by layer
[ https://issues.apache.org/jira/browse/KYLIN-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794063#comment-16794063 ] ASF GitHub Bot commented on KYLIN-3850: --- shaofengshi commented on pull request #520: KYLIN-3850 Flink cubing step : merge by layer URL: https://github.com/apache/kylin/pull/520 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Flink cubing step : merge by layer > -- > > Key: KYLIN-3850 > URL: https://issues.apache.org/jira/browse/KYLIN-3850 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #520: KYLIN-3850 Flink cubing step : merge by layer
shaofengshi merged pull request #520: KYLIN-3850 Flink cubing step : merge by layer URL: https://github.com/apache/kylin/pull/520 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3876) Fix flink config option wrong key mapping
[
https://issues.apache.org/jira/browse/KYLIN-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794055#comment-16794055
]
ASF subversion and git services commented on KYLIN-3876:
Commit 9faa880dddb33bdeed938f30d8d7630ab5de0dd1 in kylin's branch
refs/heads/engine-flink from yanghua
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=9faa880 ]
KYLIN-3876 Fix flink config option wrong key mapping
> Fix flink config option wrong key mapping
> -
>
> Key: KYLIN-3876
> URL: https://issues.apache.org/jira/browse/KYLIN-3876
> Project: Kylin
> Issue Type: Sub-task
> Components: Flink Engine
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>
> There is a wrong key mapping, it would cause critical exception :
> {code:java}
> java.lang.IllegalArgumentException: Unsupported Flink configuration pair :
> key[taskmanager.heap.size], value[1G] at
> org.apache.kylin.engine.flink.FlinkExecutable.doWork(FlinkExecutable.java:193)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3876) Fix flink config option wrong key mapping
[
https://issues.apache.org/jira/browse/KYLIN-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794054#comment-16794054
]
ASF GitHub Bot commented on KYLIN-3876:
---
shaofengshi commented on pull request #521: KYLIN-3876 Fix flink config option
wrong key mapping
URL: https://github.com/apache/kylin/pull/521
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Fix flink config option wrong key mapping
> -
>
> Key: KYLIN-3876
> URL: https://issues.apache.org/jira/browse/KYLIN-3876
> Project: Kylin
> Issue Type: Sub-task
> Components: Flink Engine
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>
> There is a wrong key mapping, it would cause critical exception :
> {code:java}
> java.lang.IllegalArgumentException: Unsupported Flink configuration pair :
> key[taskmanager.heap.size], value[1G] at
> org.apache.kylin.engine.flink.FlinkExecutable.doWork(FlinkExecutable.java:193)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #521: KYLIN-3876 Fix flink config option wrong key mapping
shaofengshi merged pull request #521: KYLIN-3876 Fix flink config option wrong key mapping URL: https://github.com/apache/kylin/pull/521 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Comment Edited] (KYLIN-3682) Error while building sample cube with spark ava.lang.NoClassDefFoundError: Could not initialize class org.apache.kylin.metadata.datatype.DataType
[
https://issues.apache.org/jira/browse/KYLIN-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793879#comment-16793879
]
Gaurav Rawat edited comment on KYLIN-3682 at 3/15/19 7:19 PM:
--
[~Wayne0101] thanks for your help it finally worked when I copied
kylin.properties into executor node (y).looks the error is actually because of
not able to locate kylin.properties .
Do we need to set these up on the child executor nodes as well in a spark
cluster ?
was (Author: gauravbrills):
[~Wayne0101] looks the error is actually because of not able to locate
kylin.properties . But I see the same is there on the master node on spark .Do
we need to set these up on the child executor nodes as well ?
error
{code:java}
19/03/15 18:44:32 INFO scheduler.TaskSetManager: Starting task 1.0 in stage 0.0
(TID 1, ip-10-81-116-242.wfg1tst.cltest.wellmanage.com, executor 1, partition
1, RACK_LOCAL, 6113 bytes)
19/03/15 18:44:32 WARN scheduler.TaskSetManager: Lost task 0.0 in stage 0.0
(TID 0, ip-10-81-116-242.wfg1tst.cltest.wellmanage.com, executor 1):
java.lang.ExceptionInInitializerError
...
...
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1535)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:422)
at
org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:75)
at
org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:114)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:85)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:53)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: fail to locate kylin.properties
at
org.apache.kylin.common.KylinConfig.buildSiteOrderedProps(KylinConfig.java:350)
at org.apache.kylin.common.KylinConfig.buildSiteProperties(KylinConfig.java:316)
at org.apache.kylin.common.KylinConfig.getInstanceFromEnv(KylinConfig.java:97)
at org.apache.kylin.measure.MeasureTypeFactory.init(MeasureTypeFactory.java:119)
at
org.apache.kylin.measure.MeasureTypeFactory.(MeasureTypeFactory.java:97)
{code}
> Error while building sample cube with spark ava.lang.NoClassDefFoundError:
> Could not initialize class org.apache.kylin.metadata.datatype.DataType
> -
>
> Key: KYLIN-3682
> URL: https://issues.apache.org/jira/browse/KYLIN-3682
> Project: Kylin
> Issue Type: Bug
> Components: Integration
>Affects Versions: v2.5.0
> Environment: test
>Reporter: Gaurav Rawat
>Priority: Major
> Labels: starter
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HI I am having error at step #7 when building with Spark on AWS EMR, with
> mapreduce the same builds fine . The error I am getting is as below :-
> {code:java}
> 18/11/12 21:45:01 INFO yarn.Client:
>client token: N/A
>diagnostics: User class threw exception: java.lang.RuntimeException:
> error execute org.apache.kylin.storage.hbase.steps.SparkCubeHFile. Root
> cause: Job aborted due to stage failure: Task 1 in stage 0.0 failed 4 times,
> most recent failure: Lost task 1.3 in stage 0.0 (TID 8,
> ip-10-81-117-151.wfg1tst.cltest.wellmanage.com, executor 1):
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.kylin.metadata.datatype.DataType
> at java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
> at
> java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1787)
> at java.io.ObjectStreamClass.access$100(ObjectStreamClass.java:72)
> at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:253)
> at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:251)
> at java.security.AccessController.doPrivileged(Native Method)
> at
> java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:250)
> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:611)
> at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1843)
> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1713)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2000)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1535)
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2245)
> at
[jira] [Commented] (KYLIN-3682) Error while building sample cube with spark ava.lang.NoClassDefFoundError: Could not initialize class org.apache.kylin.metadata.datatype.DataType
[
https://issues.apache.org/jira/browse/KYLIN-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793879#comment-16793879
]
Gaurav Rawat commented on KYLIN-3682:
-
[~Wayne0101] looks the error is actually because of not able to locate
kylin.properties . But I see the same is there on the master node on spark .Do
we need to set these up on the child executor nodes as well ?
error
{code:java}
19/03/15 18:44:32 INFO scheduler.TaskSetManager: Starting task 1.0 in stage 0.0
(TID 1, ip-10-81-116-242.wfg1tst.cltest.wellmanage.com, executor 1, partition
1, RACK_LOCAL, 6113 bytes)
19/03/15 18:44:32 WARN scheduler.TaskSetManager: Lost task 0.0 in stage 0.0
(TID 0, ip-10-81-116-242.wfg1tst.cltest.wellmanage.com, executor 1):
java.lang.ExceptionInInitializerError
...
...
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1535)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:422)
at
org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:75)
at
org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:114)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:85)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:53)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: fail to locate kylin.properties
at
org.apache.kylin.common.KylinConfig.buildSiteOrderedProps(KylinConfig.java:350)
at org.apache.kylin.common.KylinConfig.buildSiteProperties(KylinConfig.java:316)
at org.apache.kylin.common.KylinConfig.getInstanceFromEnv(KylinConfig.java:97)
at org.apache.kylin.measure.MeasureTypeFactory.init(MeasureTypeFactory.java:119)
at
org.apache.kylin.measure.MeasureTypeFactory.(MeasureTypeFactory.java:97)
{code}
> Error while building sample cube with spark ava.lang.NoClassDefFoundError:
> Could not initialize class org.apache.kylin.metadata.datatype.DataType
> -
>
> Key: KYLIN-3682
> URL: https://issues.apache.org/jira/browse/KYLIN-3682
> Project: Kylin
> Issue Type: Bug
> Components: Integration
>Affects Versions: v2.5.0
> Environment: test
>Reporter: Gaurav Rawat
>Priority: Major
> Labels: starter
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> HI I am having error at step #7 when building with Spark on AWS EMR, with
> mapreduce the same builds fine . The error I am getting is as below :-
> {code:java}
> 18/11/12 21:45:01 INFO yarn.Client:
>client token: N/A
>diagnostics: User class threw exception: java.lang.RuntimeException:
> error execute org.apache.kylin.storage.hbase.steps.SparkCubeHFile. Root
> cause: Job aborted due to stage failure: Task 1 in stage 0.0 failed 4 times,
> most recent failure: Lost task 1.3 in stage 0.0 (TID 8,
> ip-10-81-117-151.wfg1tst.cltest.wellmanage.com, executor 1):
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.kylin.metadata.datatype.DataType
> at java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
> at
> java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1787)
> at java.io.ObjectStreamClass.access$100(ObjectStreamClass.java:72)
> at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:253)
> at java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:251)
> at java.security.AccessController.doPrivileged(Native Method)
> at
> java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:250)
> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:611)
> at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1843)
> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1713)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2000)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1535)
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2245)
> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2169)
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2027)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1535)
> at java.io.ObjectInputStream.readArray(ObjectInputStream.java:1933)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1529)
>
[GitHub] [kylin] codecov-io commented on issue #522: KYLIN-3817: Duration in Cube building is a negative number
codecov-io commented on issue #522: KYLIN-3817: Duration in Cube building is a negative number URL: https://github.com/apache/kylin/pull/522#issuecomment-473372929 # [Codecov](https://codecov.io/gh/apache/kylin/pull/522?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@756d582`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `100%`. [](https://codecov.io/gh/apache/kylin/pull/522?src=pr=tree) ```diff @@Coverage Diff@@ ## master #522 +/- ## = Coverage ? 24.44% Complexity? 5026 = Files ? 1160 Lines ?70390 Branches ?10013 = Hits ?17206 Misses?51448 Partials ? 1736 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/522?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [.../apache/kylin/job/execution/ExecutableManager.java](https://codecov.io/gh/apache/kylin/pull/522/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9leGVjdXRpb24vRXhlY3V0YWJsZU1hbmFnZXIuamF2YQ==) | `33.33% <100%> (ø)` | `35 <0> (?)` | | | [.../kylin/job/execution/DefaultChainedExecutable.java](https://codecov.io/gh/apache/kylin/pull/522/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9leGVjdXRpb24vRGVmYXVsdENoYWluZWRFeGVjdXRhYmxlLmphdmE=) | `66.99% <100%> (ø)` | `22 <0> (?)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/522?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/522?src=pr=footer). Last update [756d582...6693e33](https://codecov.io/gh/apache/kylin/pull/522?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Closed] (KYLIN-3871) Kylin inside Cloudera CDH Quickstart Sandbox
[ https://issues.apache.org/jira/browse/KYLIN-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanwen Lin closed KYLIN-3871. - Resolution: Workaround Use Hortonworks HDP as a workaround > Kylin inside Cloudera CDH Quickstart Sandbox > > > Key: KYLIN-3871 > URL: https://issues.apache.org/jira/browse/KYLIN-3871 > Project: Kylin > Issue Type: Test > Components: Job Engine, Real-time Streaming >Affects Versions: v2.6.0 > Environment: Cloudera Quickstart Docker image: > - OS: centos6 > - memory: 13GB > - disk: 20GB > - java: 1.8 > - maven: 3.5.3 >Reporter: Yanwen Lin >Priority: Blocker > > When doing integration test, I met the following error. I know this is > related to Java version error and the reason is that Kylin use java1.8 while > Cloudera use java1.7. So I manually installed java 1.8 and set JAVA_HOME to > point to Spark2.x. (I also type spark-submit --version to check this). But > the bug did not go away. I guess during the process of Spark job, some > command may change the Java version back to java1.7 (not sure). Is there > anyway to force it not change back to Java1.7 or any workaround? > I have successfully finished maven installing and unit tests. > *Branch:* > realtime-streaming > *Executed command with problem:* > mvn verify -fae -Dhdp.version=2.4.0.0-169 -P sandbox > *Error stack:* > Exception in thread "main" java.lang.UnsupportedClassVersionError: > org/apache/spark/network/util/ByteUnit : Unsupported major.minor version 52.0 > at java.lang.ClassLoader.defineClass1(Native Method) > at java.lang.ClassLoader.defineClass(ClassLoader.java:800) > at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) > at java.net.URLClassLoader.access$100(URLClassLoader.java:71) > at java.net.URLClassLoader$1.run(URLClassLoader.java:361) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > at org.apache.spark.deploy.history.config$.(config.scala:44) > at org.apache.spark.deploy.history.config$.(config.scala) > at org.apache.spark.SparkConf$.(SparkConf.scala:635) > at org.apache.spark.SparkConf$.(SparkConf.scala) > at org.apache.spark.SparkConf.set(SparkConf.scala:94) > at > org.apache.spark.SparkConf$$anonfun$loadFromSystemProperties$3.apply(SparkConf.scala:76) > at > org.apache.spark.SparkConf$$anonfun$loadFromSystemProperties$3.apply(SparkConf.scala:75) > at > scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733) > at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221) > at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428) > at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428) > at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428) > at > scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:732) > at org.apache.spark.SparkConf.loadFromSystemProperties(SparkConf.scala:75) > at org.apache.spark.SparkConf.(SparkConf.scala:70) > at org.apache.spark.SparkConf.(SparkConf.scala:57) > at > org.apache.spark.deploy.yarn.ApplicationMaster.(ApplicationMaster.scala:62) > at > org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:838) > at > org.apache.spark.deploy.yarn.ExecutorLauncher$.main(ApplicationMaster.scala:869) > at > org.apache.spark.deploy.yarn.ExecutorLauncher.main(ApplicationMaster.scala) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3817) Duration in Cube building is a negative number
[ https://issues.apache.org/jira/browse/KYLIN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793740#comment-16793740 ] ASF GitHub Bot commented on KYLIN-3817: --- lshmouse commented on pull request #522: KYLIN-3817: Duration in Cube building is a negative number URL: https://github.com/apache/kylin/pull/522 See KYLIN-3817. After building the cube for a few minutes, click the Refresh button and the duration of the job becomes negative. This bug is introduced in KYLIN-3780: https://github.com/apache/kylin/pull/442/commits/b3728040e39bf32412624907e493f666c49dfb5c This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Duration in Cube building is a negative number > -- > > Key: KYLIN-3817 > URL: https://issues.apache.org/jira/browse/KYLIN-3817 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.6.0 >Reporter: Na Zhai >Assignee: Na Zhai >Priority: Major > Fix For: v2.6.2 > > Attachments: Duration error.png > > > After building the cube for a few minutes, click the Refresh button and the > duration of the job becomes negative. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] lshmouse opened a new pull request #522: KYLIN-3817: Duration in Cube building is a negative number
lshmouse opened a new pull request #522: KYLIN-3817: Duration in Cube building is a negative number URL: https://github.com/apache/kylin/pull/522 See KYLIN-3817. After building the cube for a few minutes, click the Refresh button and the duration of the job becomes negative. This bug is introduced in KYLIN-3780: https://github.com/apache/kylin/pull/442/commits/b3728040e39bf32412624907e493f666c49dfb5c This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #522: KYLIN-3817: Duration in Cube building is a negative number
asfgit commented on issue #522: KYLIN-3817: Duration in Cube building is a negative number URL: https://github.com/apache/kylin/pull/522#issuecomment-473343458 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #522: KYLIN-3817: Duration in Cube building is a negative number
asfgit commented on issue #522: KYLIN-3817: Duration in Cube building is a negative number URL: https://github.com/apache/kylin/pull/522#issuecomment-473343452 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3817) Duration in Cube building is a negative number
[ https://issues.apache.org/jira/browse/KYLIN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793699#comment-16793699 ] Liu Shaohui commented on KYLIN-3817: Sorry for this bug which is introduced in KYLIN-3780.I will fix later. > Duration in Cube building is a negative number > -- > > Key: KYLIN-3817 > URL: https://issues.apache.org/jira/browse/KYLIN-3817 > Project: Kylin > Issue Type: Bug >Affects Versions: v2.6.0 >Reporter: Na Zhai >Assignee: Na Zhai >Priority: Major > Fix For: v2.6.2 > > Attachments: Duration error.png > > > After building the cube for a few minutes, click the Refresh button and the > duration of the job becomes negative. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3878) NPE to run sonar analysis
Shaofeng SHI created KYLIN-3878: --- Summary: NPE to run sonar analysis Key: KYLIN-3878 URL: https://issues.apache.org/jira/browse/KYLIN-3878 Project: Kylin Issue Type: Test Components: Tools, Build and Test Reporter: Shaofeng SHI mvn sonar:sonar -Dsonar.host.url=https://sonarcloud.io -Dsonar.organization=kylin -e [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 03:13 min [INFO] Finished at: 2019-03-15T14:42:16Z [INFO] [ERROR] Failed to execute goal org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar (default-cli) on project kylin: null: MojoExecutionException: NullPointerException -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar (default-cli) on project kylin: null at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356) Caused by: org.apache.maven.plugin.MojoExecutionException at org.sonarsource.scanner.maven.bootstrap.ScannerBootstrapper.execute (ScannerBootstrapper.java:67) at org.sonarsource.scanner.maven.SonarQubeMojo.execute (SonarQubeMojo.java:104) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:208) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356) Caused by: java.lang.NullPointerException at org.A.E.get
[GitHub] [kylin] codecov-io commented on issue #521: KYLIN-3876 Fix flink config option wrong key mapping
codecov-io commented on issue #521: KYLIN-3876 Fix flink config option wrong key mapping URL: https://github.com/apache/kylin/pull/521#issuecomment-473285536 # [Codecov](https://codecov.io/gh/apache/kylin/pull/521?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`engine-flink@cc4128f`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0%`. [](https://codecov.io/gh/apache/kylin/pull/521?src=pr=tree) ```diff @@ Coverage Diff @@ ## engine-flink #521 +/- ## === Coverage? 24.27% Complexity ? 5029 === Files ? 1166 Lines ?70903 Branches?10078 === Hits?17215 Misses ?51948 Partials? 1740 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/521?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...e/kylin/engine/flink/FlinkOnYarnConfigMapping.java](https://codecov.io/gh/apache/kylin/pull/521/diff?src=pr=tree#diff-ZW5naW5lLWZsaW5rL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9lbmdpbmUvZmxpbmsvRmxpbmtPbllhcm5Db25maWdNYXBwaW5nLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/521?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/521?src=pr=footer). Last update [cc4128f...64ec3f3](https://codecov.io/gh/apache/kylin/pull/521?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] codecov-io commented on issue #520: KYLIN-3850 Flink cubing step : merge by layer
codecov-io commented on issue #520: KYLIN-3850 Flink cubing step : merge by layer URL: https://github.com/apache/kylin/pull/520#issuecomment-473278531 # [Codecov](https://codecov.io/gh/apache/kylin/pull/520?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`engine-flink@cc4128f`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0%`. [](https://codecov.io/gh/apache/kylin/pull/520?src=pr=tree) ```diff @@ Coverage Diff @@ ## engine-flink #520 +/- ## === Coverage? 24.23% Complexity ? 5029 === Files ? 1167 Lines ?71042 Branches?10088 === Hits?17220 Misses ?52083 Partials? 1739 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/520?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...rg/apache/kylin/engine/flink/FlinkCubingMerge.java](https://codecov.io/gh/apache/kylin/pull/520/diff?src=pr=tree#diff-ZW5naW5lLWZsaW5rL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9lbmdpbmUvZmxpbmsvRmxpbmtDdWJpbmdNZXJnZS5qYXZh) | `0% <0%> (ø)` | `0 <0> (?)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/520?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/520?src=pr=footer). Last update [cc4128f...87a86a5](https://codecov.io/gh/apache/kylin/pull/520?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] shaofengshi merged pull request #518: Update Kylin configuration
shaofengshi merged pull request #518: Update Kylin configuration URL: https://github.com/apache/kylin/pull/518 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3877) Add flink specific config items for kylin properties configuration files
vinoyang created KYLIN-3877: --- Summary: Add flink specific config items for kylin properties configuration files Key: KYLIN-3877 URL: https://issues.apache.org/jira/browse/KYLIN-3877 Project: Kylin Issue Type: Sub-task Components: Flink Engine Reporter: vinoyang Assignee: vinoyang Add Flink specific configuration, such as JM/TM memory, slot num and so on. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3876) Fix flink config option wrong key mapping
[
https://issues.apache.org/jira/browse/KYLIN-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793584#comment-16793584
]
ASF GitHub Bot commented on KYLIN-3876:
---
yanghua commented on pull request #521: KYLIN-3876 Fix flink config option
wrong key mapping
URL: https://github.com/apache/kylin/pull/521
JIRA ref : https://issues.apache.org/jira/browse/KYLIN-3876
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Fix flink config option wrong key mapping
> -
>
> Key: KYLIN-3876
> URL: https://issues.apache.org/jira/browse/KYLIN-3876
> Project: Kylin
> Issue Type: Sub-task
> Components: Flink Engine
>Reporter: vinoyang
>Assignee: vinoyang
>Priority: Major
>
> There is a wrong key mapping, it would cause critical exception :
> {code:java}
> java.lang.IllegalArgumentException: Unsupported Flink configuration pair :
> key[taskmanager.heap.size], value[1G] at
> org.apache.kylin.engine.flink.FlinkExecutable.doWork(FlinkExecutable.java:193)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] asfgit commented on issue #521: KYLIN-3876 Fix flink config option wrong key mapping
asfgit commented on issue #521: KYLIN-3876 Fix flink config option wrong key mapping URL: https://github.com/apache/kylin/pull/521#issuecomment-473266045 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] yanghua opened a new pull request #521: KYLIN-3876 Fix flink config option wrong key mapping
yanghua opened a new pull request #521: KYLIN-3876 Fix flink config option wrong key mapping URL: https://github.com/apache/kylin/pull/521 JIRA ref : https://issues.apache.org/jira/browse/KYLIN-3876 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3876) Fix flink config option wrong key mapping
vinoyang created KYLIN-3876:
---
Summary: Fix flink config option wrong key mapping
Key: KYLIN-3876
URL: https://issues.apache.org/jira/browse/KYLIN-3876
Project: Kylin
Issue Type: Sub-task
Components: Flink Engine
Reporter: vinoyang
Assignee: vinoyang
There is a wrong key mapping, it would cause critical exception :
{code:java}
java.lang.IllegalArgumentException: Unsupported Flink configuration pair :
key[taskmanager.heap.size], value[1G] at
org.apache.kylin.engine.flink.FlinkExecutable.doWork(FlinkExecutable.java:193)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3850) Flink cubing step : merge by layer
[ https://issues.apache.org/jira/browse/KYLIN-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793582#comment-16793582 ] ASF GitHub Bot commented on KYLIN-3850: --- yanghua commented on pull request #520: KYLIN-3850 Flink cubing step : merge by layer URL: https://github.com/apache/kylin/pull/520 JIRA ref : https://issues.apache.org/jira/browse/KYLIN-3850 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Flink cubing step : merge by layer > -- > > Key: KYLIN-3850 > URL: https://issues.apache.org/jira/browse/KYLIN-3850 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] yanghua opened a new pull request #520: KYLIN-3850 Flink cubing step : merge by layer
yanghua opened a new pull request #520: KYLIN-3850 Flink cubing step : merge by layer URL: https://github.com/apache/kylin/pull/520 JIRA ref : https://issues.apache.org/jira/browse/KYLIN-3850 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #520: KYLIN-3850 Flink cubing step : merge by layer
asfgit commented on issue #520: KYLIN-3850 Flink cubing step : merge by layer URL: https://github.com/apache/kylin/pull/520#issuecomment-473264173 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] codecov-io edited a comment on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
codecov-io edited a comment on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters URL: https://github.com/apache/kylin/pull/516#issuecomment-472811473 # [Codecov](https://codecov.io/gh/apache/kylin/pull/516?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@7b88a99`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0%`. [](https://codecov.io/gh/apache/kylin/pull/516?src=pr=tree) ```diff @@Coverage Diff@@ ## master #516 +/- ## = Coverage ? 24.43% Complexity? 5024 = Files ? 1160 Lines ?70398 Branches ?10013 = Hits ?17202 Misses?51459 Partials ? 1737 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/516?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...apache/kylin/storage/hbase/steps/CubeHFileJob.java](https://codecov.io/gh/apache/kylin/pull/516/diff?src=pr=tree#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9DdWJlSEZpbGVKb2IuamF2YQ==) | `0% <0%> (ø)` | `0 <0> (?)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/516?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/516?src=pr=footer). Last update [7b88a99...e7e05f5](https://codecov.io/gh/apache/kylin/pull/516?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] codecov-io edited a comment on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
codecov-io edited a comment on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters URL: https://github.com/apache/kylin/pull/516#issuecomment-472811473 # [Codecov](https://codecov.io/gh/apache/kylin/pull/516?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@7b88a99`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0%`. [](https://codecov.io/gh/apache/kylin/pull/516?src=pr=tree) ```diff @@Coverage Diff@@ ## master #516 +/- ## = Coverage ? 24.43% Complexity? 5024 = Files ? 1160 Lines ?70390 Branches ?10013 = Hits ?17202 Misses?51452 Partials ? 1736 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/516?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...apache/kylin/storage/hbase/steps/CubeHFileJob.java](https://codecov.io/gh/apache/kylin/pull/516/diff?src=pr=tree#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9DdWJlSEZpbGVKb2IuamF2YQ==) | `0% <0%> (ø)` | `0 <0> (?)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/516?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/516?src=pr=footer). Last update [7b88a99...1682078](https://codecov.io/gh/apache/kylin/pull/516?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] codecov-io edited a comment on issue #515: KYLIN-3841 Build Global Dict by MR/Hive
codecov-io edited a comment on issue #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515#issuecomment-472747723 # [Codecov](https://codecov.io/gh/apache/kylin/pull/515?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@d23d2bd`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0.26%`. [](https://codecov.io/gh/apache/kylin/pull/515?src=pr=tree) ```diff @@Coverage Diff@@ ## master #515 +/- ## = Coverage ? 24.31% Complexity? 5024 = Files ? 1162 Lines ?70763 Branches ?10068 = Hits ?17205 Misses?51823 Partials ? 1735 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/515?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...ain/java/org/apache/kylin/job/JoinedFlatTable.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9Kb2luZWRGbGF0VGFibGUuamF2YQ==) | `0% <ø> (ø)` | `0 <0> (?)` | | | [.../java/org/apache/kylin/common/KylinConfigBase.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9LeWxpbkNvbmZpZ0Jhc2UuamF2YQ==) | `13.92% <0%> (ø)` | `41 <0> (?)` | | | [...apache/kylin/measure/bitmap/BitmapMeasureType.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vbWVhc3VyZS9iaXRtYXAvQml0bWFwTWVhc3VyZVR5cGUuamF2YQ==) | `18.86% <0%> (ø)` | `4 <0> (?)` | | | [...ain/java/org/apache/kylin/cube/model/CubeDesc.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL21vZGVsL0N1YmVEZXNjLmphdmE=) | `63.44% <0%> (ø)` | `179 <0> (?)` | | | [...rg/apache/kylin/source/hive/BeelineHiveClient.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0JlZWxpbmVIaXZlQ2xpZW50LmphdmE=) | `4.05% <0%> (ø)` | `5 <0> (?)` | | | [...apache/kylin/source/hive/CreateMrHiveDictStep.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0NyZWF0ZU1ySGl2ZURpY3RTdGVwLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...va/org/apache/kylin/source/hive/HiveInputBase.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0hpdmVJbnB1dEJhc2UuamF2YQ==) | `7.54% <0%> (ø)` | `4 <0> (?)` | | | [...va/org/apache/kylin/source/hive/CLIHiveClient.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0NMSUhpdmVDbGllbnQuamF2YQ==) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...lin/engine/mr/steps/FactDistinctColumnsMapper.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-ZW5naW5lLW1yL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9lbmdpbmUvbXIvc3RlcHMvRmFjdERpc3RpbmN0Q29sdW1uc01hcHBlci5qYXZh) | `5.17% <0%> (ø)` | `0 <0> (?)` | | | [...a/org/apache/kylin/source/hive/MRHiveDictUtil.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL01SSGl2ZURpY3RVdGlsLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | ... and [3 more](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/515?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/515?src=pr=footer). Last update [d23d2bd...e66b357](https://codecov.io/gh/apache/kylin/pull/515?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please
[GitHub] [kylin] coveralls edited a comment on issue #515: KYLIN-3841 Build Global Dict by MR/Hive
coveralls edited a comment on issue #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515#issuecomment-473231956 ## Pull Request Test Coverage Report for [Build 4240](https://coveralls.io/builds/22200959) * **1** of **375** **(0.27%)** changed or added relevant lines in **12** files are covered. * **8** unchanged lines in **5** files lost coverage. * Overall coverage decreased (**-0.1%**) to **26.771%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [core-metadata/src/main/java/org/apache/kylin/measure/bitmap/BitmapMeasureType.java](https://coveralls.io/builds/22200959/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmeasure%2Fbitmap%2FBitmapMeasureType.java#L154) | 0 | 2 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/model/FunctionDesc.java](https://coveralls.io/builds/22200959/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fmodel%2FFunctionDesc.java#L95) | 1 | 4 | 25.0% | [core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java](https://coveralls.io/builds/22200959/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FKylinConfigBase.java#L1344) | 0 | 6 | 0.0% | [core-cube/src/main/java/org/apache/kylin/cube/util/KeyValueBuilder.java](https://coveralls.io/builds/22200959/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Futil%2FKeyValueBuilder.java#L95) | 0 | 6 | 0.0% | [engine-mr/src/main/java/org/apache/kylin/engine/mr/steps/FactDistinctColumnsMapper.java](https://coveralls.io/builds/22200959/source?filename=engine-mr%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fmr%2Fsteps%2FFactDistinctColumnsMapper.java#L175) | 0 | 7 | 0.0% | [core-cube/src/main/java/org/apache/kylin/cube/model/CubeDesc.java](https://coveralls.io/builds/22200959/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fmodel%2FCubeDesc.java#L1344) | 0 | 10 | 0.0% | [source-hive/src/main/java/org/apache/kylin/source/hive/BeelineHiveClient.java](https://coveralls.io/builds/22200959/source?filename=source-hive%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fsource%2Fhive%2FBeelineHiveClient.java#L129) | 0 | 14 | 0.0% | [engine-mr/src/main/java/org/apache/kylin/engine/mr/common/BaseCuboidBuilder.java](https://coveralls.io/builds/22200959/source?filename=engine-mr%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fmr%2Fcommon%2FBaseCuboidBuilder.java#L109) | 0 | 15 | 0.0% | [source-hive/src/main/java/org/apache/kylin/source/hive/CLIHiveClient.java](https://coveralls.io/builds/22200959/source?filename=source-hive%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fsource%2Fhive%2FCLIHiveClient.java#L135) | 0 | 16 | 0.0% | [source-hive/src/main/java/org/apache/kylin/source/hive/MRHiveDictUtil.java](https://coveralls.io/builds/22200959/source?filename=source-hive%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fsource%2Fhive%2FMRHiveDictUtil.java#L27) | 0 | 46 | 0.0% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java](https://coveralls.io/builds/22200959/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FKylinConfigBase.java#L1337) | 1 | 15.1% | | [engine-mr/src/main/java/org/apache/kylin/engine/mr/common/BaseCuboidBuilder.java](https://coveralls.io/builds/22200959/source?filename=engine-mr%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fmr%2Fcommon%2FBaseCuboidBuilder.java#L136) | 1 | 0.0% | | [core-cube/src/main/java/org/apache/kylin/cube/model/CubeDesc.java](https://coveralls.io/builds/22200959/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fmodel%2FCubeDesc.java#L1359) | 1 | 69.71% | | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultScheduler.java](https://coveralls.io/builds/22200959/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultScheduler.java#L194) | 2 | 80.23% | | [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/22200959/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L449) | 3 | 78.42% | | Totals | [](https://coveralls.io/builds/22200959) | | :-- | --: | | Change from base [Build 4236](https://coveralls.io/builds/22195903): | -0.1% | | Covered Lines: | 18944 | | Relevant Lines: | 70763 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To
[GitHub] [kylin] shaofengshi commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive
shaofengshi commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515#issuecomment-473238649 Hi Guowei, can you use seperated PR for the changes of count(col)? Thank you! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] coveralls commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive
coveralls commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515#issuecomment-473231956 ## Pull Request Test Coverage Report for [Build 4239](https://coveralls.io/builds/22200495) * **1** of **369** **(0.27%)** changed or added relevant lines in **11** files are covered. * **6** unchanged lines in **4** files lost coverage. * Overall coverage decreased (**-0.1%**) to **26.777%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [core-metadata/src/main/java/org/apache/kylin/measure/bitmap/BitmapMeasureType.java](https://coveralls.io/builds/22200495/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmeasure%2Fbitmap%2FBitmapMeasureType.java#L154) | 0 | 2 | 0.0% | [core-metadata/src/main/java/org/apache/kylin/metadata/model/FunctionDesc.java](https://coveralls.io/builds/22200495/source?filename=core-metadata%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fmetadata%2Fmodel%2FFunctionDesc.java#L95) | 1 | 4 | 25.0% | [core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java](https://coveralls.io/builds/22200495/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FKylinConfigBase.java#L1344) | 0 | 6 | 0.0% | [engine-mr/src/main/java/org/apache/kylin/engine/mr/steps/FactDistinctColumnsMapper.java](https://coveralls.io/builds/22200495/source?filename=engine-mr%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fmr%2Fsteps%2FFactDistinctColumnsMapper.java#L175) | 0 | 7 | 0.0% | [core-cube/src/main/java/org/apache/kylin/cube/model/CubeDesc.java](https://coveralls.io/builds/22200495/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fmodel%2FCubeDesc.java#L1344) | 0 | 10 | 0.0% | [source-hive/src/main/java/org/apache/kylin/source/hive/BeelineHiveClient.java](https://coveralls.io/builds/22200495/source?filename=source-hive%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fsource%2Fhive%2FBeelineHiveClient.java#L129) | 0 | 14 | 0.0% | [engine-mr/src/main/java/org/apache/kylin/engine/mr/common/BaseCuboidBuilder.java](https://coveralls.io/builds/22200495/source?filename=engine-mr%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fmr%2Fcommon%2FBaseCuboidBuilder.java#L109) | 0 | 15 | 0.0% | [source-hive/src/main/java/org/apache/kylin/source/hive/CLIHiveClient.java](https://coveralls.io/builds/22200495/source?filename=source-hive%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fsource%2Fhive%2FCLIHiveClient.java#L135) | 0 | 16 | 0.0% | [source-hive/src/main/java/org/apache/kylin/source/hive/MRHiveDictUtil.java](https://coveralls.io/builds/22200495/source?filename=source-hive%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fsource%2Fhive%2FMRHiveDictUtil.java#L27) | 0 | 46 | 0.0% | [source-hive/src/main/java/org/apache/kylin/source/hive/HiveInputBase.java](https://coveralls.io/builds/22200495/source?filename=source-hive%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fsource%2Fhive%2FHiveInputBase.java#L92) | 0 | 87 | 0.0% | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java](https://coveralls.io/builds/22200495/source?filename=core-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcommon%2FKylinConfigBase.java#L1337) | 1 | 15.1% | | [engine-mr/src/main/java/org/apache/kylin/engine/mr/common/BaseCuboidBuilder.java](https://coveralls.io/builds/22200495/source?filename=engine-mr%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fmr%2Fcommon%2FBaseCuboidBuilder.java#L136) | 1 | 0.0% | | [core-cube/src/main/java/org/apache/kylin/cube/model/CubeDesc.java](https://coveralls.io/builds/22200495/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fmodel%2FCubeDesc.java#L1359) | 1 | 69.71% | | [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/22200495/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L449) | 3 | 78.42% | | Totals | [](https://coveralls.io/builds/22200495) | | :-- | --: | | Change from base [Build 4236](https://coveralls.io/builds/22195903): | -0.1% | | Covered Lines: | 18947 | | Relevant Lines: | 70758 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] codecov-io edited a comment on issue #515: KYLIN-3841 Build Global Dict by MR/Hive
codecov-io edited a comment on issue #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515#issuecomment-472747723 # [Codecov](https://codecov.io/gh/apache/kylin/pull/515?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@d23d2bd`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0.27%`. [](https://codecov.io/gh/apache/kylin/pull/515?src=pr=tree) ```diff @@Coverage Diff@@ ## master #515 +/- ## = Coverage ? 24.31% Complexity? 5024 = Files ? 1162 Lines ?70758 Branches ?10066 = Hits ?17208 Misses?51815 Partials ? 1735 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/515?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...ain/java/org/apache/kylin/job/JoinedFlatTable.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9Kb2luZWRGbGF0VGFibGUuamF2YQ==) | `0% <ø> (ø)` | `0 <0> (?)` | | | [...apache/kylin/measure/bitmap/BitmapMeasureType.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vbWVhc3VyZS9iaXRtYXAvQml0bWFwTWVhc3VyZVR5cGUuamF2YQ==) | `18.86% <0%> (ø)` | `4 <0> (?)` | | | [...ain/java/org/apache/kylin/cube/model/CubeDesc.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL21vZGVsL0N1YmVEZXNjLmphdmE=) | `63.44% <0%> (ø)` | `179 <0> (?)` | | | [...rg/apache/kylin/source/hive/BeelineHiveClient.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0JlZWxpbmVIaXZlQ2xpZW50LmphdmE=) | `4.05% <0%> (ø)` | `5 <0> (?)` | | | [...apache/kylin/source/hive/CreateMrHiveDictStep.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0NyZWF0ZU1ySGl2ZURpY3RTdGVwLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...va/org/apache/kylin/source/hive/CLIHiveClient.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0NMSUhpdmVDbGllbnQuamF2YQ==) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...lin/engine/mr/steps/FactDistinctColumnsMapper.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-ZW5naW5lLW1yL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9lbmdpbmUvbXIvc3RlcHMvRmFjdERpc3RpbmN0Q29sdW1uc01hcHBlci5qYXZh) | `5.17% <0%> (ø)` | `0 <0> (?)` | | | [.../java/org/apache/kylin/common/KylinConfigBase.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9LeWxpbkNvbmZpZ0Jhc2UuamF2YQ==) | `13.92% <0%> (ø)` | `41 <0> (?)` | | | [...a/org/apache/kylin/source/hive/MRHiveDictUtil.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL01SSGl2ZURpY3RVdGlsLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...ache/kylin/engine/mr/common/BaseCuboidBuilder.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree#diff-ZW5naW5lLW1yL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9lbmdpbmUvbXIvY29tbW9uL0Jhc2VDdWJvaWRCdWlsZGVyLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | ... and [2 more](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/515?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/515?src=pr=footer). Last update [d23d2bd...6418169](https://codecov.io/gh/apache/kylin/pull/515?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please
[jira] [Updated] (KYLIN-3262) Produce jacoco exec files for integration test
[ https://issues.apache.org/jira/browse/KYLIN-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong Yanghong updated KYLIN-3262: -- Fix Version/s: v3.0.0 > Produce jacoco exec files for integration test > -- > > Key: KYLIN-3262 > URL: https://issues.apache.org/jira/browse/KYLIN-3262 > Project: Kylin > Issue Type: Task >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v3.0.0 > > Attachments: APACHE-KYLIN-3262.patch > > > Currently to calculate code coverage, kylin only considers UT. However, IT > also covers lots of code. It's better to include this for code coverage. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3262) Produce jacoco exec files for integration test
[ https://issues.apache.org/jira/browse/KYLIN-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI updated KYLIN-3262: Fix Version/s: (was: v3.0.0) v2.6.2 > Produce jacoco exec files for integration test > -- > > Key: KYLIN-3262 > URL: https://issues.apache.org/jira/browse/KYLIN-3262 > Project: Kylin > Issue Type: Task >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v2.6.2 > > Attachments: APACHE-KYLIN-3262.patch > > > Currently to calculate code coverage, kylin only considers UT. However, IT > also covers lots of code. It's better to include this for code coverage. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3571) Not build Spark in Kylin's binary package
[ https://issues.apache.org/jira/browse/KYLIN-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793505#comment-16793505 ] ASF subversion and git services commented on KYLIN-3571: Commit 5bf3431a21057bde6d3bb627997a6167d1bf7c2a in kylin's branch refs/heads/2.6.x from Shao Feng Shi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5bf3431 ] KYLIN-3571 give a message to user when spark not found > Not build Spark in Kylin's binary package > - > > Key: KYLIN-3571 > URL: https://issues.apache.org/jira/browse/KYLIN-3571 > Project: Kylin > Issue Type: Improvement > Components: Environment >Reporter: Shaofeng SHI >Assignee: Chao Long >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3262) Produce jacoco exec files for integration test
[ https://issues.apache.org/jira/browse/KYLIN-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793504#comment-16793504 ] ASF GitHub Bot commented on KYLIN-3262: --- shaofengshi commented on pull request #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder URL: https://github.com/apache/kylin/pull/519 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Produce jacoco exec files for integration test > -- > > Key: KYLIN-3262 > URL: https://issues.apache.org/jira/browse/KYLIN-3262 > Project: Kylin > Issue Type: Task >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v3.0.0 > > Attachments: APACHE-KYLIN-3262.patch > > > Currently to calculate code coverage, kylin only considers UT. However, IT > also covers lots of code. It's better to include this for code coverage. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3571) Not build Spark in Kylin's binary package
[ https://issues.apache.org/jira/browse/KYLIN-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793503#comment-16793503 ] ASF subversion and git services commented on KYLIN-3571: Commit 6b9a3d27c3e29bd698a8a39d3dd945fbb61657da in kylin's branch refs/heads/master from Shao Feng Shi [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=6b9a3d2 ] KYLIN-3571 give a message to user when spark not found > Not build Spark in Kylin's binary package > - > > Key: KYLIN-3571 > URL: https://issues.apache.org/jira/browse/KYLIN-3571 > Project: Kylin > Issue Type: Improvement > Components: Environment >Reporter: Shaofeng SHI >Assignee: Chao Long >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder
shaofengshi merged pull request #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder URL: https://github.com/apache/kylin/pull/519 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Assigned] (KYLIN-3862) Check the binary packages
[ https://issues.apache.org/jira/browse/KYLIN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI reassigned KYLIN-3862: --- Assignee: Shaofeng SHI > Check the binary packages > - > > Key: KYLIN-3862 > URL: https://issues.apache.org/jira/browse/KYLIN-3862 > Project: Kylin > Issue Type: Task >Reporter: Shaofeng SHI >Assignee: Shaofeng SHI >Priority: Major > > As to the approval of binary packages: > > It's not possible in general to check the exact contents of a binary, however > there are some checks that should be made: > - sigs and hashes must be OK > - the package must contain the correct NOTICE and LICENSE files for the > included content > - the package must not contain any content not derived from the source. > - in the case of bundled binaries, reviewers must check that all contents are > represented in the LICENSE (and NOTICE file if required). > The bundle must not contain any files that are prohibited from distribution > (category X). -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] codecov-io commented on issue #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder
codecov-io commented on issue #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder URL: https://github.com/apache/kylin/pull/519#issuecomment-473217495 # [Codecov](https://codecov.io/gh/apache/kylin/pull/519?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@d23d2bd`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/kylin/pull/519?src=pr=tree) ```diff @@Coverage Diff@@ ## master #519 +/- ## = Coverage ? 24.44% Complexity? 5023 = Files ? 1160 Lines ?70390 Branches ?10013 = Hits ?17204 Misses?51450 Partials ? 1736 ``` -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/519?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/519?src=pr=footer). Last update [d23d2bd...263eb98](https://codecov.io/gh/apache/kylin/pull/519?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] coveralls commented on issue #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder
coveralls commented on issue #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder URL: https://github.com/apache/kylin/pull/519#issuecomment-473216714 ## Pull Request Test Coverage Report for [Build 4238](https://coveralls.io/builds/22199737) * **0** of **0** changed or added relevant lines in **0** files are covered. * **6** unchanged lines in **2** files lost coverage. * Overall coverage increased (+**0.003%**) to **26.913%** --- | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultScheduler.java](https://coveralls.io/builds/22199737/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultScheduler.java#L194) | 2 | 80.23% | | [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/22199737/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L449) | 4 | 78.12% | | Totals | [](https://coveralls.io/builds/22199737) | | :-- | --: | | Change from base [Build 4236](https://coveralls.io/builds/22195903): | 0.003% | | Covered Lines: | 18944 | | Relevant Lines: | 70390 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3262) Produce jacoco exec files for integration test
[ https://issues.apache.org/jira/browse/KYLIN-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793465#comment-16793465 ] Zhong Yanghong commented on KYLIN-3262: --- Hi [~Shaofengshi], This can be refined by adding a copy phase. The related PR is https://github.com/apache/kylin/pull/519/commits/263eb982593c72843c9f31661fea7afc7368e97e > Produce jacoco exec files for integration test > -- > > Key: KYLIN-3262 > URL: https://issues.apache.org/jira/browse/KYLIN-3262 > Project: Kylin > Issue Type: Task >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Attachments: APACHE-KYLIN-3262.patch > > > Currently to calculate code coverage, kylin only considers UT. However, IT > also covers lots of code. It's better to include this for code coverage. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] asfgit commented on issue #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder
asfgit commented on issue #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder URL: https://github.com/apache/kylin/pull/519#issuecomment-473205781 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3262) Produce jacoco exec files for integration test
[ https://issues.apache.org/jira/browse/KYLIN-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793464#comment-16793464 ] ASF GitHub Bot commented on KYLIN-3262: --- kyotoYaho commented on pull request #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder URL: https://github.com/apache/kylin/pull/519 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Produce jacoco exec files for integration test > -- > > Key: KYLIN-3262 > URL: https://issues.apache.org/jira/browse/KYLIN-3262 > Project: Kylin > Issue Type: Task >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Attachments: APACHE-KYLIN-3262.patch > > > Currently to calculate code coverage, kylin only considers UT. However, IT > also covers lots of code. It's better to include this for code coverage. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] kyotoYaho opened a new pull request #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder
kyotoYaho opened a new pull request #519: KYLIN-3262 add a copy phase for copying jacoco related jars to dev-support folder URL: https://github.com/apache/kylin/pull/519 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] guangxuCheng commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
guangxuCheng commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters URL: https://github.com/apache/kylin/pull/516#issuecomment-473205800 Re-review the logic of this block, we only need to add the information about the nameservice of HBase's HDFS to the configuration. The patch has been updated.Thanks This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] guangxuCheng commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
guangxuCheng commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters URL: https://github.com/apache/kylin/pull/516#issuecomment-473199409 Sorry, There is a small problem here. After modification, it may cause the configuration in "kylin_job_conf.xml" to be overwritten. Let me prepare a new patch, thanks! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3875) During cube or model design, from 1th-step jump to 4th-step doesn't check validity of step between 1th-step and 4th-step, which click next button does.
Yuzhang QIU created KYLIN-3875: -- Summary: During cube or model design, from 1th-step jump to 4th-step doesn't check validity of step between 1th-step and 4th-step, which click next button does. Key: KYLIN-3875 URL: https://issues.apache.org/jira/browse/KYLIN-3875 Project: Kylin Issue Type: Bug Components: Web Affects Versions: v2.5.2 Reporter: Yuzhang QIU Hi dear team: I found a minor problem in webapp. When I designing a model, I clear all dimension and click next. Then an alert window show the warnning about null dimension. But when I return to pre step and click "Measure" step, it pass and can be saved successfully. May be same problems will happen when design an cube. How do you think about this? Best regards yuzhang -- This message was sent by Atlassian JIRA (v7.6.3#76005)
