[GitHub] [kylin] alomais commented on a change in pull request #1751: add hudi source integration
alomais commented on a change in pull request #1751:
URL: https://github.com/apache/kylin/pull/1751#discussion_r743391464
##
File path:
core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java
##
@@ -35,15 +35,8 @@
import java.io.File;
import java.io.IOException;
import java.io.Serializable;
-import java.util.Arrays;
-import java.util.Collection;
-import java.util.List;
-import java.util.Locale;
-import java.util.Map;
Review comment:
Hey
##
File path:
core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java
##
@@ -889,6 +882,73 @@ public int getJobOutputMaxSize() {
return
Integer.parseInt(getOptional("kylin.job.execute-output.max-size", "10485760"));
Review comment:
Hey
##
File path:
core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java
##
@@ -35,15 +35,8 @@
import java.io.File;
import java.io.IOException;
import java.io.Serializable;
-import java.util.Arrays;
-import java.util.Collection;
-import java.util.List;
-import java.util.Locale;
-import java.util.Map;
Review comment:
What's up
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (KYLIN-5097) modify hive dict table format from textfile to orc
[ https://issues.apache.org/jira/browse/KYLIN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439020#comment-17439020 ] ASF GitHub Bot commented on KYLIN-5097: --- fengpod commented on pull request #1752: URL: https://github.com/apache/kylin/pull/1752#issuecomment-961616892 > I am not quite not sure if I need to merge this patch since it is **incompatible**. I know some Kylin user write program to read and parse the dict tables's file to decode the Bitmap into original literal values. I wonder if this patch may break these user. Compatible with the previous format, users can specify the table-format through configuration ‘kylin.dictionary.mr-hive.table.format’ 。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org > modify hive dict table format from textfile to orc > -- > > Key: KYLIN-5097 > URL: https://issues.apache.org/jira/browse/KYLIN-5097 > Project: Kylin > Issue Type: Bug >Affects Versions: v3.1.1, v3.1.2, v3.1.3 >Reporter: fengpod >Priority: Minor > > Textfile format end with ‘\n’ by default， when the data itself contains ‘\n’, > dict table may appear dirty data。 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] fengpod commented on pull request #1752: KYLIN-5097 modify hive dict table format from textfile to orc
fengpod commented on pull request #1752: URL: https://github.com/apache/kylin/pull/1752#issuecomment-961616892 > I am not quite not sure if I need to merge this patch since it is **incompatible**. I know some Kylin user write program to read and parse the dict tables's file to decode the Bitmap into original literal values. I wonder if this patch may break these user. Compatible with the previous format, users can specify the table-format through configuration ‘kylin.dictionary.mr-hive.table.format’ 。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4974) Kylin does not handle fucntion CURRENT_TIME().
[
https://issues.apache.org/jira/browse/KYLIN-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439008#comment-17439008
]
ASF subversion and git services commented on KYLIN-4974:
Commit db44b996187d4830b386163d58d7232e4f5667f5 in kylin's branch
refs/heads/master-hadoop3 from Alexander Sidorchuk
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=db44b99 ]
KYLIN-4974 add time serializer to handle CURRENT_TIME calcite function. (#1637)
Co-authored-by: alexandr.sidorchuk
> Kylin does not handle fucntion CURRENT_TIME().
> --
>
> Key: KYLIN-4974
> URL: https://issues.apache.org/jira/browse/KYLIN-4974
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: v3.1.1
>Reporter: Alexander
>Assignee: Alexander
>Priority: Minor
> Fix For: v3.1.3
>
>
> Select query:
> {code:java}
> ==[QUERY]===
> Query Id: 4e8c6498-9736-604f-ca84-c537e749448b
> SQL: select CURRENT_TIME() from KYLIN_SALES
> {code}
> Response:
> {code:java}
> org.apache.kylin.rest.exception.InternalErrorException: No DataTypeSerializer
> for type timeorg.apache.kylin.rest.exception.InternalErrorException: No
> DataTypeSerializer for type timewhile executing SQL: "select * from (select
> CURRENT_TIME() from KYLIN_SALES) limit 5" at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:486)
> at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:401)
> at
> org.apache.kylin.rest.controller.QueryController.query(QueryController.java:93)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-5054) Kylin_System project and cubes create time is wrong (1970).
[ https://issues.apache.org/jira/browse/KYLIN-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439007#comment-17439007 ] ASF subversion and git services commented on KYLIN-5054: Commit 14404f8338b4d442393614b4464afc21dc5a9d49 in kylin's branch refs/heads/master-hadoop3 from Sonu Kumar Singh [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=14404f8 ] KYLIN-5054 kylin_system's project and cubes create time is wrong 1970 > Kylin_System project and cubes create time is wrong (1970). > --- > > Key: KYLIN-5054 > URL: https://issues.apache.org/jira/browse/KYLIN-5054 > Project: Kylin > Issue Type: Bug > Components: Others >Affects Versions: v3.1.2 >Reporter: Sonu Kumar Singh >Assignee: Sonu Kumar Singh >Priority: Minor > Fix For: v3.1.3 > > > Kylin_System's project and cubes create time is 1970, that is wrong. It > should be current time when user will setup the Kylin_System project. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-5033) RealizationRegistry provider MUST always containing CubeManager
[ https://issues.apache.org/jira/browse/KYLIN-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439006#comment-17439006 ] ASF subversion and git services commented on KYLIN-5033: Commit 374eb82abd30d8bb6d2b724df599007b8e8432b2 in kylin's branch refs/heads/master-hadoop3 from yangjiang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=374eb82 ] [KYLIN-5033] RealizationRegistry provider MUST always containing CubeManager > RealizationRegistry provider MUST always containing CubeManager > > > Key: KYLIN-5033 > URL: https://issues.apache.org/jira/browse/KYLIN-5033 > Project: Kylin > Issue Type: Bug >Reporter: JiangYang >Assignee: JiangYang >Priority: Major > > if RealizationRegistry not contains CubeManager, will cause sql fail: > > Exception while executing queryException while executing > queryjava.sql.SQLException: Error while executing SQL "select * . group > by 1,2,3,4) limit 5": From line 1, column 104 to line 1, column 133: > Object 'PRS_RESTRICTED_V' not found at > org.apache.calcite.avatica.Helper.createException(Helper.java:56) at > org.apache.calcite.avatica.Helper.createException(Helper.java:41) at > org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:163) > at > org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:227) > at > org.apache.kylin.rest.service.QueryService.executeRequest(QueryService.java:1012) > at > org.apache.kylin.rest.service.QueryService.executeRequestWithSpan(QueryService.java:994) > at > org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:702) > at org.apache.kylin.rest.service.QueryService.query(QueryService.java:222) > at > org.apache.kylin.rest.service.QueryService.queryAndUpdateCache(QueryService.java:513) > at > org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:469) > at > org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:392) > at > org.apache.kylin.rest.controller.QueryController.query(QueryController.java:93) > at sun.reflect.GeneratedMethodAccessor128.invoke(Unknown Source) at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) > at > org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:849) > at > org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:760) > at > org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85) > at > org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967) > at > org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901) > at > org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970) > at > org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:647) at > org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:728) at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317) > at > org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127) > at > org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91) > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331) > at >
[jira] [Commented] (KYLIN-5032) Not allow change project for a cubeInstance.
[ https://issues.apache.org/jira/browse/KYLIN-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439004#comment-17439004 ] ASF subversion and git services commented on KYLIN-5032: Commit 42b913a5dd76daa03af4a717c87f7d0ed55ad6d1 in kylin's branch refs/heads/master-hadoop3 from yangjiang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=42b913a ] [KYLIN-5032] Not allow change project for a cubeInstance. (cherry picked from commit f8f52aff9c973abac2cc06c25ea99e3801044af0) > Not allow change project for a cubeInstance. > > > Key: KYLIN-5032 > URL: https://issues.apache.org/jira/browse/KYLIN-5032 > Project: Kylin > Issue Type: Improvement >Reporter: JiangYang >Assignee: JiangYang >Priority: Minor > Fix For: v3.1.3 > > > There are two project in Kylin: project1, project2. > Cube1 is in project1 now. > 1.Some one is in project2 (In KYLIN-UI) > 2.edit cube1 with url > [https:///kylin/cubes/edit/cube1|https://kylin.rno.corp.ebay.com/kylin/cubes/edit/PA_AUTO_TRACKING_GROUPS_SD_PROD_C_V2] > 3. then save, now cube1 is in project2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-5035) Fix Merge Cuboid Statistics EOFException
[ https://issues.apache.org/jira/browse/KYLIN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439005#comment-17439005 ] ASF subversion and git services commented on KYLIN-5035: Commit 85e70fb323c3758dfef9091626cd8bbe1f1a61a6 in kylin's branch refs/heads/master-hadoop3 from yangjiang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=85e70fb ] [KYLIN-5035] Fix Merge Cuboid Statistics EOFException. > Fix Merge Cuboid Statistics EOFException > > > Key: KYLIN-5035 > URL: https://issues.apache.org/jira/browse/KYLIN-5035 > Project: Kylin > Issue Type: Bug > Components: Job Engine, Spark Engine >Reporter: JiangYang >Assignee: JiangYang >Priority: Major > Fix For: v3.1.3 > > > org.apache.kylin.job.exception.ExecuteException: java.io.EOFException at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201) > at > org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) > at > org.apache.kylin.job.impl.threadpool.DistributedScheduler\$JobRunner.run(DistributedScheduler.java:238) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) Caused by: java.io.EOFException at > java.io.DataInputStream.readFully(DataInputStream.java:197) at > java.io.DataInputStream.readFully(DataInputStream.java:169) at > org.apache.hadoop.io.SequenceFile\$Reader.init(SequenceFile.java:1918) at > org.apache.hadoop.io.SequenceFile\$Reader.initialize(SequenceFile.java:1883) > at org.apache.hadoop.io.SequenceFile\$Reader.(SequenceFile.java:1832) at > org.apache.kylin.engine.mr.common.CubeStatsReader\$CubeStatsResult.(CubeStatsReader.java:484) > at > org.apache.kylin.engine.mr.common.CubeStatsReader.(CubeStatsReader.java:133) > at > org.apache.kylin.engine.mr.steps.MergeStatisticsWithOldStep.doWork(MergeStatisticsWithOldStep.java:97) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) > ... 6 more -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (KYLIN-5115) 执行mvn clean test报错
[ https://issues.apache.org/jira/browse/KYLIN-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingquanzhang closed KYLIN-5115. Resolution: Later > 执行mvn clean test报错 > -- > > Key: KYLIN-5115 > URL: https://issues.apache.org/jira/browse/KYLIN-5115 > Project: Kylin > Issue Type: Test >Affects Versions: v4.0.0 > Environment: windows10 > spark2.4.7 > maven3.5.4 > 未安装hadoop >Reporter: qingquanzhang >Priority: Major > Attachments: cmd_log.txt > > > 按照官网步骤一步一步在win10下搭建开发环境, > 代码是从git上拉取的kylin主分支的代码 > 但是执行mvn clean test后,有很多报错信息 > 完整的记录我上传到了附件中 > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4864) Support building and testing Kylin on ARM64 architecture platform
[ https://issues.apache.org/jira/browse/KYLIN-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438995#comment-17438995 ] ASF subversion and git services commented on KYLIN-4864: Commit 01cc8f00316e5334b500596785eeef0ed21af2d5 in kylin's branch refs/heads/main from Liu sheng [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=01cc8f0 ] [KYLIN-4864] Enable running Kylin tests on ARM64 platform (#1558) * [KYLIN-4864] Enable running Kylin tests on ARM64 platform This change modify the Travis CI configurations to enable the Kylin testing on ARM64 server. * Use openjdk11 for ARM64 test > Support building and testing Kylin on ARM64 architecture platform > - > > Key: KYLIN-4864 > URL: https://issues.apache.org/jira/browse/KYLIN-4864 > Project: Kylin > Issue Type: Improvement >Reporter: liusheng >Priority: Major > Fix For: v3.1.3 > > > Currently, there are many softwares have support running on ARM64 platform. > We have also done many efforts about making big-data projects support ARM64 > platform. > For an example, Hadoop has published ARM64 platform specific packages: > [https://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-3.3.0/hadoop-3.3.0-aarch64.tar.gz] > > and also have ARM specific CI job configured: > [https://ci-hadoop.apache.org/job/Hive-trunk-linux-ARM/] > It would be better to also enable ARM support and setup ARM CI for Kylin > projects -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4864) Support building and testing Kylin on ARM64 architecture platform
[ https://issues.apache.org/jira/browse/KYLIN-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438996#comment-17438996 ] ASF subversion and git services commented on KYLIN-4864: Commit 929014c70467eb7f90a72e2906826bed6c462201 in kylin's branch refs/heads/main from Martin Grigorov [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=929014c ] KYLIN-4864 Fix .travis.yml syntax (#1700) * KYLIN-4864 Fix .travis.yml syntax The commented line about `# mvn sonar:sonar -e -Dsonar.host.url=https://sonarcloud.io ...` has broken the YAML and because of this TravisCI didn't execute any jobs. I wasn't able to find a way to preserve the commented line and fix the syntax, so I removed the line. Later it could be get from Git history to re-enable Sonar. While here I've improved few more things: - install OpenJDK and unzip for both AMD64 and ARM64. This way it uses latest JDK 8 (1.8.0_292) for both CPU architectures - fix more YAML warnings * KYLIN-4864 Use Graviton2 ARM64 node There is some problem with resolving the local address on the arm64 node (non-graviton2) - https://travis-ci.community/t/sudo-unable-to-resolve-host/8841 > Support building and testing Kylin on ARM64 architecture platform > - > > Key: KYLIN-4864 > URL: https://issues.apache.org/jira/browse/KYLIN-4864 > Project: Kylin > Issue Type: Improvement >Reporter: liusheng >Priority: Major > Fix For: v3.1.3 > > > Currently, there are many softwares have support running on ARM64 platform. > We have also done many efforts about making big-data projects support ARM64 > platform. > For an example, Hadoop has published ARM64 platform specific packages: > [https://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-3.3.0/hadoop-3.3.0-aarch64.tar.gz] > > and also have ARM specific CI job configured: > [https://ci-hadoop.apache.org/job/Hive-trunk-linux-ARM/] > It would be better to also enable ARM support and setup ARM CI for Kylin > projects -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4864) Support building and testing Kylin on ARM64 architecture platform
[ https://issues.apache.org/jira/browse/KYLIN-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438994#comment-17438994 ] ASF GitHub Bot commented on KYLIN-4864: --- hit-lacus merged pull request #1757: URL: https://github.com/apache/kylin/pull/1757 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Support building and testing Kylin on ARM64 architecture platform > - > > Key: KYLIN-4864 > URL: https://issues.apache.org/jira/browse/KYLIN-4864 > Project: Kylin > Issue Type: Improvement >Reporter: liusheng >Priority: Major > Fix For: v3.1.3 > > > Currently, there are many softwares have support running on ARM64 platform. > We have also done many efforts about making big-data projects support ARM64 > platform. > For an example, Hadoop has published ARM64 platform specific packages: > [https://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-3.3.0/hadoop-3.3.0-aarch64.tar.gz] > > and also have ARM specific CI job configured: > [https://ci-hadoop.apache.org/job/Hive-trunk-linux-ARM/] > It would be better to also enable ARM support and setup ARM CI for Kylin > projects -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] hit-lacus merged pull request #1757: KYLIN-4864 Travis CI improvement for kylin4
hit-lacus merged pull request #1757: URL: https://github.com/apache/kylin/pull/1757 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-5053) Update the website to link to TravisCI and Github Actions instead of Jenkins
[ https://issues.apache.org/jira/browse/KYLIN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438670#comment-17438670 ] Martin Tzvetanov Grigorov commented on KYLIN-5053: -- I was going to close this Jira issue but I've noticed that [https://kylin.apache.org/development/#ci-and-code-analysis] is still the old version. I'll keep it open until the website is updated also in SVN. > Update the website to link to TravisCI and Github Actions instead of Jenkins > > > Key: KYLIN-5053 > URL: https://issues.apache.org/jira/browse/KYLIN-5053 > Project: Kylin > Issue Type: Task > Components: Documentation >Affects Versions: v3.1.2 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > Fix For: v3.1.3 > > > Currently [https://kylin.apache.org/development/#ci-and-code-analysis] points > to [https://builds.apache.org/job/Kylin-Master-JDK-1.8/] as CI, but this url > leads to error 404 (Not Found). > Since a while Kylin uses > [TravisCI|https://app.travis-ci.com/github/apache/kylin] and [GitHub > Actions|https://github.com/apache/kylin/actions] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4864) Support building and testing Kylin on ARM64 architecture platform
[ https://issues.apache.org/jira/browse/KYLIN-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438617#comment-17438617 ] ASF GitHub Bot commented on KYLIN-4864: --- zhangayqian commented on pull request #1757: URL: https://github.com/apache/kylin/pull/1757#issuecomment-960628645 > Awesome! The build passed: https://app.travis-ci.com/github/apache/kylin/builds/241166816 Your commit fixed this！Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Support building and testing Kylin on ARM64 architecture platform > - > > Key: KYLIN-4864 > URL: https://issues.apache.org/jira/browse/KYLIN-4864 > Project: Kylin > Issue Type: Improvement >Reporter: liusheng >Priority: Major > Fix For: v3.1.3 > > > Currently, there are many softwares have support running on ARM64 platform. > We have also done many efforts about making big-data projects support ARM64 > platform. > For an example, Hadoop has published ARM64 platform specific packages: > [https://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-3.3.0/hadoop-3.3.0-aarch64.tar.gz] > > and also have ARM specific CI job configured: > [https://ci-hadoop.apache.org/job/Hive-trunk-linux-ARM/] > It would be better to also enable ARM support and setup ARM CI for Kylin > projects -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] zhangayqian commented on pull request #1757: KYLIN-4864 Travis CI improvement for kylin4
zhangayqian commented on pull request #1757: URL: https://github.com/apache/kylin/pull/1757#issuecomment-960628645 > Awesome! The build passed: https://app.travis-ci.com/github/apache/kylin/builds/241166816 Your commit fixed this！Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (KYLIN-5115) 执行mvn clean test报错
qingquanzhang created KYLIN-5115: Summary: 执行mvn clean test报错 Key: KYLIN-5115 URL: https://issues.apache.org/jira/browse/KYLIN-5115 Project: Kylin Issue Type: Test Affects Versions: v4.0.0 Environment: windows10 spark2.4.7 maven3.5.4 未安装hadoop Reporter: qingquanzhang Attachments: cmd_log.txt 按照官网步骤一步一步在win10下搭建开发环境, 代码是从git上拉取的kylin主分支的代码 但是执行mvn clean test后,有很多报错信息 完整的记录我上传到了附件中 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4864) Support building and testing Kylin on ARM64 architecture platform
[ https://issues.apache.org/jira/browse/KYLIN-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438614#comment-17438614 ] ASF GitHub Bot commented on KYLIN-4864: --- martin-g commented on pull request #1757: URL: https://github.com/apache/kylin/pull/1757#issuecomment-960622255 Awesome! The build passed: https://app.travis-ci.com/github/apache/kylin/builds/241166816 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Support building and testing Kylin on ARM64 architecture platform > - > > Key: KYLIN-4864 > URL: https://issues.apache.org/jira/browse/KYLIN-4864 > Project: Kylin > Issue Type: Improvement >Reporter: liusheng >Priority: Major > Fix For: v3.1.3 > > > Currently, there are many softwares have support running on ARM64 platform. > We have also done many efforts about making big-data projects support ARM64 > platform. > For an example, Hadoop has published ARM64 platform specific packages: > [https://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-3.3.0/hadoop-3.3.0-aarch64.tar.gz] > > and also have ARM specific CI job configured: > [https://ci-hadoop.apache.org/job/Hive-trunk-linux-ARM/] > It would be better to also enable ARM support and setup ARM CI for Kylin > projects -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] martin-g commented on pull request #1757: KYLIN-4864 Travis CI improvement for kylin4
martin-g commented on pull request #1757: URL: https://github.com/apache/kylin/pull/1757#issuecomment-960622255 Awesome! The build passed: https://app.travis-ci.com/github/apache/kylin/builds/241166816 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError
[
https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qingquanzhang updated KYLIN-5114:
-
Description:
Build cube error:
{code:java}
Caused by: java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V{code}
So I tryed move $HIVE_HOME/lib/guava-27.0-jre.jar into $KYLIN_HOME/tools/ and
$KYLIN_HOME/tomcat/lib/ and restart kylin,but still the same error.
!image-2021-11-04-16-36-25-537.png!
虽然报错了,但是该segment却有了记录,再次构建cube就会提示segment已存在.如果删除这个segment,还会报错,报错信息如下
!image-2021-11-04-17-34-11-875.png!
was:
Build cube error:
{code:java}
Caused by: java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V{code}
So I tryed move $HIVE_HOME/lib/guava-27.0-jre.jar into $KYLIN_HOME/tools/ and
$KYLIN_HOME/tomcat/lib/ and restart kylin,but still the same error.
!image-2021-11-04-16-36-25-537.png!
> Build cube error:java.lang.NoSuchMethodError
>
>
> Key: KYLIN-5114
> URL: https://issues.apache.org/jira/browse/KYLIN-5114
> Project: Kylin
> Issue Type: Bug
> Components: Environment , Spark Engine
>Affects Versions: v4.0.0
> Environment: Hive 3.1.2
> hadoop 3.1.3
> spark 2.4.5
>Reporter: qingquanzhang
>Assignee: mukvin
>Priority: Major
> Fix For: Future
>
> Attachments: image-2021-11-04-16-36-25-537.png,
> image-2021-11-04-17-34-11-875.png, kylin.log
>
>
> Build cube error:
> {code:java}
> Caused by: java.lang.NoSuchMethodError:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V{code}
> So I tryed move $HIVE_HOME/lib/guava-27.0-jre.jar into $KYLIN_HOME/tools/ and
> $KYLIN_HOME/tomcat/lib/ and restart kylin,but still the same error.
>
> !image-2021-11-04-16-36-25-537.png!
> 虽然报错了,但是该segment却有了记录,再次构建cube就会提示segment已存在.如果删除这个segment,还会报错,报错信息如下
> !image-2021-11-04-17-34-11-875.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError
[
https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qingquanzhang updated KYLIN-5114:
-
Attachment: image-2021-11-04-17-34-11-875.png
> Build cube error:java.lang.NoSuchMethodError
>
>
> Key: KYLIN-5114
> URL: https://issues.apache.org/jira/browse/KYLIN-5114
> Project: Kylin
> Issue Type: Bug
> Components: Environment , Spark Engine
>Affects Versions: v4.0.0
> Environment: Hive 3.1.2
> hadoop 3.1.3
> spark 2.4.5
>Reporter: qingquanzhang
>Assignee: mukvin
>Priority: Major
> Fix For: Future
>
> Attachments: image-2021-11-04-16-36-25-537.png,
> image-2021-11-04-17-34-11-875.png, kylin.log
>
>
> Build cube error:
> {code:java}
> Caused by: java.lang.NoSuchMethodError:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V{code}
> So I tryed move $HIVE_HOME/lib/guava-27.0-jre.jar into $KYLIN_HOME/tools/ and
> $KYLIN_HOME/tomcat/lib/ and restart kylin,but still the same error.
>
> !image-2021-11-04-16-36-25-537.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError
[
https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438586#comment-17438586
]
qingquanzhang commented on KYLIN-5114:
--
我尝试使用guava-28.0-jre.jar替换了$KYLIN_HOME/tools/ 和
$KYLIN_HOME/tomcat/lib/,以及hadoop和hive下对应的guava-27.0-jre.jar,但是仍然在构建cube时会出现同样的错误.
> Build cube error:java.lang.NoSuchMethodError
>
>
> Key: KYLIN-5114
> URL: https://issues.apache.org/jira/browse/KYLIN-5114
> Project: Kylin
> Issue Type: Bug
> Components: Environment , Spark Engine
>Affects Versions: v4.0.0
> Environment: Hive 3.1.2
> hadoop 3.1.3
> spark 2.4.5
>Reporter: qingquanzhang
>Assignee: mukvin
>Priority: Major
> Fix For: Future
>
> Attachments: image-2021-11-04-16-36-25-537.png, kylin.log
>
>
> Build cube error:
> {code:java}
> Caused by: java.lang.NoSuchMethodError:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V{code}
> So I tryed move $HIVE_HOME/lib/guava-27.0-jre.jar into $KYLIN_HOME/tools/ and
> $KYLIN_HOME/tomcat/lib/ and restart kylin,but still the same error.
>
> !image-2021-11-04-16-36-25-537.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus opened a new pull request #1759: Test travis CI
hit-lacus opened a new pull request #1759: URL: https://github.com/apache/kylin/pull/1759 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature request, be sure to link to that issue. ## Github Branch As most of the development works are on Kylin 4, we need to switch it as main branch. Apache Kylin community changes the branch settings on Github since 2021-08-04 : 1. The original branch _kylin-on-parquet-v2_ for **Kylin 4.X** (Parquet Storage) has been renamed to branch **main**, and configured as the **default** branch; 2. The original branch _master_ for **Kylin 3.X** (HBase Storage) has been renamed to branch **kylin3** ; Please check [Intro to Kylin 4 architecture](https://kylin.apache.org/blog/2021/07/02/Apache-Kylin4-A-new-storage-and-compute-architecture/) and [INFRA-22166](https://issues.apache.org/jira/browse/INFRA-22166) if you are interested. ## Types of changes What types of changes does your code introduce to Kylin? _Put an `x` in the boxes that apply_ - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected) - [ ] Documentation Update (if none of the other choices apply) ## Checklist _Put an `x` in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code._ - [ ] I have create an issue on [Kylin's jira](https://issues.apache.org/jira/browse/KYLIN), and have described the bug/feature there in detail - [ ] Commit messages in my PR start with the related jira ID, like "KYLIN- Make Kylin project open-source" - [ ] Compiling and unit tests pass locally with my changes - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] I have added necessary documentation (if appropriate) - [ ] Any dependent changes have been merged ## Further comments If this is a relatively large or complex change, kick off the discussion at user@kylin or dev@kylin by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError
[
https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qingquanzhang updated KYLIN-5114:
-
Description:
Build cube error:
{code:java}
Caused by: java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V{code}
So I tryed move $HIVE_HOME/lib/guava-27.0-jre.jar into $KYLIN_HOME/tools/ and
$KYLIN_HOME/tomcat/lib/ and restart kylin,but still the same error.
!image-2021-11-04-16-36-25-537.png!
was:
Build cube error:
{code:java}
Caused by: java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V{code}
So I tryed move $HIVE_HOME/lib/guava-27.0-jre.jar into $KYLIN_HOME/tools/ and
$KYLIN_HOME/tomcat/lib/ and restart kylin,but still the same error.
> Build cube error:java.lang.NoSuchMethodError
>
>
> Key: KYLIN-5114
> URL: https://issues.apache.org/jira/browse/KYLIN-5114
> Project: Kylin
> Issue Type: Bug
> Components: Environment , Spark Engine
>Affects Versions: v4.0.0
> Environment: Hive 3.1.2
> hadoop 3.1.3
> spark 2.4.5
>Reporter: qingquanzhang
>Assignee: mukvin
>Priority: Major
> Fix For: Future
>
> Attachments: image-2021-11-04-16-36-25-537.png, kylin.log
>
>
> Build cube error:
> {code:java}
> Caused by: java.lang.NoSuchMethodError:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V{code}
> So I tryed move $HIVE_HOME/lib/guava-27.0-jre.jar into $KYLIN_HOME/tools/ and
> $KYLIN_HOME/tomcat/lib/ and restart kylin,but still the same error.
>
> !image-2021-11-04-16-36-25-537.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError
[
https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qingquanzhang updated KYLIN-5114:
-
Attachment: image-2021-11-04-16-36-25-537.png
> Build cube error:java.lang.NoSuchMethodError
>
>
> Key: KYLIN-5114
> URL: https://issues.apache.org/jira/browse/KYLIN-5114
> Project: Kylin
> Issue Type: Bug
> Components: Environment , Spark Engine
>Affects Versions: v4.0.0
> Environment: Hive 3.1.2
> hadoop 3.1.3
> spark 2.4.5
>Reporter: qingquanzhang
>Assignee: mukvin
>Priority: Major
> Fix For: Future
>
> Attachments: image-2021-11-04-16-36-25-537.png, kylin.log
>
>
> Build cube error:
> {code:java}
> Caused by: java.lang.NoSuchMethodError:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V{code}
> So I tryed move $HIVE_HOME/lib/guava-27.0-jre.jar into $KYLIN_HOME/tools/ and
> $KYLIN_HOME/tomcat/lib/ and restart kylin,but still the same error.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-5097) modify hive dict table format from textfile to orc
[ https://issues.apache.org/jira/browse/KYLIN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438559#comment-17438559 ] ASF GitHub Bot commented on KYLIN-5097: --- hit-lacus commented on pull request #1752: URL: https://github.com/apache/kylin/pull/1752#issuecomment-960551850 I am not quite not sure if I need to merge this patch since it is **incompatible**. I know some Kylin user write program to read and parse the dict tables's file to decode the Bitmap into original literal values. I wonder if this patch may break these user. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org > modify hive dict table format from textfile to orc > -- > > Key: KYLIN-5097 > URL: https://issues.apache.org/jira/browse/KYLIN-5097 > Project: Kylin > Issue Type: Bug >Affects Versions: v3.1.1, v3.1.2, v3.1.3 >Reporter: fengpod >Priority: Minor > > Textfile format end with ‘\n’ by default， when the data itself contains ‘\n’, > dict table may appear dirty data。 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] hit-lacus commented on pull request #1752: KYLIN-5097 modify hive dict table format from textfile to orc
hit-lacus commented on pull request #1752: URL: https://github.com/apache/kylin/pull/1752#issuecomment-960551850 I am not quite not sure if I need to merge this patch since it is **incompatible**. I know some Kylin user write program to read and parse the dict tables's file to decode the Bitmap into original literal values. I wonder if this patch may break these user. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-5111) Record the time spent for each stage of query in kylin4's log
[ https://issues.apache.org/jira/browse/KYLIN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438540#comment-17438540 ] ASF GitHub Bot commented on KYLIN-5111: --- hit-lacus merged pull request #1755: URL: https://github.com/apache/kylin/pull/1755 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Record the time spent for each stage of query in kylin4's log > - > > Key: KYLIN-5111 > URL: https://issues.apache.org/jira/browse/KYLIN-5111 > Project: Kylin > Issue Type: Improvement > Components: Metrics >Affects Versions: v4.0.0 >Reporter: Yaqian Zhang >Assignee: Yaqian Zhang >Priority: Minor > Fix For: v4.0.1 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] hit-lacus merged pull request #1755: KYLIN-5111 Record the time spent for each stage of query in kylin4's log
hit-lacus merged pull request #1755: URL: https://github.com/apache/kylin/pull/1755 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-5111) Record the time spent for each stage of query in kylin4's log
[ https://issues.apache.org/jira/browse/KYLIN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438541#comment-17438541 ] ASF subversion and git services commented on KYLIN-5111: Commit d9a5c70136c29b77f981058c7166492ce53ea2a4 in kylin's branch refs/heads/main from yaqian.zhang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d9a5c70 ] KYLIN-5111 Record the time spent for each stage of query in kylin4's log > Record the time spent for each stage of query in kylin4's log > - > > Key: KYLIN-5111 > URL: https://issues.apache.org/jira/browse/KYLIN-5111 > Project: Kylin > Issue Type: Improvement > Components: Metrics >Affects Versions: v4.0.0 >Reporter: Yaqian Zhang >Assignee: Yaqian Zhang >Priority: Minor > Fix For: v4.0.1 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] hit-lacus merged pull request #1758: Modify branch name for kylin3
hit-lacus merged pull request #1758: URL: https://github.com/apache/kylin/pull/1758 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@kylin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (KYLIN-5035) Fix Merge Cuboid Statistics EOFException
[ https://issues.apache.org/jira/browse/KYLIN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang updated KYLIN-5035: Fix Version/s: v3.1.3 > Fix Merge Cuboid Statistics EOFException > > > Key: KYLIN-5035 > URL: https://issues.apache.org/jira/browse/KYLIN-5035 > Project: Kylin > Issue Type: Bug > Components: Job Engine, Spark Engine >Reporter: JiangYang >Assignee: JiangYang >Priority: Major > Fix For: v3.1.3 > > > org.apache.kylin.job.exception.ExecuteException: java.io.EOFException at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201) > at > org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) > at > org.apache.kylin.job.impl.threadpool.DistributedScheduler\$JobRunner.run(DistributedScheduler.java:238) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) Caused by: java.io.EOFException at > java.io.DataInputStream.readFully(DataInputStream.java:197) at > java.io.DataInputStream.readFully(DataInputStream.java:169) at > org.apache.hadoop.io.SequenceFile\$Reader.init(SequenceFile.java:1918) at > org.apache.hadoop.io.SequenceFile\$Reader.initialize(SequenceFile.java:1883) > at org.apache.hadoop.io.SequenceFile\$Reader.(SequenceFile.java:1832) at > org.apache.kylin.engine.mr.common.CubeStatsReader\$CubeStatsResult.(CubeStatsReader.java:484) > at > org.apache.kylin.engine.mr.common.CubeStatsReader.(CubeStatsReader.java:133) > at > org.apache.kylin.engine.mr.steps.MergeStatisticsWithOldStep.doWork(MergeStatisticsWithOldStep.java:97) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) > ... 6 more -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-5053) Update the website to link to TravisCI and Github Actions instead of Jenkins
[ https://issues.apache.org/jira/browse/KYLIN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang updated KYLIN-5053: Fix Version/s: v3.1.3 > Update the website to link to TravisCI and Github Actions instead of Jenkins > > > Key: KYLIN-5053 > URL: https://issues.apache.org/jira/browse/KYLIN-5053 > Project: Kylin > Issue Type: Task > Components: Documentation >Affects Versions: v3.1.2 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > Fix For: v3.1.3 > > > Currently [https://kylin.apache.org/development/#ci-and-code-analysis] points > to [https://builds.apache.org/job/Kylin-Master-JDK-1.8/] as CI, but this url > leads to error 404 (Not Found). > Since a while Kylin uses > [TravisCI|https://app.travis-ci.com/github/apache/kylin] and [GitHub > Actions|https://github.com/apache/kylin/actions] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-5032) Not allow change project for a cubeInstance.
[ https://issues.apache.org/jira/browse/KYLIN-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang updated KYLIN-5032: Fix Version/s: v3.1.3 > Not allow change project for a cubeInstance. > > > Key: KYLIN-5032 > URL: https://issues.apache.org/jira/browse/KYLIN-5032 > Project: Kylin > Issue Type: Improvement >Reporter: JiangYang >Assignee: JiangYang >Priority: Minor > Fix For: v3.1.3 > > > There are two project in Kylin: project1, project2. > Cube1 is in project1 now. > 1.Some one is in project2 (In KYLIN-UI) > 2.edit cube1 with url > [https:///kylin/cubes/edit/cube1|https://kylin.rno.corp.ebay.com/kylin/cubes/edit/PA_AUTO_TRACKING_GROUPS_SD_PROD_C_V2] > 3. then save, now cube1 is in project2. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-5007) queries with limit clause may fail when string dimension is encoded in integer type
[
https://issues.apache.org/jira/browse/KYLIN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yaqian Zhang updated KYLIN-5007:
Fix Version/s: v3.1.3
> queries with limit clause may fail when string dimension is encoded in
> integer type
> ---
>
> Key: KYLIN-5007
> URL: https://issues.apache.org/jira/browse/KYLIN-5007
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: v3.0.2
>Reporter: Congling Xia
>Assignee: Congling Xia
>Priority: Major
> Fix For: v3.1.3
>
> Attachments: image-2021-06-10-10-03-54-775.png
>
>
> Hi, team.
> Recently we encounter a problem that queries may fail if there is a LIMIT in
> the SQL. The SQL looks like:
> {code}
> select gid from some_table group by gid limit 100
> {code}
> The error message is like the following:
> {code:java}
> Not sorted! last: source_v1=null,...,gid=276,... fetched:
> source_v1=null,...,gid=100506,...
> {code}
> After searching the issues list, we find it is similar with KYLIN-2425,
> KYLIN-3089, and KYLIN-4942. We notice that these problems are not completely
> resolved.
> It is an row-key encoding problem, the cube uses integer:4 to encode string
> column _gid_:
> !image-2021-06-10-10-03-54-775.png|width=571,height=141!
> As [~kangkaisen] mensioned in KYLIN-3089, comparator in
> SortMergedPartitionResultIterator is different from the one in
> SortedIteratorMergerWithLimit. SortedIteratorMergerWithLimit compares tuple
> of dimensions in their origin data type "string" rather than the encoded data
> type "integer" in rowkeys. In the exception message above, 276<100506 is
> false because they are compared in "string" type.
> It may be resolved by skipping limit pushdown when column type and encoding
> type may produce different comparing results, but it may lead such queries to
> be slower.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KYLIN-4947) Implement spark engine for cube optimization jobs
[ https://issues.apache.org/jira/browse/KYLIN-4947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang updated KYLIN-4947: Fix Version/s: v3.1.3 > Implement spark engine for cube optimization jobs > - > > Key: KYLIN-4947 > URL: https://issues.apache.org/jira/browse/KYLIN-4947 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: JiangYang >Assignee: JiangYang >Priority: Minor > Fix For: v3.1.3 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4944) Upgrade CentOS version, Hadoop version and Spark version for Kylin Docker image
[ https://issues.apache.org/jira/browse/KYLIN-4944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang updated KYLIN-4944: Fix Version/s: v3.1.3 > Upgrade CentOS version, Hadoop version and Spark version for Kylin Docker > image > --- > > Key: KYLIN-4944 > URL: https://issues.apache.org/jira/browse/KYLIN-4944 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: v4.0.0-beta >Reporter: Zhichao Zhang >Assignee: Zhichao Zhang >Priority: Minor > Fix For: v4.0.0, v3.1.3 > > > Currently, the centos version of kylin docker image is 6.9, and the yum of > centos 6.9 is no longer maintained, it needs to upgrade to 7+. > It also can upgrade hadoop to 2.8.5 , spark to 2.4.7. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4554) Validate "filter condition" on model saving
[ https://issues.apache.org/jira/browse/KYLIN-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang updated KYLIN-4554: Fix Version/s: v3.1.3 > Validate "filter condition" on model saving > --- > > Key: KYLIN-4554 > URL: https://issues.apache.org/jira/browse/KYLIN-4554 > Project: Kylin > Issue Type: Improvement > Components: Metadata >Reporter: Shao Feng Shi >Assignee: Sun BiaoBiao >Priority: Major > Fix For: v4.0.0, v3.1.3 > > Attachments: WechatIMG397.png > > > When define a model, user can enter a filter condition (using to do data > filtering on loading). While the system doesn't validate the filtering > condition's syntax; Later when build the cube, the condition will be send to > Hive, Hive may report an error on the syntax, but at that time, it is > difficult to modify it. > > !WechatIMG397.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4964) Receiver consumer thread should be stoped while encounting unrecoverable error
[ https://issues.apache.org/jira/browse/KYLIN-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang updated KYLIN-4964: Fix Version/s: v3.1.3 > Receiver consumer thread should be stoped while encounting unrecoverable error > -- > > Key: KYLIN-4964 > URL: https://issues.apache.org/jira/browse/KYLIN-4964 > Project: Kylin > Issue Type: Bug > Components: Real-time Streaming >Affects Versions: v3.1.1 >Reporter: Xingxing Di >Assignee: Xingxing Di >Priority: Major > Fix For: v3.1.3 > > > org.apache.kylin.stream.core.storage.columnar.ColumnarMemoryStorePersister#persist > will catch exception and just log it, this behavior will cause critical > problem, like our case: there is no space left on device, `persist` method > failed for many times, we lost several hours of data. > Here is our solution which already tested: > # Throw IllegalStorageException while we cannot do the persist > # Then stop the consumer thread > # Add `consumer_thread_alive` in ConsumerStats for monitoring > # Also fix an another issue which will cause wrong result after restore from > checkpoint > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4992) Source row count statistics calculated in a wrong way in MergeDictionaryMapper
[ https://issues.apache.org/jira/browse/KYLIN-4992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yaqian Zhang updated KYLIN-4992: Fix Version/s: v3.1.3 > Source row count statistics calculated in a wrong way in MergeDictionaryMapper > -- > > Key: KYLIN-4992 > URL: https://issues.apache.org/jira/browse/KYLIN-4992 > Project: Kylin > Issue Type: Bug >Affects Versions: v3.0.0, v2.6.2, v2.6.3, v3.1.0, v3.0.1, v3.0.2, v3.1.1, > v3.1.2 >Reporter: Zhong Yanghong >Assignee: JiangYang >Priority: Critical > Fix For: v3.1.3 > > > With this bug, source row count will be smaller than the correct one and it > will result in smaller cuboid size estimation and smaller region number. > Finally it will impact job and query performance. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4582) Query with count distinct and grouping sets get wrong result
[
https://issues.apache.org/jira/browse/KYLIN-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yaqian Zhang updated KYLIN-4582:
Fix Version/s: v3.1.4
> Query with count distinct and grouping sets get wrong result
>
>
> Key: KYLIN-4582
> URL: https://issues.apache.org/jira/browse/KYLIN-4582
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: v2.5.2
> Environment: hdp 2.6
>Reporter: YaoChen
>Priority: Critical
> Fix For: v3.1.4
>
> Attachments: count_distinct_grouping_sets_wrong_result.png,
> right_result.png
>
>
> We find that query with count distinct and grouping sets get wrong result
> when number of grouping sets combination > 2;
> if we change count distinct to count or sum the result is correct.
> Query result is correct when grouping have two sets as below:
> {code:sql}
> group by grouping sets(
> (a.period_id,a.company_name,a.province,a.new_flag),
> (a.period_id,a.company_name,a.new_flag))
> {code}
> full sql:
> {code:sql}
> select period_id,
>case grouping(a.company_name) when 1 then 'ALL' else a.company_name
> end company_name,
>case grouping(a.province) when 1 then 'ALL' else a.province end
> province,
>case grouping(a.new_flag) when 1 then 'ALL' else a.new_flag end
> new_flag,
>count(distinct user_id) as index2 --'users'
> from (
> select monthid as period_id,
>case company_id when '1' then 'xx1' when '2' then 'xx2'
>end as company_name,
>province_name as province,
>case new_user_flag when '1' then '新增' when '2' then '存量' when '3' then
> '存量' end as new_flag,
>user_id
> from rpt_culture_order_m
> where monthid between '202005' and '{202005}' and order_flag=2 and
> company_id=4
> ) a
> group by grouping sets(
> (a.period_id,a.company_name,a.province,a.new_flag),
> (a.period_id,a.company_name,a.new_flag))
> {code}
> !right_result.png|width=843,height=547!
> *{color:#ff}But if we add one or more grouping the query result (count
> distinct(user_id)) is wrong.{color}*
> {code:sql}
> group by grouping sets(
> (a.period_id,a.company_name,a.province,a.new_flag),
> (a.period_id,a.company_name,a.new_flag),
> (a.period_id,a.company_name))
> {code}
> full sql:
> {code:sql}
> select period_id,
>case grouping(a.company_name) when 1 then 'ALL' else a.company_name
> end company_name,
>case grouping(a.province) when 1 then 'ALL' else a.province end
> province,
>case grouping(a.new_flag) when 1 then 'ALL' else a.new_flag end
> new_flag,
>count(distinct user_id) as index2 --'users'
> from (
> select monthid as period_id,
>case company_id when '1' then 'xx1' when '2' then 'xx2'
>end as company_name,
>province_name as province,
>case new_user_flag when '1' then '新增' when '2' then '存量' when '3' then
> '存量' end as new_flag,
>user_id
> from rpt_culture_order_m
> where monthid between '202005' and '{202005}' and order_flag=2 and
> company_id=4
> ) a
> group by grouping sets(
> (a.period_id,a.company_name,a.province,a.new_flag),
> (a.period_id,a.company_name,a.new_flag),
> (a.period_id,a.company_name)
> )
> {code}
>
> !count_distinct_grouping_sets_wrong_result.png!
> The result of '新增‘ （column ：INDEX2） should be 3170752 instead of 34808840
> which is equal with the result of 'all'.
> count distinct result of "All" dimension = roll up dimension.
> Further, we have test that when change the aggregation from count distinct to
> count or sum the result is right.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KYLIN-4995) Query exception when the query statement contains a single left parenthesis
[
https://issues.apache.org/jira/browse/KYLIN-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yaqian Zhang updated KYLIN-4995:
Fix Version/s: v3.1.3
> Query exception when the query statement contains a single left parenthesis
> ---
>
> Key: KYLIN-4995
> URL: https://issues.apache.org/jira/browse/KYLIN-4995
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: v3.1.2
>Reporter: Mingming Ge
>Assignee: Mingming Ge
>Priority: Critical
> Fix For: v3.1.3
>
> Attachments: image-2021-05-19-10-15-34-215.png
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> Queries like this：
>
> {code:java}
> select '( a + b) * (c+ d ' from t；{code}
> The following exception will occur during execution，
> !image-2021-05-19-10-15-34-215.png|width=592,height=326!
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
