Re: [VOTE] Release apache-kylin-2.6.3 (RC1)
+1 (binding) mvn test passed Apache Maven 3.6.1 (d66c9c0b3152b2e69ee9bac180bb8fcc8e6af555; 2019-04-05T03:00:29+08:00) Maven home: /opt/maven Java version: 1.8.0_211, vendor: Oracle Corporation, runtime: /Library/Java/JavaVirtualMachines/jdk1.8.0_211.jdk/Contents/Home/jre Default locale: en_CN, platform encoding: UTF-8 OS name: "mac os x", version: "10.14.5", arch: "x86_64", family: "mac" Best regards, Yanghong Zhong On 2019/7/2, 4:27 PM, "Xiaoxiang Yu" wrote: EXTERNAL EMAIL: Do not click any links or open attachments unless you trust the sender and know the content is safe. +1mvn test passed- - Best wishes to you ! From ：Xiaoxiang Yu At 2019-07-01 15:51:58, "Wang rupeng" wrote: >+1 >mvn test passed > >在 2019/7/1 下午2:16，“Chao Long” 写入: > >+1 >mvn test passed > >On Mon, Jul 1, 2019 at 2:09 PM Cheng wang wrote: > >> ＋1(binding) >> >> Best regards, >> Cheng Wang >> >> >> On 7/1/19, 9:27 AM, "ShaoFeng Shi" wrote: >> >> Hi all, >> >> I have created a build for Apache Kylin 2.6.3, release candidate 1. >> >> Changes highlights: >> - [KYLIN-4024] - Support pushdown to Presto >> - [KYLIN-3977] - Avoid mistaken deleting dicts by storage cleanup while >> building jobs are running >> - [KYLIN-4015] – Fix build cube error at the "Build UHC Dictionary" >> step >> - [KYLIN-4022] - Error with message "Unrecognized column type: >> DECIMAL(xx,xx)" happens when doing query pushdown >> >> Thanks to everyone who has contributed to this release. >> Here’s release notes: >> >> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fsecure%2FReleaseNote.jspa%3FprojectId%3D12316121%26version%3D12345582&data=02%7C01%7Cyangzhong%40ebay.com%7C4fbcbb97315842aa63bd08d6fec71ad5%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636976528590708045&sdata=cRF3oJfZ53by7huE5lNIX8srXBTdHJcxMeqFyhP2FWU%3D&reserved=0 >> >> The commit to being voted upon: >> >> >> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkylin%2Fcommit%2F0d5f85b0a40c301134122de927204a0d17ad65fa&data=02%7C01%7Cyangzhong%40ebay.com%7C4fbcbb97315842aa63bd08d6fec71ad5%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636976528590708045&sdata=hIsL4%2BVu42b20t5FkZLLEI3CNvuZlkba63m%2BWID%2FILg%3D&reserved=0 >> >> Its hash is 0d5f85b0a40c301134122de927204a0d17ad65fa. >> >> The artifacts to be voted on are located here: >> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fkylin%2Fapache-kylin-2.6.3-rc1%2F&data=02%7C01%7Cyangzhong%40ebay.com%7C4fbcbb97315842aa63bd08d6fec71ad5%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636976528590708045&sdata=meibRHs0M62EEL7BEwXRFpO66gQRnC6mXdKO8ojRjzQ%3D&reserved=0 >> >> The hash of the artifact is as follows: >> apache-kylin-2.6.3-source-release.zip.sha256 >> 50d1cad423f1a15a5e25f1c3c68748c7ce10e0116fd67fa9e38c1470a11d389c >> >> A staged Maven repository is available for review at: >> >> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachekylin-1063%2F&data=02%7C01%7Cyangzhong%40ebay.com%7C4fbcbb97315842aa63bd08d6fec71ad5%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636976528590708045&sdata=pQXAo43Ut2WcSGFKCWW030GvyrNCWC%2BlSz9iz41Cfxo%3D&reserved=0 >> >> Release artifacts are signed with the following key: >> https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fshaofengshi.asc&data=02%7C01%7Cyangzhong%40ebay.com%7C4fbcbb97315842aa63bd08d6fec71ad5%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636976528590708045&sdata=j5cPCyxsxsUUPHIe1STIwcRBTY2nyeWfzPZLtD%2BN5Ho%3D&reserved=0 >> >> Please vote on releasing this package as Apache Kylin 2.6.3. >> >> The vote is open for the next 72 hours and passes if a majority of >> at least three +1 PMC votes are cast. >> >> [ ] +1 Release this package as Apache Kylin 2.6.3 >> [ ] 0 I don't feel strongly about it, but I'm okay with the release >> [ ] -1 Do not release this package because... >> >> >> Here is my vote: >> >> +1 (binding) >> >> Best regards, >> >> Shaofeng Shi 史少锋 >> Apache Kylin PMC >> Email: shaofeng...@apache.org >> >> Apache Ky
[jira] [Created] (KYLIN-4070) No logs print in kylin.log file and met error "Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster"
xiangakun created KYLIN-4070:
Summary: No logs print in kylin.log file and met error "Error:
Could not find or load main class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster"
Key: KYLIN-4070
URL: https://issues.apache.org/jira/browse/KYLIN-4070
Project: Kylin
Issue Type: Bug
Environment: apache-kylin-2.6.2-bin-hbase1x hadoop-2.7.7
hbase-1.2.11hive-2.3.4
Reporter: xiangakun
Hello friends,
I am using kylin with version 2.6.2, and the relied components are lists below,
I start the kylin server successfully and met the error
"org.apache.kylin.rest.exception.InternalErrorException:
org/apache/hadoop/hive/conf/HiveConf" when loading hive meta data. I updated
the configuration from "export
HBASE_CLASSPATH_PREFIX=${KYLIN_HOME}/conf:${KYLIN_HOME}/lib/*:${KYLIN_HOME}/ext/*:${HBASE_CLASSPATH_PREFIX}"
to "export
HBASE_CLASSPATH_PREFIX=${KYLIN_HOME}/conf:${KYLIN_HOME}/lib/*:${KYLIN_HOME}/ext/*:{color:#FF}${hive_dependency}{color}:${HBASE_CLASSPATH_PREFIX}"
in kylin.sh file. it did work fine. However, after this action, I found no
more messages could be produced in logs/kylin.log file. I removed kylin.log
file, and after restarted the kylin server, kylin.log file was not created any
more. It's seems too stange.
What's more, when I create a cube and build it, the error happens in step 3, it
shows "
Error: Could not find or load main class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster".
In fact, I used the same configuration in yarn-site.xml and mapred-site.xml
files with kylin version 2.1.0 for a long time, it worked fine and never met
such error.
Does anyone meet the same problem before? Hope receive your kindly help soon.
Thanks in advance.
Best Regards
xiangakun
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-4069) HivePushDownConverter.doConvert will change sql semantics in some scenarios
weibin0516 created KYLIN-4069:
-
Summary: HivePushDownConverter.doConvert will change sql semantics
in some scenarios
Key: KYLIN-4069
URL: https://issues.apache.org/jira/browse/KYLIN-4069
Project: Kylin
Issue Type: Bug
Components: Query Engine
Affects Versions: v2.6.2
Reporter: weibin0516
Assignee: weibin0516
HivePushDownConverter.doConvert source code is as follows:
{code:java}
public static String doConvert(String originStr, boolean isPrepare) {
// Step1.Replace " with `
String convertedSql = replaceString(originStr, "\"", "`");
// Step2.Replace extract functions
convertedSql = extractReplace(convertedSql);
// Step3.Replace cast type string
convertedSql = castReplace(convertedSql);
// Step4.Replace sub query
convertedSql = subqueryReplace(convertedSql);
// Step5.Replace char_length with length
convertedSql = replaceString(convertedSql, "CHAR_LENGTH", "LENGTH");
convertedSql = replaceString(convertedSql, "char_length", "length");
// Step6.Replace "||" with concat
convertedSql = concatReplace(convertedSql);
// Step7.Add quote for interval in timestampadd
convertedSql = timestampAddDiffReplace(convertedSql);
// Step8.Replace integer with int
convertedSql = replaceString(convertedSql, "INTEGER", "INT");
convertedSql = replaceString(convertedSql, "integer", "int");
// Step9.Add limit 1 for prepare select sql to speed up
if (isPrepare) {
convertedSql = addLimit(convertedSql);
}
return convertedSql;
}
{code}
It is not advisable to directly replace the sql text. The following example
will convert sql to another error sql:
{code:sql}
SELECT "CHAR_LENGTH" FROM datasource.a
{code}
will convert to
{code:sql}
SELECT `LENGTH` FROM datasource.a
{code}
Every use of replaceString in doConvert will cause such problems.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-4068) Automatically add limit has bug
weibin0516 created KYLIN-4068:
-
Summary: Automatically add limit has bug
Key: KYLIN-4068
URL: https://issues.apache.org/jira/browse/KYLIN-4068
Project: Kylin
Issue Type: Bug
Components: Query Engine
Affects Versions: v2.6.2
Reporter: weibin0516
Assignee: weibin0516
{code:sql}
SELECT E_Name FROM Employees_China
UNION
SELECT E_Name FROM Employees_USA
{code}
will convert to
{code:sql}
SELECT E_Name FROM Employees_China
UNION
SELECT E_Name FROM Employees_USA
LIMIT 5
{code}
This limit is not working on the result of union, but on SELECT E_Name FROM
Employees_USA.
We should use a more secure way to achieve the limit effect.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-4067) Speed up response of kylin cube page
zhao jintao created KYLIN-4067: -- Summary: Speed up response of kylin cube page Key: KYLIN-4067 URL: https://issues.apache.org/jira/browse/KYLIN-4067 Project: Kylin Issue Type: Improvement Components: Web Affects Versions: v2.6.2 Reporter: zhao jintao Assignee: zhao jintao Fix For: Future Hi Team： My Kylin project has more than 100 cubes. It is very slowly when open kylin web page. I find that kylin load all information of cubes when open cube page. It load all information of all cubes at every cube in kylin project. The url of request is "http://ip:port/kylin/api/cubes?limit=65535&offset=0";. For example, if one project has 10 cubes, this request will be called by 10 times. But this information is only be used to determine whether the name is duplicated when adding a new cube. This page loading mechanism can be optimized. Getting all the information of all cube only needs to be called when adding a new cube. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-4066) No planner for not ROLE_ADMIN user on WebSite
langdamao created KYLIN-4066:
Summary: No planner for not ROLE_ADMIN user on WebSite
Key: KYLIN-4066
URL: https://issues.apache.org/jira/browse/KYLIN-4066
Project: Kylin
Issue Type: Bug
Components: Website
Affects Versions: v2.6.1
Environment: macOs
Reporter: langdamao
Fix For: Future
There is no planner page for none ROLE_ADMIN user ,even though he has ADMIN
access for the project.
I found in webapp/app/partials/cubes/cube_detail.html line44
{code:java}
Planner
{code}
but other place the hasPermission function use as
{code:java}
hasPermission('cube',cube, permissions.ADMINISTRATION.mask)
{code}
the function hasPermission is defined in webapp/app/js/controllers/page.js
line100
{code:java}
$scope.hasPermission = function (accessType, entity){
...
if (accessType === 'cube') {
project = entity.project
} else if (accessType === 'project') {
project = entity && entity.name || entity.selectedProject
} else if (accessType === 'model') {
project = ProjectModel.getProjectByCubeModel(entity.name)
}
...
}{code}
I guess whether it's cause by no param of accessType.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Re: [VOTE] Release apache-kylin-2.6.3 (RC1)
+1mvn test passed- - Best wishes to you ! From ：Xiaoxiang Yu At 2019-07-01 15:51:58, "Wang rupeng" wrote: >+1 >mvn test passed > >在 2019/7/1 下午2:16，“Chao Long” 写入: > >+1 >mvn test passed > >On Mon, Jul 1, 2019 at 2:09 PM Cheng wang wrote: > >> ＋1(binding) >> >> Best regards, >> Cheng Wang >> >> >> On 7/1/19, 9:27 AM, "ShaoFeng Shi" wrote: >> >> Hi all, >> >> I have created a build for Apache Kylin 2.6.3, release candidate 1. >> >> Changes highlights: >> - [KYLIN-4024] - Support pushdown to Presto >> - [KYLIN-3977] - Avoid mistaken deleting dicts by storage cleanup > while >> building jobs are running >> - [KYLIN-4015] – Fix build cube error at the "Build UHC Dictionary" >> step >> - [KYLIN-4022] - Error with message "Unrecognized column type: >> DECIMAL(xx,xx)" happens when doing query pushdown >> >> Thanks to everyone who has contributed to this release. >> Here’s release notes: >> >> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121&version=12345582 >> >> The commit to being voted upon: >> >> >> > https://github.com/apache/kylin/commit/0d5f85b0a40c301134122de927204a0d17ad65fa >> >> Its hash is 0d5f85b0a40c301134122de927204a0d17ad65fa. >> >> The artifacts to be voted on are located here: >> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.3-rc1/ >> >> The hash of the artifact is as follows: >> apache-kylin-2.6.3-source-release.zip.sha256 >> 50d1cad423f1a15a5e25f1c3c68748c7ce10e0116fd67fa9e38c1470a11d389c >> >> A staged Maven repository is available for review at: >> >> https://repository.apache.org/content/repositories/orgapachekylin-1063/ >> >> Release artifacts are signed with the following key: >> https://people.apache.org/keys/committer/shaofengshi.asc >> >> Please vote on releasing this package as Apache Kylin 2.6.3. >> >> The vote is open for the next 72 hours and passes if a majority of >> at least three +1 PMC votes are cast. >> >> [ ] +1 Release this package as Apache Kylin 2.6.3 >> [ ] 0 I don't feel strongly about it, but I'm okay with the release >> [ ] -1 Do not release this package because... >> >> >> Here is my vote: >> >> +1 (binding) >> >> Best regards, >> >> Shaofeng Shi 史少锋 >> Apache Kylin PMC >> Email: shaofeng...@apache.org >> >> Apache Kylin FAQ: >> https://kylin.apache.org/docs/gettingstarted/faq.html >> Join Kylin user mail group: user-subscr...@kylin.apache.org >> Join Kylin dev mail group: dev-subscr...@kylin.apache.org >> >> >> > >
