from:"Rongchuan Jin"

Re: [ANNOUNCE] New Committer: Jiatao Tao

2019-06-12 Thread Rongchuan Jin

Congrats to Jiatao!

Rongchuan.Jin

 

在 2019/6/13 上午10:48，“zjsy...@163.com 代表 nichunen” 写入:

Congratulations!  Jiatao.



Best regards,

 

Ni Chunen / George



On 06/13/2019 10:46，ShaoFeng Shi wrote：
The Project Management Committee (PMC) for Apache Kylin
has invited Jiatao Tao to become a committer and we are pleased
to announce that he has accepted.

Thanks for all your hard work Jiatao; we look forward to more
contributions!

Please join me in extending congratulations to Jiatao!

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofeng...@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: [VOTE] Release apache-kylin-2.6.1 (RC1)

2019-03-06 Thread Rongchuan Jin

+1 mvn test passed
Best Regards
Rongchuan Jin

 

在 2019/3/6 下午7:37，“Billy Liu” 写入:

+1 binding

mvn test passed

Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
2018-06-18T02:33:14+08:00)
Maven home: /usr/local/Cellar/maven/3.5.4
Java version: 1.8.0_91, vendor: Oracle Corporation, runtime:
/Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.14.3", arch: "x86_64", family: "mac"

With Warm regards

Billy Liu

Luke Han  于2019年3月6日周三 下午6:29写道：
>
> +1 binding
>
> Best Regards!
> -
>
> Luke Han
>
>
> On Wed, Mar 6, 2019 at 5:55 PM PENG Zhengshuai 
> wrote:
>
> > +1
> >
> > > On Mar 5, 2019, at 1:56 PM, JiaTao Tao  wrote:
> > >
> > > +1
> > >
> > > --
> > >
> > >
> > > Regards!
> > >
> > > Aron Tao
> > >
> > >
> > >
> > > ShaoFeng Shi  于2019年3月4日周一 上午10:35写道：
> > >
> > >> Hi all,
> > >>
> > >> I have created a build for Apache Kylin 2.6.1, release candidate 1.
> > >>
> > >> Changes highlights:
> > >> [KYLIN-3494] - Build cube with spark reports
> > ArrayIndexOutOfBoundsException
> > >> [KYLIN-3537] - Use Spark to build Cube on Yarn failed at Setp8 on 
HDP3.
> > >> [KYLIN-3815] - Unexpected behavior when joining the streaming table 
and
> > >> hive table
> > >> [KYLIN-3828] - ArrayIndexOutOfBoundsException thrown when building a
> > >> streaming cube with empty data in its first dimension
> > >> [KYLIN-3833] - Potential OOM in Spark Extract Fact Table Distinct
> > Columns
> > >> step
> > >> [KYLIN-3826] - MergeCuboidJob only uploads necessary segment's
> > dictionary
> > >>
> > >> Thanks to everyone who has contributed to this release.
> > >> Here’s the release notes:
> > >>
> > >>
> > 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121&version=12344845
> > >>
> > >> The commit to being voted upon:
> > >>
> > >>
> > >>
> > 
https://github.com/apache/kylin/commit/270cfe68ecc94c66141b29e2ccf20b9ec25e23dd
> > >>
> > >> Its hash is 270cfe68ecc94c66141b29e2ccf20b9ec25e23dd.
> > >>
> > >> The artifacts to be voted on are located here:
> > >> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.1-rc1/
> > >>
> > >> The hash of the artifact is as follows:
> > >> apache-kylin-2.6.1-source-release.zip.sha256
> > >> 961b8c8d0e781fe7936efb7f33cebb9661b4fbf83082669769a41b47cea19001
> > >>
> > >> A staged Maven repository is available for review at:
> > >> 
https://repository.apache.org/content/repositories/orgapachekylin-1060/
> > >>
> > >> Release artifacts are signed with the following key:
> > >> https://people.apache.org/keys/committer/shaofengshi.asc
> > >>
> > >> Please vote on releasing this package as Apache Kylin 2.6.1.
> > >>
> > >> The vote is open for the next 72 hours and passes if a majority of
> > >> at least three +1 PMC votes are cast.
> > >>
> > >> [ ] +1 Release this package as Apache Kylin 2.6.1
> > >> [ ]  0 I don't feel strongly about it, but I'm okay with the release
> > >> [ ] -1 Do not release this package because...
> > >>
> > >>
> > >> Here is my vote:
> > >>
> > >> +1 (binding)
> > >>
> > >> Best regards,
> > >>
> > >> Shaofeng Shi 史少锋
> > >> Apache Kylin PMC
> > >> Work email: shaofeng@kyligence.io
> > >> Kyligence Inc: https://kyligence.io/
> > >>
> > >> Apache Kylin FAQ: 
https://kylin.apache.org/docs/gettingstarted/faq.html
> > >> Join Kylin user mail group: user-subscr...@kylin.apache.org
> > >> Join Kylin dev mail group: dev-subscr...@kylin.apache.org
> > >>
> >
> >

Re: kylin连接sqlserver数据库： kylin生成的sql语句有反单引号 `, 查询sqlserver报错了

2019-02-28 Thread Rongchuan Jin

Hi,
As far as I know, there is only MySQL adaptor for Apache Kylin. If you 
want to use adaptor for SQLServer. Please refer to 
http://download.kyligence.io/#/download . You just need to register a Kyligence 
Account.

Best Regards
Rongchuan.Jin

 

在 2019/2/28 下午7:39，“PENG Zhengshuai” 写入:

Hi,

You should put the "sql.enable-quote-all-identifiers = false “ in your 
mssql.xml as a “PROPERTY”

An example as below:




And please make sure you have added the Adaptor for msserver


BR
PENG Zhengshuai


On Feb 28, 2019, at 6:36 PM, 奥威软件 
<3513797...@qq.com> wrote:

确定没有写错dialect

[cid:3400FE11@D13FCE4E.C4B9775C]

sql.enable-quote-all-identifiers = false 放在那里的，放在kylin.properties里不生效
如果不是这样用的，要怎么用？ 谢谢
[cid:2F04F80E@5FB6275E.C4B9775C]

-- 原始邮件 --
发件人: "张 佑铖"mailto:edouard...@hotmail.com>>;
发送时间: 2019年2月28日(星期四) 晚上6:06
收件人: 
"dev@kylin.apache.org"mailto:dev@kylin.apache.org>>;
主题: Re: 回复： kylin连接sqlserver数据库： kylin生成的sql语句有反单引号 `, 查询sqlserver报错了

Hi,



You should create a configuration file maybe name mssql.xml to define 
configuration to adapt Microsoft Sqlserver.



As you mentioned I guess you define DIALECT="mysql", actually mysql use ` 
as quote. You should define DIALECT="mssql" in mssql.xml.

And if you don't want to enable quote, you can set 
"sql.enable-quote-all-identifiers = false" to disable quote.



Best Regards

Youcheng Zhang





在 2019/2/28 下午3:53，“奥威软件”<3513797...@qq.com> 写入:



请问有详细的操作说明文档吗？





datasource_sdk能解决kylin生成的sql查询语语句带有 ` 问题吗？





-- 原始邮件 --

发件人: "PENG 
Zhengshuai"mailto:cosine...@hotmail.com>>;

发送时间: 2019年2月28日(星期四) 下午2:13

收件人: 
"dev@kylin.apache.org"mailto:dev@kylin.apache.org>>;



主题: Re: kylin连接sqlserver数据库： kylin生成的sql语句有反单引号 `,  查询sqlserver报错了







Hi，



If you want to connect to RDBMS, you need a datasource-sdk for specific 
RDBMS.

Please refer to http://kylin.apache.org/development/datasource_sdk.html



BR

PENG Zhengshuai



On Feb 28, 2019, at 1:36 PM, 奥威软件 
<3513797...@qq.com> wrote:



kylin连接sqlserver数据库： kylin生成的sql语句有反单引号 `,  查询sqlserver报错了

[cid:2BFC6A82@35529157.4F73775C]



将查询语句单独拿出来，并删除反单引号 ` ，执行语句是成功的

Re: [Discuss] Moving toward Apache Kylin 3.0

2019-01-24 Thread Rongchuan Jin

+1

Rongchuan.Jin
 

在 2019/1/25 上午11:37，“PENG Zhengshuai” 写入:

+1

> On Jan 23, 2019, at 11:15 PM, Chao Long  wrote:
> 
> +1
> 
> 
> For parquet storage, I recently completed the development of removing 
dict from the query side, and the query performance has been inproved a lot. 
But there is still a lot of work to do, like removing query single-point issue, 
upgrading parquet to 1.11 for page index and etc. So I think release it in 
Kylin 3.0 is a great choice.
> --
> Best Regards,
> Chao Long
> 
> 
> -- 原始邮件 --
> 发件人: "ShaoFeng Shi";
> 发送时间: 2019年1月23日(星期三) 下午3:56
> 收件人: "dev";
> 
> 主题: [Discuss] Moving toward Apache Kylin 3.0
> 
> 
> 
> Hi Kylin developers,
> 
> In last week, Kylin released v2.6.0, with the enhanced & distributed query
> cache and JDBC data source SDK. After this release, the next batch
> candidate features include real-time streaming, parquet storage, and druid
> storage. These features were developed in the past 1-2 years by different
> Kylin players and were open sourced in the past 6 months. They have 
already
> been staged in separate branches and are under evaluation by the 
community.
> We have received much feedback from the community.
> 
> These candidate features are big supplements to as-is Kylin functions; For
> example, the real-time streaming feature will bring Kylin from batch &
> historical analytics into real-time analytics. The parquet storage will
> make the deployment more flexible and more cloud-friendly. Of course,
> stabilizing and improving these features need additional time and effort.
> 
> So, when we merging and releasing them, we'd better give it a new version
> number so that user can clearly know the difference with current 2.x
> versions. I discussed this with several developers offline, we think it is
> time to move toward Kylin 3.0. So, if one of the above features is merged,
> the version will be 3.0. The current 2.6 will be maintained until 3.x is
> ready for production use.
> 
> Your comments, ideas, and suggestions are welcomed!
> 
> Best regards,
> 
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Work email: shaofeng@kyligence.io
> Kyligence Inc: https://kyligence.io/
> 
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscr...@kylin.apache.org
> Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: Using mysql as adata source instead of Kylin

2019-01-21 Thread Rongchuan Jin

Hi hubert:
Thanks to @youcheng.zhang (JIRA) who has fixed this bug. You can 
cherry-pick this 
commit(https://github.com/apache/kylin/commit/b4dace4db8304a53082265e614384132316801bb)
 now or wait for 
the next release. 

Best Regards
Rongchuan.Jin

 

在 2019/1/16 下午6:15，“Rongchuan Jin” 写入:

Hi hubert:
I don’t think root cause is conflict between pushdown property.

Best Regards
Rongchuan.Jin

 

在 2019/1/16 下午5:50，“hubert stefani” 写入:

 Ok. I will create the JIRA in a few minutes. Any chance there is a 
conflict in the configuration with the  kylin.query.pushdown.jdbc. properties  ?

Le mercredi 16 janvier 2019 à 10:46:59 UTC+1, Rongchuan Jin 
 a écrit :  
 
 Hi hubert:
  Your configuration seems okay. I reproduced it in my environment, it 
seems like a bug within ClassLoader. Welcome to create a JIRA ticket.

Best Regards
Rongchuan.Jin

 

在 2019/1/16 下午5:36，“hubert stefani” 写入:

Please find hereunder the kylin properties lines related to mysql 
jdbc connection:  (it works properly through spark shell script)

# NOVAGEN -- CUSTOM CONFIGURATION FOR MYSQL AS SOURCE

kylin.source.jdbc.connection-url=jdbc:mysql://ip-172-31-36-94.eu-west-1.compute.internal:3306/decat
kylin.source.jdbc.driver=com.mysql.jdbc.Driver
kylin.source.jdbc.dialect=mysql
kylin.source.jdbc.user=root
kylin.source.jdbc.pass=

kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushdownRunnerSDKImpl
kylin.source.default=16
kylin.source.jdbc.sqoop-home=/usr/bin

kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.MysqlAdaptor



Le mercredi 16 janvier 2019 à 05:54:51 UTC+1, Rongchuan Jin 
 a écrit :  

Hi Hubert,
Could you please provide your kylin.properties with prefix 
“kylin.source.jdbc ” or just show your project configurations. I think it’s 
easier to find the root cause.

Best Regards
Rongchuan.Jin


在 2019/1/14 下午9:24，“hubert 
stefani” 写入:

Hi,
  we are currently trying to test the KYLIN-3552 feature to 
rely directly on Mysql for data source instead of Hive. 

(we tried as much as possible to add correct info in 
kylin.properties, add mysql jdbc drivers, create mysql.xml in 
./conf/datasources ... as mentioned in 
https://github.com/apache/kylin/pull/327/files )



the error we entountered is ( excerpt from kylin.log ) :

2019-01-14 09:48:16,223 WARN  [http-bio-7070-exec-2] 
extensible.JdbcSource:50 : DataSource cannot be connected. This may not be 
required in a MapReduce job.
java.lang.LinkageError: loader constraint violation: loader 
(instance of sun/misc/Launcher$AppClassLoader) previously initiated loading for 
a different type with name "org/apache/kylin/common/KylinConfig"
at java.lang.ClassLoader.defineClass1(Native Method)
at 
java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at 
java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at 
java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at 
java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at 
java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native 
Method)
at 
java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at 
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:27)


with further trace : 

2019-01-14 09:48:16,229 ERROR [http-bio-7070-exec-2] 
controller.TableController:197 : 
java.lang.NullPointerException
at 
org.apache.kylin.source.jdbc.extensible.JdbcExplorer.listDatabases(JdbcExplorer.java:58)
at 
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:280)

Re: Using mysql as adata source instead of Kylin

2019-01-16 Thread Rongchuan Jin

Hi hubert:
I don’t think root cause is conflict between pushdown property.

Best Regards
Rongchuan.Jin

 

在 2019/1/16 下午5:50，“hubert stefani” 写入:

 Ok. I will create the JIRA in a few minutes. Any chance there is a 
conflict in the configuration with the  kylin.query.pushdown.jdbc. properties  ?

Le mercredi 16 janvier 2019 à 10:46:59 UTC+1, Rongchuan Jin 
 a écrit :  
 
 Hi hubert:
  Your configuration seems okay. I reproduced it in my environment, it 
seems like a bug within ClassLoader. Welcome to create a JIRA ticket.

Best Regards
Rongchuan.Jin

 

在 2019/1/16 下午5:36，“hubert stefani” 写入:

Please find hereunder the kylin properties lines related to mysql jdbc 
connection:  (it works properly through spark shell script)

# NOVAGEN -- CUSTOM CONFIGURATION FOR MYSQL AS SOURCE

kylin.source.jdbc.connection-url=jdbc:mysql://ip-172-31-36-94.eu-west-1.compute.internal:3306/decat
kylin.source.jdbc.driver=com.mysql.jdbc.Driver
kylin.source.jdbc.dialect=mysql
kylin.source.jdbc.user=root
kylin.source.jdbc.pass=

kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushdownRunnerSDKImpl
kylin.source.default=16
kylin.source.jdbc.sqoop-home=/usr/bin

kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.MysqlAdaptor



Le mercredi 16 janvier 2019 à 05:54:51 UTC+1, Rongchuan Jin 
 a écrit :  

Hi Hubert,
Could you please provide your kylin.properties with prefix 
“kylin.source.jdbc ” or just show your project configurations. I think it’s 
easier to find the root cause.

Best Regards
Rongchuan.Jin


在 2019/1/14 下午9:24，“hubert stefani” 写入:

Hi,
  we are currently trying to test the KYLIN-3552 feature to rely 
directly on Mysql for data source instead of Hive. 

(we tried as much as possible to add correct info in 
kylin.properties, add mysql jdbc drivers, create mysql.xml in 
./conf/datasources ... as mentioned in 
https://github.com/apache/kylin/pull/327/files )



the error we entountered is ( excerpt from kylin.log ) :

2019-01-14 09:48:16,223 WARN  [http-bio-7070-exec-2] 
extensible.JdbcSource:50 : DataSource cannot be connected. This may not be 
required in a MapReduce job.
java.lang.LinkageError: loader constraint violation: loader 
(instance of sun/misc/Launcher$AppClassLoader) previously initiated loading for 
a different type with name "org/apache/kylin/common/KylinConfig"
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at 
java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at 
java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native 
Method)
at 
java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at 
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:27)


with further trace : 

2019-01-14 09:48:16,229 ERROR [http-bio-7070-exec-2] 
controller.TableController:197 : 
java.lang.NullPointerException
at 
org.apache.kylin.source.jdbc.extensible.JdbcExplorer.listDatabases(JdbcExplorer.java:58)
at 
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:280)
at 
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:195)

do you have any idea ? 
Is there a User guide ?

Re: Using mysql as adata source instead of Kylin

2019-01-16 Thread Rongchuan Jin

Hi hubert:
  Your configuration seems okay. I reproduced it in my environment, it seems 
like a bug within ClassLoader. Welcome to create a JIRA ticket.

Best Regards
Rongchuan.Jin

 

在 2019/1/16 下午5:36，“hubert stefani” 写入:

 Please find hereunder the kylin properties lines related to mysql jdbc 
connection:  (it works properly through spark shell script)

# NOVAGEN -- CUSTOM CONFIGURATION FOR MYSQL AS SOURCE

kylin.source.jdbc.connection-url=jdbc:mysql://ip-172-31-36-94.eu-west-1.compute.internal:3306/decat
kylin.source.jdbc.driver=com.mysql.jdbc.Driver
kylin.source.jdbc.dialect=mysql
kylin.source.jdbc.user=root
kylin.source.jdbc.pass=

kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushdownRunnerSDKImpl
kylin.source.default=16
kylin.source.jdbc.sqoop-home=/usr/bin

kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.MysqlAdaptor



Le mercredi 16 janvier 2019 à 05:54:51 UTC+1, Rongchuan Jin 
 a écrit :  
 
 Hi Hubert,
Could you please provide your kylin.properties with prefix 
“kylin.source.jdbc ” or just show your project configurations. I think it’s 
easier to find the root cause.

Best Regards
Rongchuan.Jin
 

在 2019/1/14 下午9:24，“hubert stefani” 写入:

Hi,
  we are currently trying to test the KYLIN-3552 feature to rely 
directly on Mysql for data source instead of Hive. 

(we tried as much as possible to add correct info in kylin.properties, 
add mysql jdbc drivers, create mysql.xml in ./conf/datasources ... as mentioned 
in https://github.com/apache/kylin/pull/327/files )



the error we entountered is ( excerpt from kylin.log ) :

2019-01-14 09:48:16,223 WARN  [http-bio-7070-exec-2] 
extensible.JdbcSource:50 : DataSource cannot be connected. This may not be 
required in a MapReduce job.
java.lang.LinkageError: loader constraint violation: loader (instance 
of sun/misc/Launcher$AppClassLoader) previously initiated loading for a 
different type with name "org/apache/kylin/common/KylinConfig"
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:27)


with further trace : 

2019-01-14 09:48:16,229 ERROR [http-bio-7070-exec-2] 
controller.TableController:197 : 
java.lang.NullPointerException
at 
org.apache.kylin.source.jdbc.extensible.JdbcExplorer.listDatabases(JdbcExplorer.java:58)
at 
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:280)
at 
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:195)

do you have any idea ? 
Is there a User guide ?

Re: Using mysql as adata source instead of Kylin

2019-01-15 Thread Rongchuan Jin

Hi Hubert,
Could you please provide your kylin.properties with prefix 
“kylin.source.jdbc ” or just show your project configurations. I think it’s 
easier to find the root cause.

Best Regards
Rongchuan.Jin
 

在 2019/1/14 下午9:24，“hubert stefani” 写入:

Hi,
  we are currently trying to test the KYLIN-3552 feature to rely directly 
on Mysql for data source instead of Hive. 

(we tried as much as possible to add correct info in kylin.properties, add 
mysql jdbc drivers, create mysql.xml in ./conf/datasources ... as mentioned in 
https://github.com/apache/kylin/pull/327/files )



the error we entountered is ( excerpt from kylin.log ) :

2019-01-14 09:48:16,223 WARN  [http-bio-7070-exec-2] 
extensible.JdbcSource:50 : DataSource cannot be connected. This may not be 
required in a MapReduce job.
java.lang.LinkageError: loader constraint violation: loader (instance of 
sun/misc/Launcher$AppClassLoader) previously initiated loading for a different 
type with name "org/apache/kylin/common/KylinConfig"
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:27)


with further trace : 

2019-01-14 09:48:16,229 ERROR [http-bio-7070-exec-2] 
controller.TableController:197 : 
java.lang.NullPointerException
at 
org.apache.kylin.source.jdbc.extensible.JdbcExplorer.listDatabases(JdbcExplorer.java:58)
at 
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:280)
at 
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:195)

do you have any idea ? 
Is there a User guide ?

Re:Using mysql as adata source instead of Kylin

2019-01-14 Thread Rongchuan Jin

Hello hubert
 as a fact,you don't need to create mysql.xml since it has been packaged to 
binary.Besides,the directory is #KYLIN_HOME/conf/datasource,there is no 's' 
character.

Best Regards
    Rongchuan Jin



发自我的小米手机
在 hubert stefani ，2019年1月14日 下午9:24写道：

Hi,
  we are currently trying to test the KYLIN-3552 feature to rely directly on 
Mysql for data source instead of Hive.

(we tried as much as possible to add correct info in kylin.properties, add 
mysql jdbc drivers, create mysql.xml in ./conf/datasources ... as mentioned in 
https://github.com/apache/kylin/pull/327/files )



the error we entountered is ( excerpt from kylin.log ) :

2019-01-14 09:48:16,223 WARN  [http-bio-7070-exec-2] extensible.JdbcSource:50 : 
DataSource cannot be connected. This may not be required in a MapReduce job.
java.lang.LinkageError: loader constraint violation: loader (instance of 
sun/misc/Launcher$AppClassLoader) previously initiated loading for a different 
type with name "org/apache/kylin/common/KylinConfig"
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at 
java.net<http://java.net>.URLClassLoader.defineClass(URLClassLoader.java:467)
at 
java.net<http://java.net>.URLClassLoader.access$100(URLClassLoader.java:73)
at 
java.net<http://java.net>.URLClassLoader$1.run(URLClassLoader.java:368)
at 
java.net<http://java.net>.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at 
java.net<http://java.net>.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:27)


with further trace :

2019-01-14 09:48:16,229 ERROR [http-bio-7070-exec-2] 
controller.TableController:197 :
java.lang.NullPointerException
at 
org.apache.kylin.source.jdbc.extensible.JdbcExplorer.listDatabases(JdbcExplorer.java:58)
at 
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:280)
at 
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:195)

do you have any idea ?
Is there a User guide ?

Re: [VOTE] Release apache-kylin-2.6.0 (RC1)

2019-01-09 Thread Rongchuan Jin

+1


金荣钏/Rongchuan.Jin
 

在 2019/1/10 上午9:49，“ShaoFeng Shi” 写入:

Checked the source package, the signature, and the sha256 hash;

Mvn package and test are all successful with jdk 1.8.0_111 on Mac;

+1 (binding)

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Work email: shaofeng@kyligence.io
Kyligence Inc: https://kyligence.io/

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org




JiaTao Tao  于2019年1月10日周四 上午9:42写道：

> +1
> mvn test passed
>
> Yanghong Zhong  于2019年1月9日周三 上午2:46写道：
>
> > Hi all,
> >
> > I have created a build for Apache Kylin 2.6.0, release candidate 1.
> >
> > Changes highlights:
> > [KYLIN-2895] - Refine query cache by changing the query cache expiration
> > strategy by signature checking and introducing memcached as distributed
> > cache
> > [KYLIN-2932] - Simplify the thread model for in-memory cubing
> > [KYLIN-3021] - Check MapReduce job failed reason and include the
> > diagnostics into email notification
> > [KYLIN-3272] - Upgrade Spark dependency to 2.3.2
> > [KYLIN-3540] - Improve Mandatory Cuboid Recommendation Algorithm
> > [KYLIN-3552] - Data Source SDK to ingest data from different JDBC 
sources
> > [KYLIN-3611] - Upgrade Tomcat to 7.0.91, 8.5.34 or later
> > [KYLIN-3656] - Improve HLLCounter performance
> > [KYLIN-3700] - Quote sql identities when creating flat table
> > [KYLIN-3729] - CLUSTER BY CAST(field AS STRING) will accelerate base
> cuboid
> > build with UHC global dict
> >
> > Thanks to everyone who has contributed to this release.
> > Here’s release notes:
> >
> >
> 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121&version=12344003
> >
> > The commit to be voted upon:
> >
> >
> >
> 
https://github.com/apache/kylin/commit/8737bc1f555a2789a67462c8f8420b6ab3be97ce
> >
> > Its hash is 8737bc1f555a2789a67462c8f8420b6ab3be97ce.
> >
> > The artifacts to be voted on are located here:
> > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.0-rc1/
> >
> > The hash of the artifact is as follows:
> > apache-kylin-2.6.0-source-release.zip.sha256
> >
> > 3621750945823ff4f0c4124b6d5b5c7164d9b08686729352ea22b2f486958d2a
> >
> > A staged Maven repository is available for review at:
> > https://repository.apache.org/content/repositories/orgapachekylin-1059/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/nju_yaho.asc
> >
> > Please vote on releasing this package as Apache Kylin 2.6.0.
> >
> > The vote is open for the next 72 hours and passes if a majority of
> > at least three +1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Kylin 2.6.0
> > [ ]  0 I don't feel strongly about it, but I'm okay with the release
> > [ ] -1 Do not release this package because...
> >
> >
> > Here is my vote:
> >
> > +1 (binding)
> >
> > Best regards,
> > Yanghong Zhong
> > eBay Inc.
> >
>
>
> --
>
>
> Regards!
>
> Aron Tao
>

Re: [VOTE] Release apache-kylin-2.5.2 (RC2)

2018-12-01 Thread Rongchuan Jin

+1 
mvn test passed

 

在 2018/12/1 下午5:15，“zhan shaoxiong” 写入:

+1 mvn test passed.

On [DATE], "[NAME]" <[ADDRESS]> wrote:

+1

Local CI pass


Best wishes,
Xiaoxiang Yu 
 

On [DATE], "[NAME]" <[ADDRESS]> wrote:

Hi all,

I have created a build for Apache Kylin 2.5.2, release candidate 2.

Changes:
[KYLIN-3187] - JDK APIs using the default locale, time zone or 
character
set should be avoided
[KYLIN-3636] - Wrong "storage_type" in CubeDesc causing cube 
building error
[KYLIN-3666] - Mege cube step 2: Update dictionary throws
IllegalStateException
[KYLIN-3672] - Performance is poor when multiple queries occur in a 
short
period
[KYLIN-3676] - Update to custom calcite and remove the "atopcalcite"
[KYLIN-3678] - CacheStateChecker may remove a cache file that under 
a
building
[KYLIN-3683] - Package org.apache.commons.lang3 not exists
[KYLIN-3689] - When the startTime is equal to the endTime in build 
request,
the segment will build all data.
[KYLIN-3693] - TopN, Count distinct incorrect in Spark engine
[KYLIN-3705] - Segment Pruner mis-functions when the source data has
Chinese characters
Thanks to everyone who has contributed to this release.

Here are release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121&version=12344466

The commit to being voted upon:


https://github.com/apache/kylin/commit/0e519d859e217fbfadd534313376e532d2c647fa

Its hash is 0e519d859e217fbfadd534313376e532d2c647fa.

The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.5.2-rc2/

The hashe of the artifact is as follows:
apache-kylin-2.5.2-source-release.zip.sha256
fca5688cf64442ea595e07c2a4a4b2b549836d268ce8f10f3d559f05c22b61d0

A staged Maven repository is available for review at:

https://repository.apache.org/content/repositories/orgapachekylin-1058/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/shaofengshi.asc

Please vote on releasing this package as Apache Kylin 2.5.2.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PPMC votes are cast.

[ ] +1 Release this package as Apache Kylin 2.5.2
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...


Here is my vote:

+1 (binding)

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Work email: shaofeng@kyligence.io
Kyligence Inc: https://kyligence.io/

Apache Kylin FAQ: 
https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: 回复： [VOTE] Release apache-kylin-2.5.0 (RC2)

2018-09-14 Thread Rongchuan Jin

+1 
mvn test passed


 

在 2018/9/14 下午6:50，“zhan shaoxiong” 写入:

+1

在 2018/9/14 下午6:08，“Chao Long” 写入:

+1

mvn test passed




-- 原始邮件 --
发件人: "Lijun Cao"<641507...@qq.com>;
发送时间: 2018年9月14日(星期五) 下午5:56
收件人: "dev";

主题: Re: [VOTE] Release apache-kylin-2.5.0 (RC2)



+1

> 在 2018年9月14日，16:20，Na Zhai  写道：
> 
> +1
> 
> mvn test passed
> 
> 
> 
> 发送自 Windows 10 版邮件应用
> 
> 
> 
> 
> 发件人: 李 栋 
> 发送时间: Friday, September 14, 2018 2:28:05 PM
> 收件人: dev@kylin.apache.org
> 主题: RE: [VOTE] Release apache-kylin-2.5.0 (RC2)
> 
> +1 binding
> 
> mvn test passed
> 
> Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 
2018-06-17T18:33:14Z)
> Maven home: /opt/apache-maven-3.5.4
> Java version: 1.8.0_161, vendor: Oracle Corporation, runtime: 
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-3.b14.el6_9.x86_64/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "2.6.32-573.18.1.el6.x86_64", arch: 
"amd64", family: "unix"
> 
> Thanks,
> Dong Li
> 
> 
> -Original Message-
> From: Luke Han 
> Sent: Friday, September 14, 2018 11:53 AM
> To: dev 
> Subject: Re: [VOTE] Release apache-kylin-2.5.0 (RC2)
> 
> +1 binding
> 
> maven test passed
> 
> Best Regards!
> -
> 
> Luke Han
> 
> 
> On Thu, Sep 13, 2018 at 11:22 AM Zhong, Yanghong  
wrote:
> 
>> mvn clean test, passed
>> 
>> +1 binding
>> 
>> My environment:
>> Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
>> 2018-06-18T02:33:14+08:00)
>> Maven home: /Users/yangzhong/Software/apache-maven-3.5.4
>> Java version: 1.8.0_66, vendor: Oracle Corporation, runtime:
>> /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jre
>> Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x",
>> version: "10.11.6", arch: "x86_64", family: "mac"
>> 
>> Best regards,
>> Yanghong Zhong
>> 
>> On 9/13/18, 1:53 PM, "ShaoFeng Shi"  wrote:
>> 
>>Hi all,
>> 
>>I have created a build for Apache Kylin 2.5.0, release candidate 
2. The
>>difference between RC1 and RC2 is just changing the 
scala-maven-plugin
>>version from 3.4.2 to 3.4.1.
>> 
>>Changes highlights:
>> 
>>[KYLIN-2565] - Support Hadoop 3.0
>>[KYLIN-3033] - Support HBase 2.0
>>[KYLIN-2998] - Kill spark app when cube job was discarded
>>[KYLIN-3370] - Enhanced segment pruning
>>[KYLIN-3488] - Support MySQL as Kylin metadata storage
>>[KYLIN-3418] - User interface for Hybrid model
>>[KYLIN-3419] - Upgrade to Java 8
>>[KYLIN-3421] - Improve job scheduler fetch performance
>>[KYLIN-3427] - Convert to HFile in Spark
>>[KYLIN-3441] - Merge cube segments in Spark
>>[KYLIN-3442] - Fact distinct columns in Spark
>>[KYLIN-3453] - Improve cube size estimation for TOPN, COUNT 
DISTINCT
>>[KYLIN-3457] - Distribute by multi columns if not set distribute 
column
>>[KYLIN-3471] - Merge dictionary and statistics on Yarn
>>[KYLIN-3480] - Change the conformance of calcite from default to
>> lenient
>>[KYLIN-3491] - Improve the cube building process when using global
>>dictionary
>>[KYLIN-3521] - Enable Cube Planner by default
>> 
>>Thanks to everyone who has contributed to this release.
>>Here are release notes:
>> 
>> 
https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissue
>> 
s.apache.org%2Fjira%2Fsecure%2FReleaseNote.jspa%3FprojectId%3D12316121
>> 
%26version%3D12343540&data=02%7C01%7Cyangzhong%40ebay.com%7Ca764ee
>> 
fe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%
>> 
7C636724148150769018&sdata=jfiVgq93KvjoHS3vPOvQ0zwNKvQ0zra%2BLSA3U
>> XETTFs%3D&reserved=0
>> 
>>The commit to being voted upon:
>> 
>> 
https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithu
>> 
b.com%2Fapache%2Fkylin%2Fcommit%2F158f8768debe99746c66e516e4596707a476
>> 
d7d6&data=02%7C01%7Cyangzhong%40e

Re: [ANNOUNCE] New Committer: Jiatao Tao

Re: [VOTE] Release apache-kylin-2.6.1 (RC1)

Re: kylin连接sqlserver数据库： kylin生成的sql语句有反单引号 `, 查询sqlserver报错了

Re: [Discuss] Moving toward Apache Kylin 3.0

Re: Using mysql as adata source instead of Kylin

Re: Using mysql as adata source instead of Kylin

Re: Using mysql as adata source instead of Kylin

Re: Using mysql as adata source instead of Kylin

Re:Using mysql as adata source instead of Kylin

Re: [VOTE] Release apache-kylin-2.6.0 (RC1)

Re: [VOTE] Release apache-kylin-2.5.2 (RC2)

Re: 回复： [VOTE] Release apache-kylin-2.5.0 (RC2)

12 matches

Site Navigation

Mail list logo

Footer information