[DISCUSS] Collect Kylin best practices with Apache Wiki
Hello Kylin users, I'm proposing to collect the Kylin best practices with Apache Wiki. I have created an entry page, and start to compose some there. If you want to share or contribute, please email to the group, then we will review and add to it. The practice should be brief and easy to understand; If it need to dive into detail, a reference link can be provided together. Let's try, thank you! Here is the wiki link: https://cwiki.apache.org/confluence/display/KYLIN/Best+practices Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org
Re:[DISCUSS] Collect Kylin best practices with Apache Wiki
+1 Great, wiki is good place to share knowledge and it is easy to use. I will share what I found when I have some free time. -- Best wishes to you ! From ：Xiaoxiang Yu At 2020-02-18 20:15:52, "ShaoFeng Shi" wrote: Hello Kylin users, I'm proposing to collect the Kylin best practices with Apache Wiki. I have created an entry page, and start to compose some there. If you want to share or contribute, please email to the group, then we will review and add to it. The practice should be brief and easy to understand; If it need to dive into detail, a reference link can be provided together. Let's try, thank you! Here is the wiki link: https://cwiki.apache.org/confluence/display/KYLIN/Best+practices Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org
[jira] [Created] (KYLIN-4382) Unable to use DATE type in prepared statements
Gabor Arki created KYLIN-4382:
-
Summary: Unable to use DATE type in prepared statements
Key: KYLIN-4382
URL: https://issues.apache.org/jira/browse/KYLIN-4382
Project: Kylin
Issue Type: Bug
Components: Query Engine
Reporter: Gabor Arki
h4. Environment
* Kylin JDBC driver: 3.0.0
* Kylin server: 3.0.0
h4. Reproduction steps
* Use a cube with a DATE column (like the derived day_start)
* Create a prepared statement and try to filter with this column in a where
clause
* Pass the values as java.sql.Date type
h4. Expected result
* The proper response is provided for the query with the values for the
specified date(s)
h4. Actual result
* No data is returned
*
StreamStorageQuery's _Skip cube segment_ log message is containing the filter
with an epoch day value, for example: {{}}{{DAY_START GTE [18231]}}
* Executing the same query from the web UI you get the expected response. Now
the same log message is containing the filter in epoch millis format, for
example: {{DAY_START IN [158077440, 158086080]}}
* Passing the value as String instead of java.sql.Date fails on server-side
with: {{exception while executing query: java.lang.String cannot be cast to
java.lang.Integer}}
* Passing the value as java.sql.Timestamp or java.util.Date fails on
server-side with: {{exception while executing query: java.lang.Long cannot be
cast to java.lang.Integer}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
JDBC Issue with Postgresql
I am running kylin from this binary distribution, https://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-3.0.0/apache-kylin-3.0.0-bin-hadoop3.tar.gz However, couldn’t get Postgresql loading with this configuration, kylin.source.default=16 kylin.source.jdbc.connection-url=jdbc:postgresql://xxx kylin.source.jdbc.driver=org.postgresql.Driver kylin.source.jdbc.dialect=postgresql kylin.source.jdbc.user=postgres kylin.source.jdbc.pass=xxx kylin.source.jdbc.sqoop-home=/home/hadoop/sqoop kylin.source.jdbc.filed-delimiter=| kylin.source.jdbc.sqoop-mapper-num=4 kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.DefaultAdaptor kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushdownRunnerSDKImpl Someone suggested using PostgresqlAdaptor but it’s not included in this release. Here is the exception I am getting, 2020-02-18 22:26:29,274 WARN [http-nio-7070-exec-7] extensible.JdbcSource:50 : DataSource cannot be connected. This may not be required in a MapReduce job. java.lang.RuntimeException: Failed to get JdbcConnector from env. at org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:45) at org.apache.kylin.source.jdbc.extensible.JdbcSource.(JdbcSource.java:48) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.kylin.source.SourceManager.createSource(SourceManager.java:116) at org.apache.kylin.source.SourceManager.getCachedSource(SourceManager.java:84) at org.apache.kylin.source.SourceManager.getProjectSource(SourceManager.java:93) at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:284) at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:196) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) …… Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.kylin.sdk.datasource.framework.AdaptorFactory.createJdbcAdaptor(AdaptorFactory.java:26) at org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:43) ... 88 more Caused by: java.lang.NullPointerException at org.apache.kylin.sdk.datasource.adaptor.AbstractJdbcAdaptor.getSourceValidationSql(AbstractJdbcAdaptor.java:100) at org.apache.kylin.sdk.datasource.adaptor.AbstractJdbcAdaptor.(AbstractJdbcAdaptor.java:86) at org.apache.kylin.sdk.datasource.adaptor.DefaultAdaptor.(DefaultAdaptor.java:43) ... 94 more 2020-02-18 22:26:29,279 ERROR [http-nio-7070-exec-7] controller.TableController:198 : java.lang.NullPointerException at org.apache.kylin.source.jdbc.extensible.JdbcExplorer.listDatabases(JdbcExplorer.java:58) at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:286) at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:196) ….. Any help is appreciated. Thanks! Zhihong Zhang
[RESULT][VOTE] Release apache-kylin-3.0.1 (RC2)
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 4 binding +1s: Shaofeng Shi Chunen Ni Luke Han Dong Li 3 non-binding +1s: Xiaoyuan Gu Yaqian Zhang Wang Rupeng Xiaoyuan Gu No 0s or -1s. Therefore I am delighted to announce that the proposal to release Apache-Kylin-3.0.1 has passed. -- - Best regards, Ni Chunen / George
[RESULT][VOTE] Release apache-kylin-2.6.5 (RC2)
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 4 binding +1s: Shaofeng Shi Chunen Ni Luke Han Dong Li 5 non-binding +1s: Xiaoyuan Gu Yaqian Zhang Xiaoxiang Yu Weibin Zhu Wang Rupeng No 0s or -1s. Therefore I am delighted to announce that the proposal to release Apache-Kylin-2.6.5 has passed. -- - Best regards, Ni Chunen / George
