[DISCUSS] Collect Kylin best practices with Apache Wiki
Hello Kylin users, I'm proposing to collect the Kylin best practices with Apache Wiki. I have created an entry page, and start to compose some there. If you want to share or contribute, please email to the group, then we will review and add to it. The practice should be brief and easy to understand; If it need to dive into detail, a reference link can be provided together. Let's try, thank you! Here is the wiki link: https://cwiki.apache.org/confluence/display/KYLIN/Best+practices Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org
Re:[DISCUSS] Collect Kylin best practices with Apache Wiki
+1 Great, wiki is good place to share knowledge and it is easy to use. I will share what I found when I have some free time. -- Best wishes to you ! From :Xiaoxiang Yu At 2020-02-18 20:15:52, "ShaoFeng Shi" wrote: Hello Kylin users, I'm proposing to collect the Kylin best practices with Apache Wiki. I have created an entry page, and start to compose some there. If you want to share or contribute, please email to the group, then we will review and add to it. The practice should be brief and easy to understand; If it need to dive into detail, a reference link can be provided together. Let's try, thank you! Here is the wiki link: https://cwiki.apache.org/confluence/display/KYLIN/Best+practices Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org
[jira] [Created] (KYLIN-4382) Unable to use DATE type in prepared statements
Gabor Arki created KYLIN-4382: - Summary: Unable to use DATE type in prepared statements Key: KYLIN-4382 URL: https://issues.apache.org/jira/browse/KYLIN-4382 Project: Kylin Issue Type: Bug Components: Query Engine Reporter: Gabor Arki h4. Environment * Kylin JDBC driver: 3.0.0 * Kylin server: 3.0.0 h4. Reproduction steps * Use a cube with a DATE column (like the derived day_start) * Create a prepared statement and try to filter with this column in a where clause * Pass the values as java.sql.Date type h4. Expected result * The proper response is provided for the query with the values for the specified date(s) h4. Actual result * No data is returned * StreamStorageQuery's _Skip cube segment_ log message is containing the filter with an epoch day value, for example: {{}}{{DAY_START GTE [18231]}} * Executing the same query from the web UI you get the expected response. Now the same log message is containing the filter in epoch millis format, for example: {{DAY_START IN [158077440, 158086080]}} * Passing the value as String instead of java.sql.Date fails on server-side with: {{exception while executing query: java.lang.String cannot be cast to java.lang.Integer}} * Passing the value as java.sql.Timestamp or java.util.Date fails on server-side with: {{exception while executing query: java.lang.Long cannot be cast to java.lang.Integer}} -- This message was sent by Atlassian Jira (v8.3.4#803005)
JDBC Issue with Postgresql
I am running kylin from this binary distribution, https://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-3.0.0/apache-kylin-3.0.0-bin-hadoop3.tar.gz However, couldn’t get Postgresql loading with this configuration, kylin.source.default=16 kylin.source.jdbc.connection-url=jdbc:postgresql://xxx kylin.source.jdbc.driver=org.postgresql.Driver kylin.source.jdbc.dialect=postgresql kylin.source.jdbc.user=postgres kylin.source.jdbc.pass=xxx kylin.source.jdbc.sqoop-home=/home/hadoop/sqoop kylin.source.jdbc.filed-delimiter=| kylin.source.jdbc.sqoop-mapper-num=4 kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.DefaultAdaptor kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushdownRunnerSDKImpl Someone suggested using PostgresqlAdaptor but it’s not included in this release. Here is the exception I am getting, 2020-02-18 22:26:29,274 WARN [http-nio-7070-exec-7] extensible.JdbcSource:50 : DataSource cannot be connected. This may not be required in a MapReduce job. java.lang.RuntimeException: Failed to get JdbcConnector from env. at org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:45) at org.apache.kylin.source.jdbc.extensible.JdbcSource.(JdbcSource.java:48) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.kylin.source.SourceManager.createSource(SourceManager.java:116) at org.apache.kylin.source.SourceManager.getCachedSource(SourceManager.java:84) at org.apache.kylin.source.SourceManager.getProjectSource(SourceManager.java:93) at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:284) at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:196) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) …… Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.kylin.sdk.datasource.framework.AdaptorFactory.createJdbcAdaptor(AdaptorFactory.java:26) at org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:43) ... 88 more Caused by: java.lang.NullPointerException at org.apache.kylin.sdk.datasource.adaptor.AbstractJdbcAdaptor.getSourceValidationSql(AbstractJdbcAdaptor.java:100) at org.apache.kylin.sdk.datasource.adaptor.AbstractJdbcAdaptor.(AbstractJdbcAdaptor.java:86) at org.apache.kylin.sdk.datasource.adaptor.DefaultAdaptor.(DefaultAdaptor.java:43) ... 94 more 2020-02-18 22:26:29,279 ERROR [http-nio-7070-exec-7] controller.TableController:198 : java.lang.NullPointerException at org.apache.kylin.source.jdbc.extensible.JdbcExplorer.listDatabases(JdbcExplorer.java:58) at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:286) at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:196) ….. Any help is appreciated. Thanks! Zhihong Zhang
[RESULT][VOTE] Release apache-kylin-3.0.1 (RC2)
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 4 binding +1s: Shaofeng Shi Chunen Ni Luke Han Dong Li 3 non-binding +1s: Xiaoyuan Gu Yaqian Zhang Wang Rupeng Xiaoyuan Gu No 0s or -1s. Therefore I am delighted to announce that the proposal to release Apache-Kylin-3.0.1 has passed. -- - Best regards, Ni Chunen / George
[RESULT][VOTE] Release apache-kylin-2.6.5 (RC2)
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 4 binding +1s: Shaofeng Shi Chunen Ni Luke Han Dong Li 5 non-binding +1s: Xiaoyuan Gu Yaqian Zhang Xiaoxiang Yu Weibin Zhu Wang Rupeng No 0s or -1s. Therefore I am delighted to announce that the proposal to release Apache-Kylin-2.6.5 has passed. -- - Best regards, Ni Chunen / George