[jira] [Created] (KYLIN-4076) calcite parse in case when
chenchen created KYLIN-4076: --- Summary: calcite parse in case when Key: KYLIN-4076 URL: https://issues.apache.org/jira/browse/KYLIN-4076 Project: Kylin Issue Type: Bug Affects Versions: v2.6.3 Reporter: chenchen Attachments: image-2019-07-09-16-16-16-162.png, image-2019-07-09-16-19-09-420.png in this version, In SQL statements with case-when, when the name of the field is the same as that of the case-when-as field, the result of the query is not converted to the corresponding string. I wonder if there is a lack of configuration when I upgrade? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-4077) Kylin does not handle queries with GROUP BY constant.
Krzysztof Zarzycki created KYLIN-4077:
-
Summary: Kylin does not handle queries with GROUP BY constant.
Key: KYLIN-4077
URL: https://issues.apache.org/jira/browse/KYLIN-4077
Project: Kylin
Issue Type: Bug
Reporter: Krzysztof Zarzycki
I connect Tableau to Kylin and one of the queries it generates has a clause
{{GROUP BY 1.10001}} , that Kylin cannot handle.
{code:java}
>From line 1, column 8 to line 1, column 15: Aggregate expression is illegal in
>GROUP BY clause while executing SQL: "select count(*) from
>report_sales.kylin_sales_model GROUP BY 1.101 LIMIT 5" {code}
Alternatively, I translated the query with Hive JdbcStorageHandler to {{GROUP
BY TRUE}} and that is also not handled.
{code:java}
No DataTypeSerializer for type _literal_type while executing SQL: "select
count(*) from report_sales.kylin_sales_model GROUP BY TRUE LIMIT 5" {code}
Expected behavior:
Kylin supports queries with {{GROUP BY }}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
订阅kylin开发邮件
订阅kylin开发邮件
cannot get HiveTableMeta
There are two cubes using the same dimension table, and when both cubes are
built at the same time, both will do delete and create operations, causing one
of them to fail, Please see the log
pool-9-thread-10 and pool-9-thread-9 are two cube builds that are executed
separately, pool-9-thread-10 failed
2019-07-09 15:49:03,870 INFO [pool-9-thread-10]
common.ShellExecutable:52 : executing:hive -e "USE kylin_flat_db;
SET dfs.replication=2;
SET hive.exec.compress.output=true;
SET hive.auto.convert.join.noconditionaltask=true;
SET hive.auto.convert.join.noconditionaltask.size=1;
SET mapreduce.output.fileoutputformat.compress.type=BLOCK;
SET mapreduce.job.split.metainfo.maxsize=-1;
DROP TABLE IF EXISTS
kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW;
CREATE TABLE IF NOT EXISTS
kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW
LOCATION
'/kylin/kylin_metadata/kylin-88e0f1f2-c55e-44a2-88a9-37be8e07f445/kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW'
AS SELECT * FROM EDW.D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW;
"
2019-07-09 15:49:53,997 INFO [pool-9-thread-9] common.ShellExecutable:52
: executing:hive -e "USE kylin_flat_db;
SET dfs.replication=2;
SET hive.exec.compress.output=true;
SET hive.auto.convert.join.noconditionaltask=true;
SET hive.auto.convert.join.noconditionaltask.size=1;
SET mapreduce.output.fileoutputformat.compress.type=BLOCK;
SET mapreduce.job.split.metainfo.maxsize=-1;
DROP TABLE IF EXISTS
kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW;
CREATE TABLE IF NOT EXISTS
kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW
LOCATION
'/kylin/kylin_metadata/kylin-feb1f455-3fa1-4d14-ba7c-b5d5fb9969b4/kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW'
AS SELECT * FROM EDW.D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW;
"
2019-07-09 15:50:07,991 ERROR [pool-9-thread-10]
common.HadoopShellExecutable:65 : error execute
HadoopShellExecutable{id=88e0f1f2-c55e-44a2-88a9-37be8e07f445-04, name=Build
Dimension Dicti
onary, state=RUNNING}
java.lang.RuntimeException: cannot get HiveTableMeta
at org.apache.kylin.source.hive.HiveTable.(HiveTable.java:49)
at
org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:49)
at
org.apache.kylin.source.SourceFactory.createReadableTable(SourceFactory.java:42)
at
org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:269)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:58)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
at
org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:54)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by:
NoSuchObjectException(message:KYLIN_FLAT_DB.kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW
table not found)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_result$get_table_resultStandardScheme.read(ThriftHiveMetastore.java:35066)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_result$get_table_resultStandardScheme.read(ThriftHiveMetastore.java:35034)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_result.read(ThriftHiveMetastore.java:34965)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:1218)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1204)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1209)
at
org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:79)
at org.apache.kylin.source.hive.HiveTable.(HiveTable.java:47)
... 16 more
Enabling Https for Kylin web URLs
We tried enabling HTTPS by generating ''Keystore'' and putting it under "conf" of tomcat directory under kylin. Also changed path and password in configuration of tomcat's server.xml file. But we are not able to browse through https prefix. Kindly help us. -- Sent from: http://apache-kylin.74782.x6.nabble.com/
Kylin and Tableau JDBC
Dear Kylin Team,
I'm trying to connect Tableau (Desktop for now) to Apache Kylin using JDBC
driver. Connection fails with the error below.
[image: image.png]
I know that there are limitations regarding dialect from Tableau side (
https://onlinehelp.tableau.com/current/pro/desktop/en-us/examples_otherdatabases_jdbc.htm),
which might be the issue however I'm not sure about it.
The error messages in Tableau log files are not much of value, but I attach
the most meaningful log entry below:
{"ts":"2019-07-09T21:09:43.021","pid":11780,"tid":"2504","sev":"error","req":"-","sess":"-","site":"-","user":"-","k":"detailed-error-msg","e":{"category":"needs-classification","log-code":"bad0a3fa"},"v":{"details":["com.tableausoftware.jdbc.TableauJDBCException:
Error in isConnected","Generic JDBC connection
error","com.tableausoftware.jdbc.TableauJDBCException: Error in
isConnected\n"],"headline":"An error occurred while communicating with
Other Databases (JDBC).\n","shortMessage":"Bad Connection: Tableau could
not connect to the data source.","support-help-link":"
https://www.tableau.com/en-us/app/producthelp?build=20191.19.0213.2333&edition=pro&errorcode=&errormessage=&lang=en-us&platform=windows&type=redirect&version=2019.1
"}}
JDBC works fine with my installation from e.g. squirrelSQL.
Anybody has a clue how to make it work? Do you think that there is
something in the code of jdbc driver that can be checked/fixed or debugged?
Is there anything you would recommend?
Versions:
Tableau Desktop 2019.1 installed on Windows
Apache Kylin 2.6.2 installed from binaries on CentOS
Apache Kylin jdbc driver built locally from 2.6.3 revision/tag.
Thanks,
Piotr
Re: cannot get HiveTableMeta
Hi
What's your Kylin version?
On Tue, Jul 9, 2019 at 6:42 PM 曼 wrote:
> There are two cubes using the same dimension table, and when both cubes
> are built at the same time, both will do delete and create operations,
> causing one of them to fail, Please see the log
> pool-9-thread-10 and pool-9-thread-9 are two cube builds that are executed
> separately, pool-9-thread-10 failed
>
>
> 2019-07-09 15:49:03,870 INFO [pool-9-thread-10]
> common.ShellExecutable:52 : executing:hive -e "USE kylin_flat_db;
> SET dfs.replication=2;
> SET hive.exec.compress.output=true;
> SET hive.auto.convert.join.noconditionaltask=true;
> SET hive.auto.convert.join.noconditionaltask.size=1;
> SET mapreduce.output.fileoutputformat.compress.type=BLOCK;
> SET mapreduce.job.split.metainfo.maxsize=-1;
>
>
> DROP TABLE IF EXISTS
> kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW;
> CREATE TABLE IF NOT EXISTS
> kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW
> LOCATION
> '/kylin/kylin_metadata/kylin-88e0f1f2-c55e-44a2-88a9-37be8e07f445/kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW'
> AS SELECT * FROM EDW.D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW;
>
>
> "
>
>
>
>
>
>
> 2019-07-09 15:49:53,997 INFO [pool-9-thread-9]
> common.ShellExecutable:52 : executing:hive -e "USE kylin_flat_db;
> SET dfs.replication=2;
> SET hive.exec.compress.output=true;
> SET hive.auto.convert.join.noconditionaltask=true;
> SET hive.auto.convert.join.noconditionaltask.size=1;
> SET mapreduce.output.fileoutputformat.compress.type=BLOCK;
> SET mapreduce.job.split.metainfo.maxsize=-1;
>
>
> DROP TABLE IF EXISTS
> kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW;
> CREATE TABLE IF NOT EXISTS
> kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW
> LOCATION
> '/kylin/kylin_metadata/kylin-feb1f455-3fa1-4d14-ba7c-b5d5fb9969b4/kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW'
> AS SELECT * FROM EDW.D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW;
>
>
> "
>
>
> 2019-07-09 15:50:07,991 ERROR [pool-9-thread-10]
> common.HadoopShellExecutable:65 : error execute
> HadoopShellExecutable{id=88e0f1f2-c55e-44a2-88a9-37be8e07f445-04,
> name=Build Dimension Dicti
> onary, state=RUNNING}
> java.lang.RuntimeException: cannot get HiveTableMeta
> at org.apache.kylin.source.hive.HiveTable.(HiveTable.java:49)
> at
> org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:49)
> at
> org.apache.kylin.source.SourceFactory.createReadableTable(SourceFactory.java:42)
> at
> org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:269)
> at
> org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:58)
> at
> org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
> at org.apache.kylin.engine.mr
> .steps.CreateDictionaryJob.run(CreateDictionaryJob.java:54)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at org.apache.kylin.engine.mr
> .common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by:
> NoSuchObjectException(message:KYLIN_FLAT_DB.kylin_intermediate_EDW_D_EDW_HOTEL_PROFILE_INFO_FIN_ADD_INDEX_VIEW
> table not found)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_result$get_table_resultStandardScheme.read(ThriftHiveMetastore.java:35066)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_result$get_table_resultStandardScheme.read(ThriftHiveMetastore.java:35034)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_result.read(ThriftHiveMetastore.java:34965)
> at
> org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:1218)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1204)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1209)
> at
> org.apache.kylin.source.hive.CLIHiveC
