[jira] [Created] (KYLIN-5976) libch.so: cannot allocate memory in static TLS block
Alexander created KYLIN-5976:
Summary: libch.so: cannot allocate memory in static TLS block
Key: KYLIN-5976
URL: https://issues.apache.org/jira/browse/KYLIN-5976
Project: Kylin
Issue Type: Bug
Components: Release
Affects Versions: 5.0.0
Reporter: Alexander
Attachments: check-env.out
Build Kylin with Gluten key - "-withGluten"
Ensure that build sucessfully added gluten to package
{code:java}
// so
~/apache-kylin-5.0.0-r5-with-gluten-bin/server/libch.so
// libs
~/apache-kylin-5.0.0-r5-with-gluten-bin/lib/gluten/
celeborn-client-spark-3-shaded_2.12-0.5.1.jar
delta-core_2.12-2.3.0.jar
delta-storage-2.3.0.jar
gluten-celeborn-clickhouse-1.2.0-SNAPSHOT-jar-with-dependencies.jar
gluten.jar
protobuf-java-3.23.4.jar
//GLUTEN_VERSION
1.2.0-kylin-240730{code}
Try to start Kylin instance without any changes in gluten properties. Use
default properties.
Got error in "Checking Spark Availability" step.
{code:java}
Checking Spark Availability
...[FAIL]
{code}
Error description in check-env.out file:
{code:java}
[459715] 2024-10-03T20:53:13,051 INFO [main] gluten.GlutenDriverPlugin :
Gluten build info:
==
Backend: ClickHouse
Backend Branch: rebase_ch/20240730
Backend Revision: f69def8b6a8
Backend Revision Time: UNKNOWN
GCC Version:
Gluten Branch: HEAD
Gluten Build Time: 2024-09-04T08:14:52Z
Gluten Repo URL: https://github.com/Kyligence/gluten-ext.git
Gluten Revision: 14934a23ad23034c72229b3ea2a974787f1c3608
Gluten Revision Time: 2024-07-31 11:18:34 +0800
Gluten Version: 1.2.0-kylin-240730
Hadoop Version: 2.7.4
Java Version: 1.8
Scala Version: 2.12.15
Spark Version: 3.3.0-kylin-4.6.27.0-SNAPSHOT
==
[459715] 2024-10-03T20:53:13,338 INFO [main] vectorized.JniLibLoader : Read
real path /home/kylin/apache-kylin-5.0.0-r5-with-gluten-bin/server/libch.so for
libPath /home/kylin/apache-kylin-5.0.0-r5-with-gluten-bin/server/libch.so
Exception in thread "main" java.lang.UnsatisfiedLinkError:
/home/kylin/apache-kylin-5.0.0-r5-with-gluten-bin/server/libch.so:
/home/kylin/apache-kylin-5.0.0-r5-with-gluten-bin/server/libch.so: cannot
allocate memory in static TLS block
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at
org.apache.gluten.vectorized.JniLibLoader.loadFromPath0(JniLibLoader.java:103)
at
org.apache.gluten.vectorized.JniLibLoader.loadFromPath(JniLibLoader.java:117)
at
org.apache.gluten.backendsapi.clickhouse.CHListenerApi.initialize(CHListenerApi.scala:70)
at
org.apache.gluten.backendsapi.clickhouse.CHListenerApi.onDriverStart(CHListenerApi.scala:45)
at org.apache.gluten.GlutenDriverPlugin.init(GlutenPlugin.scala:75)
at
org.apache.spark.internal.plugin.DriverPluginContainer.$anonfun$driverPlugins$1(PluginContainer.scala:53)
at
scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:293)
at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
at scala.collection.TraversableLike.flatMap(TraversableLike.scala:293)
at scala.collection.TraversableLike.flatMap$(TraversableLike.scala:290)
at scala.collection.AbstractTraversable.flatMap(Traversable.scala:108)
at
org.apache.spark.internal.plugin.DriverPluginContainer.(PluginContainer.scala:46)
at
org.apache.spark.internal.plugin.PluginContainer$.apply(PluginContainer.scala:210)
at
org.apache.spark.internal.plugin.PluginContainer$.apply(PluginContainer.scala:193)
at org.apache.spark.SparkContext.(SparkContext.scala:560)
at
org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:58)
at
org.apache.kylin.tool.setup.KapSparkTaskTestCLI.main(KapSparkTaskTestCLI.java:44)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:977)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
at org.apache.spa
[jira] [Closed] (KYLIN-5729) Supports email notification when jobs are finished or discarded
[ https://issues.apache.org/jira/browse/KYLIN-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5729. - > Supports email notification when jobs are finished or discarded > --- > > Key: KYLIN-5729 > URL: https://issues.apache.org/jira/browse/KYLIN-5729 > Project: Kylin > Issue Type: Bug >Reporter: Laura Xia >Assignee: Laura Xia >Priority: Major > Fix For: 5.0.0 > > Attachments: image-2023-12-01-15-43-47-377.png > > > !image-2023-12-01-15-43-47-377.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5852) Support priority for job scheduler
[ https://issues.apache.org/jira/browse/KYLIN-5852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5852. - > Support priority for job scheduler > -- > > Key: KYLIN-5852 > URL: https://issues.apache.org/jira/browse/KYLIN-5852 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > > There are two steps need to handle high priority jobs: 1) write the ready > task into the job_lock table on the dataloading master node; 2) read the task > from the job_lock table to execute it on the dataloading slave node. The > priority of tasks is correctly managed by the master node; however, this > property is not serialized into the job_lock table, so the slave node cannot > order the tasks correctly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5683) There is a pagination problem when table data is in integer columns
[ https://issues.apache.org/jira/browse/KYLIN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5683. - > There is a pagination problem when table data is in integer columns > --- > > Key: KYLIN-5683 > URL: https://issues.apache.org/jira/browse/KYLIN-5683 > Project: Kylin > Issue Type: Bug >Reporter: Laura Xia >Assignee: Laura Xia >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5819) optimize the warning message on the dialog for editing computed column
[ https://issues.apache.org/jira/browse/KYLIN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5819. - > optimize the warning message on the dialog for editing computed column > -- > > Key: KYLIN-5819 > URL: https://issues.apache.org/jira/browse/KYLIN-5819 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > Attachments: image-2024-04-11-09-20-21-371.png, > image-2024-04-11-11-34-29-089.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5919) Re-design SubtractBitmap function
[ https://issues.apache.org/jira/browse/KYLIN-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5919. - > Re-design SubtractBitmap function > - > > Key: KYLIN-5919 > URL: https://issues.apache.org/jira/browse/KYLIN-5919 > Project: Kylin > Issue Type: Improvement > Components: Job Engine, Query Engine >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5934) Model validation failed for computedColumn contains escaping slash
[ https://issues.apache.org/jira/browse/KYLIN-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5934. - > Model validation failed for computedColumn contains escaping slash > -- > > Key: KYLIN-5934 > URL: https://issues.apache.org/jira/browse/KYLIN-5934 > Project: Kylin > Issue Type: Bug > Components: Modeling >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5712) The database, table, column name in the model creation API are case-sensitive, resulting in an error when calling the API
[
https://issues.apache.org/jira/browse/KYLIN-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5712.
-
> The database, table, column name in the model creation API are
> case-sensitive, resulting in an error when calling the API
> -
>
> Key: KYLIN-5712
> URL: https://issues.apache.org/jira/browse/KYLIN-5712
> Project: Kylin
> Issue Type: Bug
>Affects Versions: 5.0-beta
>Reporter: Hongrong Cao
>Assignee: Hongrong Cao
>Priority: Minor
> Fix For: 5.0.0
>
> Attachments: image-2023-11-20-22-04-48-100.png,
> image-2023-11-20-22-05-41-142.png
>
>
> The API call parameters are as follows
> {quote}{
> "project": "kylin_learn",
> "fact_table": "SSB.LINEORDER",
> "alias": "test_model_02",
> "management_type": "MODEL_BASED",
> "simplified_measures": [
> {
> "name": "COUNT_ALL",
> "expression": "COUNT",
> "parameter_value": [
> {
> "type": "constant",
> "value": 1
> }
> ],
> "return_type": ""
> }
> ],
> "simplified_dimensions": [
> {
> "column": "LINEORDER.LO_ORDERKEY",
> "name": "LO_ORDERKEY",
> "status": "DIMENSION"
> },
> {
> "column": "LINEORDER.LO_CUSTKEY",
> "name": "LO_CUSTKEY",
> "status": "DIMENSION"
> },
> {
> "column": "LINEORDER.LO_ORDERDATE",
> "name": "LO_ORDERDATE",
> "status": "DIMENSION"
> },
> {
> "column": "LINEORDER.LO_ORDERPRIOTITY",
> "name": "LO_ORDERPRIOTITY",
> "status": "DIMENSION"
> },
> {
> "column": "LINEORDER.V_REVENUE",
> "name": "V_REVENUE",
> "status": "DIMENSION"
> },
> {
> "column": "DATES.D_YEAR",
> "name": "D_YEAR",
> "status": "DIMENSION"
> },
> {
> "column": "CUSTOMER.c_name",
> "name": "c_name",
> "status": "DIMENSION"
> },
> {
> "column": "CUSTOMER.C_PHONE",
> "name": "C_PHONE",
> "status": "DIMENSION"
> }
> ],
> "join_tables": []
> }
> {quote}
> normal result as follows
> !image-2023-11-20-22-04-48-100.png|width=749,height=817!
>
> The exceptions are as follows
> !image-2023-11-20-22-05-41-142.png|width=907,height=802!
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5816) when turn on the V3 global dictionary and concurrently build Segments, the count query result may be incorrect
[ https://issues.apache.org/jira/browse/KYLIN-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5816. - > when turn on the V3 global dictionary and concurrently build Segments, the > count query result may be incorrect > -- > > Key: KYLIN-5816 > URL: https://issues.apache.org/jira/browse/KYLIN-5816 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > when turn on the V3 global dictionary and concurrently build Segments, the > count query result may be incorrect. > *Dev Design* > add Distributed locks for global dictionary build -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5771) Query cannot be interrupted during Segment pruning phase
[ https://issues.apache.org/jira/browse/KYLIN-5771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5771. - > Query cannot be interrupted during Segment pruning phase > > > Key: KYLIN-5771 > URL: https://issues.apache.org/jira/browse/KYLIN-5771 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > > When SQL is in the planning stage and pruning segment optimization is > performed, it may cause the query to cross the expected 300s and trigger the > timeout cancellation logic due to the existence of a large number of > segments, and a large number of filter expressions for simplification issues. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5766) Normalize query cache key
[ https://issues.apache.org/jira/browse/KYLIN-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5766. - > Normalize query cache key > - > > Key: KYLIN-5766 > URL: https://issues.apache.org/jira/browse/KYLIN-5766 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5938) Fix swagger can not disable
[ https://issues.apache.org/jira/browse/KYLIN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5938. - > Fix swagger can not disable > --- > > Key: KYLIN-5938 > URL: https://issues.apache.org/jira/browse/KYLIN-5938 > Project: Kylin > Issue Type: Bug > Components: Others >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5873) Check segment overlap before return models
[ https://issues.apache.org/jira/browse/KYLIN-5873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5873. - > Check segment overlap before return models > -- > > Key: KYLIN-5873 > URL: https://issues.apache.org/jira/browse/KYLIN-5873 > Project: Kylin > Issue Type: Bug > Components: Modeling >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Minor > Fix For: 5.0.0 > > Attachments: 8849.1.png, 8849.2.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5926) Turn off OptimizeOneRowJoin for query
[ https://issues.apache.org/jira/browse/KYLIN-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5926. - > Turn off OptimizeOneRowJoin for query > - > > Key: KYLIN-5926 > URL: https://issues.apache.org/jira/browse/KYLIN-5926 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5698) A dimension table field with an alias is used for measure, but the field is not added to the Kylin5 model dimension, and the field type cannot be obtained when creating a
[ https://issues.apache.org/jira/browse/KYLIN-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5698. - > A dimension table field with an alias is used for measure, but the field is > not added to the Kylin5 model dimension, and the field type cannot be > obtained when creating a tableindex > - > > Key: KYLIN-5698 > URL: https://issues.apache.org/jira/browse/KYLIN-5698 > Project: Kylin > Issue Type: Bug > Components: Modeling >Affects Versions: 5.0-beta >Reporter: Yaguang Jia >Assignee: Yaguang Jia >Priority: Minor > Fix For: 5.0.0 > > > *Dev Design* > /kylin/api/models?model_name= In the response of this api, add the return > value to the type in the selected_columns list, and return the field type of > the column. > > > > *Dev Design* > /kylin/api/models?model_name= > 这个api的response里，在selected_columns列表里type加上返回值，返回列的字段类型。 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5876) Avoid infinite match in OlapProjectMergeRule caused by simplify projects
[
https://issues.apache.org/jira/browse/KYLIN-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5876.
-
> Avoid infinite match in OlapProjectMergeRule caused by simplify projects
>
>
> Key: KYLIN-5876
> URL: https://issues.apache.org/jira/browse/KYLIN-5876
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
>Affects Versions: 5.0-alpha
>Reporter: pengfei.zhan
>Assignee: pengfei.zhan
>Priority: Major
> Fix For: 5.0.0
>
>
> tdvt test compared to version kylin-5.0-alpha a new failed sql has been
> added, the query reports an error
> {code:sql}
> SELECT (CASE WHEN "t2"."__measure__2" = 0 THEN NULL ELSE
> CAST("t0"."__measure__0" AS DOUBLE PRECISION) / "t2"."__measure__2" END) AS
> "TEMP(Test)(3502400386)(0)"
> FROM (
> SELECT SUM("CALCS"."NUM1") AS "__measure__0"
> FROM "TDVT"."CALCS" "CALCS"
> HAVING (COUNT(1) > 0)
> ) "t0"
> CROSS JOIN (
> SELECT AVG("t1"."__measure__0") AS "__measure__2"
> FROM (
> SELECT SUM("CALCS"."NUM1") AS "__measure__0"
> FROM "TDVT"."CALCS" "CALCS"
> GROUP BY "CALCS"."STR1"
> ) "t1"
> HAVING (COUNT(1) > 0)
> ) "t2"
> LIMIT 500
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5822) support history table adds left-closed and right-closed time interval
[ https://issues.apache.org/jira/browse/KYLIN-5822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5822. - > support history table adds left-closed and right-closed time interval > - > > Key: KYLIN-5822 > URL: https://issues.apache.org/jira/browse/KYLIN-5822 > Project: Kylin > Issue Type: Bug >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > Attachments: image-2024-04-11-11-32-26-396.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5879) use dataset iterator api to reduce driver memory use
[ https://issues.apache.org/jira/browse/KYLIN-5879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5879. - > use dataset iterator api to reduce driver memory use > > > Key: KYLIN-5879 > URL: https://issues.apache.org/jira/browse/KYLIN-5879 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > > Full Scenario OLAP Service/Data Unification Service Outlet > * The query result set should not reasonably have a Limit limit. > * Scenarios answered by hierarchical storage/detailed indexing can support > large-scale data exporting > * scenarios answered by query down, querying through JDBC provided by KE, the > performance is not significantly lower than using JDBC provided by the data > source directly, such as querying Hive JDBC directly. > * the amount of data returned does not set a limit on the number of data > entries / or data size, because customer data is growing, the analysis of the > scene is not fixed. > * customer behavior using data in a uniform manner, the current asynchronous > query in the data use scenarios have limitations. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5883) Enable aggregate pushDown
[ https://issues.apache.org/jira/browse/KYLIN-5883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5883. - > Enable aggregate pushDown > - > > Key: KYLIN-5883 > URL: https://issues.apache.org/jira/browse/KYLIN-5883 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5720) the query node returns to the login page after clicking on the model page
[ https://issues.apache.org/jira/browse/KYLIN-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5720. - > the query node returns to the login page after clicking on the model page > - > > Key: KYLIN-5720 > URL: https://issues.apache.org/jira/browse/KYLIN-5720 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: Hongrong Cao >Priority: Major > Fix For: 5.0.0 > > Attachments: image-2023-11-16-17-09-47-295.png > > > Reproduction method: configure two nodes, an all/job + a query node, > visit the query node and click on the model page will flashback！ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5906) Upgrade Spark version
[ https://issues.apache.org/jira/browse/KYLIN-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5906. - > Upgrade Spark version > - > > Key: KYLIN-5906 > URL: https://issues.apache.org/jira/browse/KYLIN-5906 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5937) Pushdown select star case sensitive
[ https://issues.apache.org/jira/browse/KYLIN-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5937. - > Pushdown select star case sensitive > --- > > Key: KYLIN-5937 > URL: https://issues.apache.org/jira/browse/KYLIN-5937 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5969) Package gluten dependencies into spark
[ https://issues.apache.org/jira/browse/KYLIN-5969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5969. - > Package gluten dependencies into spark > -- > > Key: KYLIN-5969 > URL: https://issues.apache.org/jira/browse/KYLIN-5969 > Project: Kylin > Issue Type: Improvement >Reporter: zhong.zhu >Assignee: zhong.zhu >Priority: Major > Fix For: 5.0.0 > > > After execute ./sbin/download-spark-user.sh, gluten relevant dependencies > will also be packaged into downloaded spark -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5725) After turning on the email alert configuration, the operation task prompts an unknown error, and the query underpressing also reports an error.
[ https://issues.apache.org/jira/browse/KYLIN-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5725. - > After turning on the email alert configuration, the operation task prompts an > unknown error, and the query underpressing also reports an error. > --- > > Key: KYLIN-5725 > URL: https://issues.apache.org/jira/browse/KYLIN-5725 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: sibing.zhang >Priority: Critical > Fix For: 5.0.0 > > Attachments: image-2023-11-17-15-03-23-989.png, > image-2023-11-17-15-05-29-264.png > > > Steps to Reproduce > 1:Configure to enable email alerts > 2:Create a model and initiate a build task. > 3:In the task list operation task restart, pause, terminate > 4:Query sql, expect query downpressure > Actual result > 3:Operation error report > 4:Query error -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5765) Optimization of registering udf operators
[ https://issues.apache.org/jira/browse/KYLIN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5765. - > Optimization of registering udf operators > - > > Key: KYLIN-5765 > URL: https://issues.apache.org/jira/browse/KYLIN-5765 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > Attachments: 42118-2.png, 42118.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5813) improve query history page filter item and model list page button text
[ https://issues.apache.org/jira/browse/KYLIN-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5813. - > improve query history page filter item and model list page button text > -- > > Key: KYLIN-5813 > URL: https://issues.apache.org/jira/browse/KYLIN-5813 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Major > Fix For: 5.0.0 > > Attachments: image-2024-04-09-09-38-42-450.png, > image-2024-04-09-09-39-13-571.png, image-2024-04-09-09-39-40-593.png, > image-2024-04-09-09-44-16-515.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5917) Optimize segment pruning after upgrading calcite 1.30
[ https://issues.apache.org/jira/browse/KYLIN-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5917. - > Optimize segment pruning after upgrading calcite 1.30 > - > > Key: KYLIN-5917 > URL: https://issues.apache.org/jira/browse/KYLIN-5917 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5898) Converted subQuery with alias cannot query
[ https://issues.apache.org/jira/browse/KYLIN-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5898. - > Converted subQuery with alias cannot query > -- > > Key: KYLIN-5898 > URL: https://issues.apache.org/jira/browse/KYLIN-5898 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5717) The to_date function is not aligned with SparkSQL. When converting to a time format such as yyyyMMdd, the result of the query hitting the snapshot is incorrect
[ https://issues.apache.org/jira/browse/KYLIN-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5717. - > The to_date function is not aligned with SparkSQL. When converting to a time > format such as MMdd, the result of the query hitting the snapshot is > incorrect > --- > > Key: KYLIN-5717 > URL: https://issues.apache.org/jira/browse/KYLIN-5717 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > > The to_date function is not aligned with SparkSQL. > When converting to a time format such as MMdd, the result of the query > hitting the snapshot is incorrect； -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5893) Support getting job list by type for api
[ https://issues.apache.org/jira/browse/KYLIN-5893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5893. - > Support getting job list by type for api > > > Key: KYLIN-5893 > URL: https://issues.apache.org/jira/browse/KYLIN-5893 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5911) Add index based on project for queryHistory table
[ https://issues.apache.org/jira/browse/KYLIN-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5911. - > Add index based on project for queryHistory table > - > > Key: KYLIN-5911 > URL: https://issues.apache.org/jira/browse/KYLIN-5911 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5940) File size estimation is inaccurate
[ https://issues.apache.org/jira/browse/KYLIN-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5940. - > File size estimation is inaccurate > -- > > Key: KYLIN-5940 > URL: https://issues.apache.org/jira/browse/KYLIN-5940 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5803) Add FileSegment and smart cache
[ https://issues.apache.org/jira/browse/KYLIN-5803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5803. - > Add FileSegment and smart cache > --- > > Key: KYLIN-5803 > URL: https://issues.apache.org/jira/browse/KYLIN-5803 > Project: Kylin > Issue Type: New Feature >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > add FileSegment -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5839) Block agg-push-down for non-equal-join
[
https://issues.apache.org/jira/browse/KYLIN-5839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5839.
-
> Block agg-push-down for non-equal-join
> --
>
> Key: KYLIN-5839
> URL: https://issues.apache.org/jira/browse/KYLIN-5839
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> The related non-equiv-join sql is as follows. If you want a corresponding
> equal-join sql, just remove the condition content `or (t2.fcol_10 is null and
> t5.fcol_17 is null)`.
> {code:java}
> select t2.fcol_7 fcol_7, count(distinct t2.fcol_6) fcol_6
> from (select t1.company_code fcol_6, t1.type_name fcol_7,
> case when t1.created_date = t0.fcol_1 then 'TRUE'
> else 'FALSE' end fcol_10
> from ( select company_code, created_date, type_name
> from "DEFAULT"."TEST_AGG_PUSH_DOWN" ) t1
> join ( select company_code, max(created_date) fcol_1
>from "DEFAULT"."TEST_AGG_PUSH_DOWN"
>group by company_code
> ) t0 on t1.company_code = t0.company_code
> ) t2 join ( select 'TRUE' fcol_17 ) t5
> on t2.fcol_10 = t5.fcol_17 or (t2.fcol_10 is null and t5.fcol_17 is null)
> group by t2.fcol_7{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5767) Calculating total rows abnormal when jdbc datasource is connnected
[
https://issues.apache.org/jira/browse/KYLIN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5767.
-
> Calculating total rows abnormal when jdbc datasource is connnected
> --
>
> Key: KYLIN-5767
> URL: https://issues.apache.org/jira/browse/KYLIN-5767
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: 5.0-beta
>Reporter: pengfei.zhan
>Assignee: pengfei.zhan
>Priority: Major
> Fix For: 5.0.0
>
>
> {{When the JDBC data source is connected, the snapshot management function is
> enabled and the dimension table is not sampled, optimize the build logic to
> ensure that the job can be executed normally when the dimension table data
> volume is large}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5885) Optimize segment pruning
[ https://issues.apache.org/jira/browse/KYLIN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5885. - > Optimize segment pruning > > > Key: KYLIN-5885 > URL: https://issues.apache.org/jira/browse/KYLIN-5885 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Priority: Minor > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5697) Mirror: Kylin5 request response optimization
[ https://issues.apache.org/jira/browse/KYLIN-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5697. - > Mirror: Kylin5 request response optimization > > > Key: KYLIN-5697 > URL: https://issues.apache.org/jira/browse/KYLIN-5697 > Project: Kylin > Issue Type: Improvement > Components: REST Service >Affects Versions: 5.0-beta >Reporter: Yaguang Jia >Assignee: Yaguang Jia >Priority: Minor > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5812) add rules combination to scalar subquery join
[ https://issues.apache.org/jira/browse/KYLIN-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5812. - > add rules combination to scalar subquery join > - > > Key: KYLIN-5812 > URL: https://issues.apache.org/jira/browse/KYLIN-5812 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > add rules combination to scalar subquery join -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5973) Enable Streaming for Kylin5
[ https://issues.apache.org/jira/browse/KYLIN-5973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5973. - > Enable Streaming for Kylin5 > --- > > Key: KYLIN-5973 > URL: https://issues.apache.org/jira/browse/KYLIN-5973 > Project: Kylin > Issue Type: Bug > Components: Real-time Streaming >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > KE5 Streaming job not avabile -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5939) Only system admin can access sparder UI
[ https://issues.apache.org/jira/browse/KYLIN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5939. - > Only system admin can access sparder UI > --- > > Key: KYLIN-5939 > URL: https://issues.apache.org/jira/browse/KYLIN-5939 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5945) metadata refactor
[ https://issues.apache.org/jira/browse/KYLIN-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5945. - > metadata refactor > - > > Key: KYLIN-5945 > URL: https://issues.apache.org/jira/browse/KYLIN-5945 > Project: Kylin > Issue Type: New Feature > Components: Metadata >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: Zhiting Guo >Priority: Major > Fix For: 5.0.0 > > Attachments: 1.PNG, 2.PNG, 3.png, 4.png, Metadata deep dive (en).pdf, > metadata (3).pdf > > > Kylin's metadata has some architectural issues, such as: > 1. The metadata adopts a key-value structure. The JSON block contains a lot > of content, which will grow with the growth of customer business, resulting > in excessive network IO when updating metadata. > 2. The design of epoch and project lock ensures that transactions within the > project are executed serially, resulting in single-point bottlenecks and > concurrency problems. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5718) Support automatic merging of V3 dictionary files
[ https://issues.apache.org/jira/browse/KYLIN-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5718. - > Support automatic merging of V3 dictionary files > > > Key: KYLIN-5718 > URL: https://issues.apache.org/jira/browse/KYLIN-5718 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: Yaguang Jia >Priority: Blocker > Fix For: 5.0.0 > > Attachments: image-2023-11-20-21-54-43-547.png > > > As the number of build tasks increases, the V3 dictionary generates more and > more files, and build performance becomes slower and slower. > !image-2023-11-20-21-54-43-547.png! > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5955) Kylin Package support gluten
[
https://issues.apache.org/jira/browse/KYLIN-5955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5955.
-
> Kylin Package support gluten
>
>
> Key: KYLIN-5955
> URL: https://issues.apache.org/jira/browse/KYLIN-5955
> Project: Kylin
> Issue Type: New Feature
>Reporter: zhong.zhu
>Assignee: zhong.zhu
>Priority: Major
> Fix For: 5.0.0
>
>
> h3. update release script with gluten
> - add gluten relevant dependencies
> {code:bash}
> ./build/release/release.sh -withGluten
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5888) Support _ymdint_between function
[ https://issues.apache.org/jira/browse/KYLIN-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5888. - > Support _ymdint_between function > > > Key: KYLIN-5888 > URL: https://issues.apache.org/jira/browse/KYLIN-5888 > Project: Kylin > Issue Type: New Feature > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5824) refine handel error for export models
[ https://issues.apache.org/jira/browse/KYLIN-5824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5824. - > refine handel error for export models > - > > Key: KYLIN-5824 > URL: https://issues.apache.org/jira/browse/KYLIN-5824 > Project: Kylin > Issue Type: Bug >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > > The system reports error when the number of models exceeds 256 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5962) Realization type is wrong when hitting snapshot or internalTable
[ https://issues.apache.org/jira/browse/KYLIN-5962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5962. - > Realization type is wrong when hitting snapshot or internalTable > > > Key: KYLIN-5962 > URL: https://issues.apache.org/jira/browse/KYLIN-5962 > Project: Kylin > Issue Type: Bug > Components: Others, Query Engine >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5894) Temporary writable db config support for hive transactional table building
[ https://issues.apache.org/jira/browse/KYLIN-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5894. - > Temporary writable db config support for hive transactional table building > -- > > Key: KYLIN-5894 > URL: https://issues.apache.org/jira/browse/KYLIN-5894 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5814) query cache support redis sentinel mode
[ https://issues.apache.org/jira/browse/KYLIN-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5814. - > query cache support redis sentinel mode > --- > > Key: KYLIN-5814 > URL: https://issues.apache.org/jira/browse/KYLIN-5814 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > query cache support redis sentinel mode -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5764) Sum expression supports if condition
[ https://issues.apache.org/jira/browse/KYLIN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5764. - > Sum expression supports if condition > > > Key: KYLIN-5764 > URL: https://issues.apache.org/jira/browse/KYLIN-5764 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5946) Integration with gluten
[ https://issues.apache.org/jira/browse/KYLIN-5946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5946. - > Integration with gluten > --- > > Key: KYLIN-5946 > URL: https://issues.apache.org/jira/browse/KYLIN-5946 > Project: Kylin > Issue Type: New Feature > Components: Job Engine, Query Engine >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: Zhichao Zhang >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5695) Code refactoring : Filter condition -> rewrite
[ https://issues.apache.org/jira/browse/KYLIN-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5695. - > Code refactoring : Filter condition -> rewrite > --- > > Key: KYLIN-5695 > URL: https://issues.apache.org/jira/browse/KYLIN-5695 > Project: Kylin > Issue Type: Improvement > Components: Modeling >Affects Versions: 5.0-beta >Reporter: Yaguang Jia >Assignee: Yaguang Jia >Priority: Minor > Fix For: 5.0.0 > > > h2. Dev Design > Rewrite the Filter condition functionality for models: > 1. When it is found that the field definition of a model does not comply with > the two-phase definition, a KylinException is generated with necessary error > information. > 2. When it is found that the filter condition of an imported model does not > meet the definition of the model (including case sensitivity issues), a > KylinException is generated with necessary error information. > > > h1. Dev Design > 对模型的Filter condition的rewrite功能重写： > # 当发现模型的字段定义不符合两段式定义时，产生KylinException，并附带必要的错误信息； > # 当发现导入的模型的filter condition，不满足模型的定义时（包括大小写匹配问题），产生KylinException，并附带必要的错误信息； -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5830) When the query connects two or more tables, the query results are inconsistent whether the order by field is in the select field or not
[
https://issues.apache.org/jira/browse/KYLIN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5830.
-
> When the query connects two or more tables, the query results are
> inconsistent whether the order by field is in the select field or not
> ---
>
> Key: KYLIN-5830
> URL: https://issues.apache.org/jira/browse/KYLIN-5830
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> Q1:
> {code:java}
> select CUSTOMER.C_PHONE
> -- ,LO_PARTKEY
> from SSB.CUSTOMER left join SSB.LINEORDER on
> CUSTOMER.C_CUSTKEY=LINEORDER.LO_CUSTKEY
> order by LINEORDER.LO_PARTKEY NULLS LAST
> LIMIT 500{code}
> Calcite Plan：
> {code:java}
> KapProjectRel(C_PHONE=[$6], ctx=[])
> KapLimitRel(ctx=[], fetch=[500])
> KapSortRel(sort0=[$12], dir0=[ASC], ctx=[])
> KapJoinRel(condition=[=($0, $11)], joinType=[left], ctx=[])
> KapTableScan(table=[[SSB, CUSTOMER]], ctx=[1@NDataflow [test]],
> fields=[[0, 1, 2, 3, 4, 5, 6, 7, 8]])
> KapTableScan(table=[[SSB, LINEORDER]], ctx=[2@NDataflow [test1]],
> fields=[[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17]]){code}
> Q2:
> {code:java}
> select CUSTOMER.C_PHONE
> ,LO_PARTKEY
> from SSB.CUSTOMER left join SSB.LINEORDER on
> CUSTOMER.C_CUSTKEY=LINEORDER.LO_CUSTKEY
> order by LINEORDER.LO_PARTKEY NULLS LAST
> LIMIT 500{code}
> Calcite Plan
> {code:java}
> KapLimitRel(ctx=[], fetch=[500])
> KapSortRel(sort0=[$1], dir0=[ASC], ctx=[])
> KapProjectRel(C_PHONE=[$6], LO_PARTKEY=[$12], ctx=[])
> KapJoinRel(condition=[=($0, $11)], joinType=[left], ctx=[])
> KapTableScan(table=[[SSB, CUSTOMER]], ctx=[1@NDataflow [test]],
> fields=[[0, 1, 2, 3, 4, 5, 6, 7, 8]])
> KapTableScan(table=[[SSB, LINEORDER]], ctx=[2@NDataflow [test1]],
> fields=[[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17]])
> {code}
> In SortRel, the columns used are not pushed down to the sub OlapContext. To
> fix this issue, need to add the columns to the sub OlapContext.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5890) The available queue capacity size is inaccurate
[ https://issues.apache.org/jira/browse/KYLIN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5890. - > The available queue capacity size is inaccurate > --- > > Key: KYLIN-5890 > URL: https://issues.apache.org/jira/browse/KYLIN-5890 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5828) During multi-jobs concurrent building, the flat table may use inconsistent global dictionaries, resulting in incorrect count distinct query results.
[ https://issues.apache.org/jira/browse/KYLIN-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5828. - > During multi-jobs concurrent building, the flat table may use inconsistent > global dictionaries, resulting in incorrect count distinct query results. > > > Key: KYLIN-5828 > URL: https://issues.apache.org/jira/browse/KYLIN-5828 > Project: Kylin > Issue Type: Bug > Components: Storage - Parquet >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > *Root Cause* > When multiple tasks are concurrently building and using the same global > dictionary, the consistency of the dictionary version used in the flat table > encoding process is not guaranteed. At the same time, another task expands > the dictionary, causing some flat table partitions to mistakenly use the new > version of the dictionary partition file. Due to the inconsistent data > distribution, the correct dictionary content cannot be obtained, resulting in > a flat table encoding column of 0 and ultimately causing an abnormal count > distinct value. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5840) Upgrade org.xerial.snappy:snappy-java to version 1.1.10.4
[ https://issues.apache.org/jira/browse/KYLIN-5840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5840. - > Upgrade org.xerial.snappy:snappy-java to version 1.1.10.4 > - > > Key: KYLIN-5840 > URL: https://issues.apache.org/jira/browse/KYLIN-5840 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > Upgrade org.xerial.snappy:snappy-java to version 1.1.10.4 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5842) When an async query hits the cache, it is unable to download the results.
[ https://issues.apache.org/jira/browse/KYLIN-5842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5842. - > When an async query hits the cache, it is unable to download the results. > - > > Key: KYLIN-5842 > URL: https://issues.apache.org/jira/browse/KYLIN-5842 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > When an asynchronous query hits the cache, it is unable to download the > results. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5823) improve text recognition dialog of add batch dimensions
[ https://issues.apache.org/jira/browse/KYLIN-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5823. - > improve text recognition dialog of add batch dimensions > --- > > Key: KYLIN-5823 > URL: https://issues.apache.org/jira/browse/KYLIN-5823 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > Attachments: image-2024-04-11-11-42-40-903.png, > image-2024-04-11-11-43-11-768.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5928) Update ScalarSubqueryJoinRule to adapt calcite 1.30
[ https://issues.apache.org/jira/browse/KYLIN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5928. - > Update ScalarSubqueryJoinRule to adapt calcite 1.30 > --- > > Key: KYLIN-5928 > URL: https://issues.apache.org/jira/browse/KYLIN-5928 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5865) Supports OlapFilterJoinRule.FILTER_ON_JOIN
[ https://issues.apache.org/jira/browse/KYLIN-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5865. - > Supports OlapFilterJoinRule.FILTER_ON_JOIN > -- > > Key: KYLIN-5865 > URL: https://issues.apache.org/jira/browse/KYLIN-5865 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > Attachments: 8813.1.png, 8813.2.png, 8813.3.png, 8813.4.png > > > The following SQL hit index problem, casually add a filter condition will > lead to repair failure, resulting in the query hit aggregation + detail, the > expectation is to hit the aggregate index. > !8813.1.png! > !8813.2.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5957) Fix download-async-profiler.sh
[ https://issues.apache.org/jira/browse/KYLIN-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5957. - > Fix download-async-profiler.sh > -- > > Key: KYLIN-5957 > URL: https://issues.apache.org/jira/browse/KYLIN-5957 > Project: Kylin > Issue Type: Bug > Components: Others >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > > missing `musl` related profilers -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5881) Import models from other project should consider merging ruleBasedIndex
[ https://issues.apache.org/jira/browse/KYLIN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5881. - > Import models from other project should consider merging ruleBasedIndex > --- > > Key: KYLIN-5881 > URL: https://issues.apache.org/jira/browse/KYLIN-5881 > Project: Kylin > Issue Type: Bug > Components: Modeling >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5817) After sending the query, the number of scanRows and scanBytes in response are inaccurate
[
https://issues.apache.org/jira/browse/KYLIN-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5817.
-
> After sending the query, the number of scanRows and scanBytes in response are
> inaccurate
>
>
> Key: KYLIN-5817
> URL: https://issues.apache.org/jira/browse/KYLIN-5817
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> h3. Background
> When KE calls the query interface, it is found that the scan row count
> {{scanRows}} and scan byte count {{scanBytes}} in the response are not
> accurate.
> h3. Root Cause
> The query interface internally calls the
> {{collectAdaptiveSparkPlanExecMetrics}} method of {{{}QueryMetricUtils{}}}.
> When iterating through {{{}exec.children.foreach{}}}, if the {{child}} is a
> {{{}SparkPlan{}}}, each time the results of the new {{child}} overwrite the
> {{newScanRow}} and {{newScanBytes}} variables without adding them up.
> h3. Dev Design
> To address the issue, replace the assignment operator {{=}} with the compound
> addition assignment operator {{+=}} to ensure that the results are properly
> accumulated. This change will allow for the correct aggregation of scan row
> count and scan byte count in each iteration.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5688) After a system admin user without data permission is added to a user group with data permission for a project, the system admin still has no data permission for this proje
[ https://issues.apache.org/jira/browse/KYLIN-5688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5688. - > After a system admin user without data permission is added to a user group > with data permission for a project, the system admin still has no data > permission for this project > - > > Key: KYLIN-5688 > URL: https://issues.apache.org/jira/browse/KYLIN-5688 > Project: Kylin > Issue Type: Bug > Components: Security >Affects Versions: 5.0-alpha >Reporter: Yaguang Jia >Assignee: Zhiting Guo >Priority: Minor > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5853) Optimize job_info and job_lock tables
[ https://issues.apache.org/jira/browse/KYLIN-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5853. - > Optimize job_info and job_lock tables > - > > Key: KYLIN-5853 > URL: https://issues.apache.org/jira/browse/KYLIN-5853 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > > Optimize job_info and job_lock tables -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5880) Dynamically adjust parquet conf when reading and writing layout files
[ https://issues.apache.org/jira/browse/KYLIN-5880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5880. - > Dynamically adjust parquet conf when reading and writing layout files > - > > Key: KYLIN-5880 > URL: https://issues.apache.org/jira/browse/KYLIN-5880 > Project: Kylin > Issue Type: New Feature > Components: Job Engine, Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5726) Remove unnecessary execution goal for deploy plugin
[ https://issues.apache.org/jira/browse/KYLIN-5726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5726. - > Remove unnecessary execution goal for deploy plugin > --- > > Key: KYLIN-5726 > URL: https://issues.apache.org/jira/browse/KYLIN-5726 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: Hongrong Cao >Priority: Minor > Fix For: 5.0.0 > > > Duplicate deploy behavior in pom.xml and kylin/pom.xml -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5854) In a read/write cluster, snapshots are automatically refreshed to maintain the original behavior
[ https://issues.apache.org/jira/browse/KYLIN-5854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5854. - > In a read/write cluster, snapshots are automatically refreshed to maintain > the original behavior > > > Key: KYLIN-5854 > URL: https://issues.apache.org/jira/browse/KYLIN-5854 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > > In a read/write cluster, snapshots are automatically refreshed to maintain > the original behavior -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5877) Upgrade table schema of recommendation
[ https://issues.apache.org/jira/browse/KYLIN-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5877. - > Upgrade table schema of recommendation > -- > > Key: KYLIN-5877 > URL: https://issues.apache.org/jira/browse/KYLIN-5877 > Project: Kylin > Issue Type: Improvement > Components: Modeling >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Minor > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5869) Column ACL missing alias while reusing with-items
[ https://issues.apache.org/jira/browse/KYLIN-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5869. - > Column ACL missing alias while reusing with-items > - > > Key: KYLIN-5869 > URL: https://issues.apache.org/jira/browse/KYLIN-5869 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5708) The time range of logs included in the job diagnostic package is incomplete
[
https://issues.apache.org/jira/browse/KYLIN-5708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5708.
-
> The time range of logs included in the job diagnostic package is incomplete
> ---
>
> Key: KYLIN-5708
> URL: https://issues.apache.org/jira/browse/KYLIN-5708
> Project: Kylin
> Issue Type: Bug
>Affects Versions: 5.0-beta
>Reporter: Hongrong Cao
>Assignee: longfeiJiang
>Priority: Minor
> Fix For: 5.0.0
>
> Attachments: image-2023-11-16-10-27-44-668.png
>
>
> task started executing at 13:40, and the start time of schedule.log and
> kylin.log are both at 13:49, with no previous logs.
> {quote}2022-09-21T13:54:52,089 INFO [main] diag : Extract kylin log from
> 2022-09-21T13:49:00 to 2022-09-21T13:52:33 .
> {quote}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5821) fix model edit page pfk flag bug and enhance model canvas window position
[ https://issues.apache.org/jira/browse/KYLIN-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5821. - > fix model edit page pfk flag bug and enhance model canvas window position > - > > Key: KYLIN-5821 > URL: https://issues.apache.org/jira/browse/KYLIN-5821 > Project: Kylin > Issue Type: Bug >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > Attachments: image-2024-04-11-09-33-26-053.png, > image-2024-04-11-09-35-55-932.png, image-2024-04-11-09-36-29-178.png, > image-2024-04-11-11-31-27-283.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5931) Query with many hints cannot work
[ https://issues.apache.org/jira/browse/KYLIN-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5931. - > Query with many hints cannot work > - > > Key: KYLIN-5931 > URL: https://issues.apache.org/jira/browse/KYLIN-5931 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5747) Calcite constant folding, adding strings to numbers, results not as expected when multiple plus signs are used together
[ https://issues.apache.org/jira/browse/KYLIN-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5747. - > Calcite constant folding, adding strings to numbers, results not as expected > when multiple plus signs are used together > --- > > Key: KYLIN-5747 > URL: https://issues.apache.org/jira/browse/KYLIN-5747 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: zhong.zhu >Assignee: zhong.zhu >Priority: Critical > Fix For: 5.0.0 > > > Phenomenon: > When more than one plus sign is used in a row and the parameters on both > sides of the plus sign are constants, the result is not as expected > '1' + 3 + 3 → 7 (correct) > '1' + 3 + '3' → 4.03 (wrong result) > '1' + '3' + 'a' → error > When multiple plus signs are used in a row, and the arguments on both sides > of the plus sign are constants, and the first plus sign results in null, the > use of plus signs in a row is not supported. > e.g. 'q' + 1 + 1 -> error -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5841) Upgrade org.apache.avro:avro to version 1.11.3
[ https://issues.apache.org/jira/browse/KYLIN-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5841. - > Upgrade org.apache.avro:avro to version 1.11.3 > -- > > Key: KYLIN-5841 > URL: https://issues.apache.org/jira/browse/KYLIN-5841 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > Upgrade org.apache.avro:avro to version 1.11.3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5912) Dictionary encoded incorrect
[ https://issues.apache.org/jira/browse/KYLIN-5912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5912. - > Dictionary encoded incorrect > > > Key: KYLIN-5912 > URL: https://issues.apache.org/jira/browse/KYLIN-5912 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5682) ER graph optimizes performance
[ https://issues.apache.org/jira/browse/KYLIN-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5682. - > ER graph optimizes performance > -- > > Key: KYLIN-5682 > URL: https://issues.apache.org/jira/browse/KYLIN-5682 > Project: Kylin > Issue Type: Improvement >Reporter: Laura Xia >Assignee: Laura Xia >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5829) Add a tool for generating sql from dumped metadata
[
https://issues.apache.org/jira/browse/KYLIN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5829.
-
> Add a tool for generating sql from dumped metadata
> --
>
> Key: KYLIN-5829
> URL: https://issues.apache.org/jira/browse/KYLIN-5829
> Project: Kylin
> Issue Type: New Feature
> Components: Metadata
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> Add a tool for generating sql from dumped metadata
> The usage of the command is {{./bin/creata-table.sh
> \{absolute_table_directory}}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5974) internal table detail page partition column read error
[ https://issues.apache.org/jira/browse/KYLIN-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5974. - > internal table detail page partition column read error > -- > > Key: KYLIN-5974 > URL: https://issues.apache.org/jira/browse/KYLIN-5974 > Project: Kylin > Issue Type: Improvement > Components: Website >Reporter: huangsheng >Assignee: huangsheng >Priority: Trivial > Fix For: 5.0.0 > > Attachments: 截屏2024-09-14 17.28.16.png, 截屏2024-09-14 17.28.54.png, > 截屏2024-09-14 17.28.59.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5882) Collect expandedFilterConditions to avoid segment pruning failure
[ https://issues.apache.org/jira/browse/KYLIN-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5882. - > Collect expandedFilterConditions to avoid segment pruning failure > - > > Key: KYLIN-5882 > URL: https://issues.apache.org/jira/browse/KYLIN-5882 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5738) Query support using '+' to concatenate strings
[
https://issues.apache.org/jira/browse/KYLIN-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5738.
-
> Query support using '+' to concatenate strings
> --
>
> Key: KYLIN-5738
> URL: https://issues.apache.org/jira/browse/KYLIN-5738
> Project: Kylin
> Issue Type: Bug
>Affects Versions: 5.0-beta
>Reporter: zhong.zhu
>Assignee: zhong.zhu
>Priority: Critical
> Fix For: 5.0.0
>
> Attachments: image-2023-12-11-11-19-24-736.png,
> image-2023-12-11-11-24-05-314.png
>
>
> Many queries of the client's mobile reports are SQL queries with +
> concatenated strings. The client does not agree with the SQL transformation
> of the front-end reports and hopes that KYLIN 4.X is forward compatible with
> this function.
> For example:
> Both the company and first_deptname fields are of type varchar(4096)
> Case one:
> SELECT company + '-' + first_deptname FROM Table name
>
> _KYLIN 4 Query Result with Exception:_
> _Conversion to relational algebra failed to preserve datatypes:_
> _validated type:_
> _RecordType(CHAR(1) CHARACTER SET "UTF-16LE" COLLATE "UTF-16LE$en_US$primary"
> NOT NULL EXPR$0) NOT NULL_
> _converted type:_
> _RecordType(CHAR(3) CHARACTER SET "UTF-16LE" COLLATE "UTF-16LE$en_US$primary"
> NOT NULL EXPR$0) NOT NULL_
> _rel:_
> _LogicalSort(fetch=[500])_
> _LogicalProject(EXPR$0=[||(||('A', '_'), 'B')])
> KapTableScan(table=[[APP, A02_HR_ORGANIZATION_TALENT_CHAIN]], ctx=[], fields=
>
> In KYLIN 3.x, the query result is right: company-deptname
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5910) Enhancement of query log
[ https://issues.apache.org/jira/browse/KYLIN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5910. - > Enhancement of query log > > > Key: KYLIN-5910 > URL: https://issues.apache.org/jira/browse/KYLIN-5910 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5875) Enhance the simplification method of filter condition for segment pruning
[ https://issues.apache.org/jira/browse/KYLIN-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5875. - > Enhance the simplification method of filter condition for segment pruning > - > > Key: KYLIN-5875 > URL: https://issues.apache.org/jira/browse/KYLIN-5875 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5958) Support storage v3 for website
[ https://issues.apache.org/jira/browse/KYLIN-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5958. - > Support storage v3 for website > -- > > Key: KYLIN-5958 > URL: https://issues.apache.org/jira/browse/KYLIN-5958 > Project: Kylin > Issue Type: New Feature > Components: Web , Website >Affects Versions: 5.0-beta >Reporter: huangsheng >Assignee: huangsheng >Priority: Blocker > Fix For: 5.0.0 > > Attachments: 截屏2024-09-02 16.36.39.png, 截屏2024-09-02 16.36.54.png > > > Support storage v3 for website -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5932) Support info of stackTrace interception
[ https://issues.apache.org/jira/browse/KYLIN-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5932. - > Support info of stackTrace interception > --- > > Key: KYLIN-5932 > URL: https://issues.apache.org/jira/browse/KYLIN-5932 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5809) Add discarded field for LayoutRecDetailResponse
[ https://issues.apache.org/jira/browse/KYLIN-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5809. - > Add discarded field for LayoutRecDetailResponse > --- > > Key: KYLIN-5809 > URL: https://issues.apache.org/jira/browse/KYLIN-5809 > Project: Kylin > Issue Type: Bug >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > Add discarded field for LayoutRecDetailResponse -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5874) Change 'max concurrent limit' to project level config
[ https://issues.apache.org/jira/browse/KYLIN-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5874. - > Change 'max concurrent limit' to project level config > - > > Key: KYLIN-5874 > URL: https://issues.apache.org/jira/browse/KYLIN-5874 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5804) Add clickhouse deps as default profile
[ https://issues.apache.org/jira/browse/KYLIN-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5804. - > Add clickhouse deps as default profile > -- > > Key: KYLIN-5804 > URL: https://issues.apache.org/jira/browse/KYLIN-5804 > Project: Kylin > Issue Type: Bug >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > Add clickhouse deps as default profile -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5867) add return job id for table sample
[
https://issues.apache.org/jira/browse/KYLIN-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5867.
-
> add return job id for table sample
> --
>
> Key: KYLIN-5867
> URL: https://issues.apache.org/jira/browse/KYLIN-5867
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine
>Affects Versions: 5.0-alpha
>Reporter: pengfei.zhan
>Assignee: pengfei.zhan
>Priority: Major
> Fix For: 5.0.0
>
>
> The sampling job should return jobId to judge whether this job is completed.
> For example:
> {code:json}
> {
> "code":"000",
> "data":"e3aa809b-5e73-42a5-a1e1-649d53b16e2c",
> "msg":""
> } {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Closed] (KYLIN-5856) Merge contents of KAPRels and OLAPRels into OlapRels
[ https://issues.apache.org/jira/browse/KYLIN-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5856. - > Merge contents of KAPRels and OLAPRels into OlapRels > > > Key: KYLIN-5856 > URL: https://issues.apache.org/jira/browse/KYLIN-5856 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5899) Optimization of job table and transaction
[ https://issues.apache.org/jira/browse/KYLIN-5899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5899. - > Optimization of job table and transaction > - > > Key: KYLIN-5899 > URL: https://issues.apache.org/jira/browse/KYLIN-5899 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5719) Occasional initialization failure of the V3 global dictionary file, resulting in failure of build jobs
[ https://issues.apache.org/jira/browse/KYLIN-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5719. - > Occasional initialization failure of the V3 global dictionary file, resulting > in failure of build jobs > -- > > Key: KYLIN-5719 > URL: https://issues.apache.org/jira/browse/KYLIN-5719 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: Yaguang Jia >Priority: Major > Fix For: 5.0.0 > > > As in the title. > Hopefully the occasional failure to initialize the dictionary file won't > affect the build task -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5730) Query dry-run for better modeling
[
https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5730.
-
> Query dry-run for better modeling
> -
>
> Key: KYLIN-5730
> URL: https://issues.apache.org/jira/browse/KYLIN-5730
> Project: Kylin
> Issue Type: Improvement
>Affects Versions: 5.0-beta
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: KYLIN-5730-01.png, KYLIN-5730-02.png, KYLIN-5730-03.png
>
>
> h2. Background
> When user enable this feature, the query insight page will display helpful
> message
> for user to understand why model is not match and what to do in next step.
>
> Following messages will display some query analytics, including at least:
> # RelNode Tree
> # OLAPContext and matched Model for each context
> # Spark Physical Plan
> Configuration entry is 'kylin.query.dryrun-enabled', at project level.
> h2. How to use
> # enable this in project configuration
> # send a query in Insight page
> # read Dry-run message and fix something and retry
>
> h4. Dry-run message sample:
> # {{Last Exception :}}
> {{{} No realization found for {id = 0, model = not matched, fact table =
> TPCH_CN.LINEITEM{
> {{ Incapable message : MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN,
> MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN,
> MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN, }}
> # {{OLAPContext(s) and matched model(s) :}}
> {{ Ctx=0 is not matched by any model/snapshot, recommend :}}
> {{ {}}
> {{ "Fact Table" : "TPCH_CN.LINEITEM",}}
> {{ "Dimension Tables" : [ "TPCH_CN.REGION", "TPCH_CN.ORDERS",
> "TPCH_CN.SUPPLIER", "TPCH_CN.PART", "TPCH_CN.CUSTOMER", "TPCH_CN.NATION"],}}
> {{ "Query Columns" : [ "TPCH_CN.NATION.N_NAME",
> "TPCH_CN.ORDERS.O_ORDERDATE", "TPCH_CN.REGION.R_NAME", "TPCH_CN.PART.P_TYPE",
> "TPCH_CN.LINEITEM.DISC_PRICE"],}}
> {{ "Dimension(Group by)" : [ "TPCH_CN.ORDERS.O_ORDERDATE"],}}
> {{ "Dimension(Filter cond)" : [ "TPCH_CN.ORDERS.O_ORDERDATE",
> "TPCH_CN.REGION.R_NAME", "TPCH_CN.PART.P_TYPE"],}}
> {{ "Measure" : [ "SUM(UNKNOWN_ALIAS.$F1)",
> "SUM(T_1_4CD6601C.DISC_PRICE)"],}}
> {{ "Join" : "}}
> {{Fact: [T_1_4CD6601C:LINEITEM]}}
> {{ Dim: [T_1_4CD6601C:LINEITEM] INNER JOIN [T_2_716C1DB8:PART] ON
> [L_PARTKEY] = [P_PARTKEY]}}
> {{ Dim: [T_1_4CD6601C:LINEITEM] INNER JOIN [T_3_6D21031C:SUPPLIER] ON
> [L_SUPPKEY] = [S_SUPPKEY]}}
> {{ Dim: [T_3_6D21031C:SUPPLIER] INNER JOIN [T_7_4F00CD31:NATION] ON
> [S_NATIONKEY] = [N_NATIONKEY]}}
> {{ Dim: [T_1_4CD6601C:LINEITEM] INNER JOIN [T_4_5CEAD9DF:ORDERS] ON
> [L_ORDERKEY] = [O_ORDERKEY]}}
> {{ Dim: [T_4_5CEAD9DF:ORDERS] INNER JOIN [T_5_54B979E7:CUSTOMER] ON
> [O_CUSTKEY] = [C_CUSTKEY]}}
> {{ Dim: [T_5_54B979E7:CUSTOMER] INNER JOIN [T_6_42081A08:NATION] ON
> [C_NATIONKEY] = [N_NATIONKEY]}}
> {{ Dim: [T_6_42081A08:NATION] INNER JOIN [T_8_B14C00A:REGION] ON
> [N_REGIONKEY] = [R_REGIONKEY]",}}
> {{ "Index Id" : 0,}}
> {{ "Query Column / Index Column" : "5 / 0",}}
> {{ "Index Columns" : []}}
> {{{} }{{
> # {{RelNode(with ctx id) :}}
> {{ OLAPToEnumerableConverter}}
> {{ LimitRel(ctx=[0@null], fetch=[500])}}
> {{ SortRel(sort0=[$0], dir0=[ASC-nulls-first], ctx=[0@null])}}
> {{ ProjectRel(O_YEAR=[$0], MKT_SHARE=[/($1, $2)], ctx=[0@null])}}
> {{ AggregateRel(group-set=[[0]], groups=[null], agg#0=[SUM($1)],
> agg#1=[SUM($2)], ctx=[0@null])}}
> {{ ProjectRel(O_YEAR=[EXTRACT(FLAG(YEAR), $54)], $f1=[CASE(=($72,
> 'BRAZIL'), $16, 0)], VOLUME=[$16], ctx=[0@null])}}
> {{ FilterRel(condition=[AND(=($76, 'AMERICA'), >=($54,
> 1995-01-01), <=($54, 1996-12-31), =($38, 'ECONOMY ANODIZED STEEL'))],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($69, $75)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($46, $71)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($62, $67)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($51, $59)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($0, $50)], joinTyp
[jira] [Closed] (KYLIN-5696) Logical view with Chinese name sampling or building exception
[ https://issues.apache.org/jira/browse/KYLIN-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5696. - > Logical view with Chinese name sampling or building exception > - > > Key: KYLIN-5696 > URL: https://issues.apache.org/jira/browse/KYLIN-5696 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: Yaguang Jia >Assignee: Yaguang Jia >Priority: Major > Fix For: 5.0.0 > > > *Root Cause* > The Logical View did not handle special characters (such as Chinese table > names) that appear in the database table name when dropping a table. > *Dev Design* > Enhance the handling of special characters in DDL statements within the > Logical View by using backticks for annotation. > > > > *Root Cause* > Logical View 在 drop table 时没有对库表名称中出现的特殊字符（比如中文表名）做兼容处理 > *Dev Design* > 增加 Logical View 中的 DDL 对特殊字符的处理，用反引号标注 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5891) Provide model level parameter conf api
[ https://issues.apache.org/jira/browse/KYLIN-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5891. - > Provide model level parameter conf api > -- > > Key: KYLIN-5891 > URL: https://issues.apache.org/jira/browse/KYLIN-5891 > Project: Kylin > Issue Type: Bug > Components: Modeling >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5909) Replacing ParameterExpression with iteration
[ https://issues.apache.org/jira/browse/KYLIN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5909. - > Replacing ParameterExpression with iteration > > > Key: KYLIN-5909 > URL: https://issues.apache.org/jira/browse/KYLIN-5909 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5968) Support real-time for website
[ https://issues.apache.org/jira/browse/KYLIN-5968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5968. - > Support real-time for website > - > > Key: KYLIN-5968 > URL: https://issues.apache.org/jira/browse/KYLIN-5968 > Project: Kylin > Issue Type: New Feature > Components: Website >Affects Versions: 5.0-beta >Reporter: huangsheng >Priority: Major > Fix For: 5.0.0 > > Attachments: 截屏2024-09-05 10.26.06.png, 截屏2024-09-05 10.26.11.png, > 截屏2024-09-05 13.55.19.png, 截屏2024-09-05 13.55.52.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5918) Add open api to delete project config
[ https://issues.apache.org/jira/browse/KYLIN-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5918. - > Add open api to delete project config > - > > Key: KYLIN-5918 > URL: https://issues.apache.org/jira/browse/KYLIN-5918 > Project: Kylin > Issue Type: New Feature > Components: Others >Affects Versions: 5.0.0 >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5927) Fix refreshing catalog api
[ https://issues.apache.org/jira/browse/KYLIN-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5927. - > Fix refreshing catalog api > -- > > Key: KYLIN-5927 > URL: https://issues.apache.org/jira/browse/KYLIN-5927 > Project: Kylin > Issue Type: Bug > Components: Others >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5915) Upgrade jars for vulnerbility
[ https://issues.apache.org/jira/browse/KYLIN-5915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5915. - > Upgrade jars for vulnerbility > - > > Key: KYLIN-5915 > URL: https://issues.apache.org/jira/browse/KYLIN-5915 > Project: Kylin > Issue Type: Bug > Components: Others >Affects Versions: 5.0-alpha >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (KYLIN-5723) Optimize Calcite plan to convert spark logical plan
[
https://issues.apache.org/jira/browse/KYLIN-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5723.
-
> Optimize Calcite plan to convert spark logical plan
> ---
>
> Key: KYLIN-5723
> URL: https://issues.apache.org/jira/browse/KYLIN-5723
> Project: Kylin
> Issue Type: Improvement
>Affects Versions: 5.0-beta
>Reporter: Hongrong Cao
>Assignee: Hongrong Cao
>Priority: Major
> Fix For: 5.0.0
>
>
> The problem with calcite plan to spark LogicalPlan is that it uses the
> DataFrame interface, which means that it parses and builds the LogicalPlan at
> the same time.
> During the process of calcite plan to spark plan, the select agg and other
> operators execute the following methods, where the execution of
> qe.assertAnalyzed() is of interest
> {quote}def ofRows(sparkSession: SparkSession, logicalPlan: LogicalPlan):
> DataFrame =
> sparkSession.withActive {
> val qe = sparkSession.sessionState.executePlan(logicalPlan)
> qe.assertAnalyzed()
> new Dataset[Row](qe, RowEncoder(qe.analyzed.schema))
> }
> {quote}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
