[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424294#comment-17424294
]
Apache Spark commented on SPARK-36926:
--
User 'cloud-fan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36926:
Assignee: (was: Apache Spark)
> Discrepancy in Q22 of TPCH for Spark 3.2
>
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424293#comment-17424293
]
Apache Spark commented on SPARK-36926:
--
User 'cloud-fan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36926:
Assignee: Apache Spark
> Discrepancy in Q22 of TPCH for Spark 3.2
>
[
https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36930:
Assignee: (was: Apache Spark)
> Support ps.MultiIndex.dtypes
>
[
https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36930:
Assignee: Apache Spark
> Support ps.MultiIndex.dtypes
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424291#comment-17424291
]
Apache Spark commented on SPARK-36930:
--
User 'dchvn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-36711:
Assignee: dch nguyen
> Support multi-index in new syntax
>
[
https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dch nguyen updated SPARK-36930:
---
Description:
when MultiIndex.dtypes is supported, we can use:
{code:java}
>>> idx =
[
https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dch nguyen updated SPARK-36930:
---
Description:
when MultiIndex.dtypes is supported, we can use:
{code:java}
>>> idx =
[
https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dch nguyen updated SPARK-36930:
---
Summary: Support ps.MultiIndex.dtypes (was: Support ps.DataFrame.dtypes)
> Support
[
https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dch nguyen updated SPARK-36930:
---
Description: (was: When DF.dtypes is supported, we can use
{code:java}
>>> pdf =
[
https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424288#comment-17424288
]
dch nguyen commented on SPARK-36930:
working on this.
> Support ps.DataFrame.dtypes
>
[
https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dch nguyen updated SPARK-36930:
---
Description:
When DF.dtypes is supported, we can use
{code:java}
>>> pdf = pd.DataFrame(
...
dch nguyen created SPARK-36930:
--
Summary: Support ps.DataFrame.dtypes
Key: SPARK-36930
URL: https://issues.apache.org/jira/browse/SPARK-36930
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-36292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424285#comment-17424285
]
Apache Spark commented on SPARK-36292:
--
User 'dchvn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-36711.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34176
[
https://issues.apache.org/jira/browse/SPARK-36296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424281#comment-17424281
]
Apache Spark commented on SPARK-36296:
--
User 'dchvn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-36874:
---
Assignee: Kousuke Saruta
> Ambiguous Self-Join detected only on right dataframe
>
[
https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-36874.
-
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 34172
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424265#comment-17424265
]
Venkata krishnan Sowrirajan commented on SPARK-36926:
-
This looks like a regression
[
https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424261#comment-17424261
]
Apache Spark commented on SPARK-36711:
--
User 'dchvn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36929:
Assignee: (was: Apache Spark)
> Remove Unused Method
[
https://issues.apache.org/jira/browse/SPARK-36929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36929:
Assignee: Apache Spark
> Remove Unused Method
[
https://issues.apache.org/jira/browse/SPARK-36929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424260#comment-17424260
]
Apache Spark commented on SPARK-36929:
--
User 'leesf' has created a pull request for this issue:
leesf created SPARK-36929:
-
Summary: Remove Unused Method
EliminateSubqueryAliasesSuite#assertEquivalent
Key: SPARK-36929
URL: https://issues.apache.org/jira/browse/SPARK-36929
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-36925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-36925.
--
Resolution: Invalid
> Overriding parameters
> -
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-36925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424258#comment-17424258
]
Hyukjin Kwon commented on SPARK-36925:
--
Let's ask questions in spark mailing list before filing it
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424256#comment-17424256
]
Hyukjin Kwon commented on SPARK-36926:
--
Just to clarify, do you know if this is a regression or not
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-36926:
-
Priority: Critical (was: Major)
> Discrepancy in Q22 of TPCH for Spark 3.2
>
[
https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-36920.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34169
[
https://issues.apache.org/jira/browse/SPARK-36881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-36881.
--
Fix Version/s: 3.3.0
Assignee: Xinrong Meng
Resolution: Fixed
Fixed in
[
https://issues.apache.org/jira/browse/SPARK-26786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424241#comment-17424241
]
Hyukjin Kwon commented on SPARK-26786:
--
It became a known limitation in universe.
> Handle to
[
https://issues.apache.org/jira/browse/SPARK-26786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424241#comment-17424241
]
Hyukjin Kwon edited comment on SPARK-26786 at 10/5/21, 1:00 AM:
It
[
https://issues.apache.org/jira/browse/SPARK-36600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424240#comment-17424240
]
Hyukjin Kwon commented on SPARK-36600:
--
You can just create a PR right away. Once that's fixed, it
[
https://issues.apache.org/jira/browse/SPARK-36802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-36802:
-
Affects Version/s: 3.1.2
> Incorrect writing the string, containing symbols like "\" to Hive
>
[
https://issues.apache.org/jira/browse/SPARK-36910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424227#comment-17424227
]
Apache Spark commented on SPARK-36910:
--
User 'xinrong-databricks' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-36910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36910:
Assignee: Apache Spark
> Inline type hints for python/pyspark/sql/types.py
>
[
https://issues.apache.org/jira/browse/SPARK-36910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36910:
Assignee: (was: Apache Spark)
> Inline type hints for python/pyspark/sql/types.py
>
[
https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424220#comment-17424220
]
Apache Spark commented on SPARK-36927:
--
User 'xinrong-databricks' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424218#comment-17424218
]
Apache Spark commented on SPARK-36927:
--
User 'xinrong-databricks' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36927:
Assignee: (was: Apache Spark)
> Inline type hints for python/pyspark/sql/window.py
>
[
https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36927:
Assignee: Apache Spark
> Inline type hints for python/pyspark/sql/window.py
>
[
https://issues.apache.org/jira/browse/SPARK-36906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-36906.
---
Fix Version/s: 3.3.0
Assignee: Xinrong Meng
Resolution: Fixed
Issue
[
https://issues.apache.org/jira/browse/SPARK-36905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424183#comment-17424183
]
Erik Krogen commented on SPARK-36905:
-
cc also [~maropu] [~viirya] [~csun]
> Reading Hive view
Max Gekk created SPARK-36928:
Summary: Handle ANSI intervals in ColumnarRow, ColumnarBatchRow
and ColumnarArray
Key: SPARK-36928
URL: https://issues.apache.org/jira/browse/SPARK-36928
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424112#comment-17424112
]
Venkata krishnan Sowrirajan edited comment on SPARK-36926 at 10/4/21, 7:44 PM:
[
https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424131#comment-17424131
]
Xinrong Meng commented on SPARK-36927:
--
I'm working on this.
> Inline type hints for
Xinrong Meng created SPARK-36927:
Summary: Inline type hints for python/pyspark/sql/window.py
Key: SPARK-36927
URL: https://issues.apache.org/jira/browse/SPARK-36927
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36874:
Assignee: (was: Apache Spark)
> Ambiguous Self-Join detected only on right dataframe
[
https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36874:
Assignee: Apache Spark
> Ambiguous Self-Join detected only on right dataframe
>
[
https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424113#comment-17424113
]
Apache Spark commented on SPARK-36874:
--
User 'sarutak' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424112#comment-17424112
]
Venkata krishnan Sowrirajan commented on SPARK-36926:
-
I tried to get a simpler
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424080#comment-17424080
]
Venkata krishnan Sowrirajan edited comment on SPARK-36926 at 10/4/21, 6:53 PM:
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424097#comment-17424097
]
Mridul Muralidharan commented on SPARK-36926:
-
+CC [~gengliang], [~cloud_fan]
> Discrepancy
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424080#comment-17424080
]
Venkata krishnan Sowrirajan edited comment on SPARK-36926 at 10/4/21, 6:05 PM:
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424080#comment-17424080
]
Venkata krishnan Sowrirajan commented on SPARK-36926:
-
The issue seems to be with
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424080#comment-17424080
]
Venkata krishnan Sowrirajan edited comment on SPARK-36926 at 10/4/21, 6:04 PM:
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424058#comment-17424058
]
Aravind Patnam commented on SPARK-36926:
cc: [~vsowrirajan] [~mridulm80]
> Discrepancy in Q22
[
https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424052#comment-17424052
]
Mridul Muralidharan edited comment on SPARK-36892 at 10/4/21, 5:26 PM:
[
https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424052#comment-17424052
]
Mridul Muralidharan commented on SPARK-36892:
-
[~Gengliang.Wang] Thanks for holding the
[
https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venkata krishnan Sowrirajan updated SPARK-36926:
Description:
When running TPCH scale 100 against 3.2, Query 22
Aravind Patnam created SPARK-36926:
--
Summary: Discrepancy in Q22 of TPCH for Spark 3.2
Key: SPARK-36926
URL: https://issues.apache.org/jira/browse/SPARK-36926
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-36911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36911:
Assignee: (was: Apache Spark)
> Add AQE Planning Times to SQL Metrics
>
[
https://issues.apache.org/jira/browse/SPARK-36911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36911:
Assignee: Apache Spark
> Add AQE Planning Times to SQL Metrics
>
[
https://issues.apache.org/jira/browse/SPARK-36911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424016#comment-17424016
]
Apache Spark commented on SPARK-36911:
--
User 'ChenMichael' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-36921:
-
Description: Extended the div function to support ANSI intervals. The
operation should produce quotient
[
https://issues.apache.org/jira/browse/SPARK-36917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423918#comment-17423918
]
Davide Benedetto commented on SPARK-36917:
--
I have checked in other Jira but any of them
[
https://issues.apache.org/jira/browse/SPARK-36917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423909#comment-17423909
]
Sean R. Owen commented on SPARK-36917:
--
Search JIRA, there are related issues, some of which are
[
https://issues.apache.org/jira/browse/SPARK-36600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Philippe Prados updated SPARK-36600:
Summary: Optimise speed and memory with Pyspark when create DataFrame (with
patch) (was:
[
https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423892#comment-17423892
]
Apache Spark commented on SPARK-36920:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36920:
Assignee: Apache Spark (was: Max Gekk)
> Support ANSI intervals by ABS
>
[
https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36920:
Assignee: Max Gekk (was: Apache Spark)
> Support ANSI intervals by ABS
>
[
https://issues.apache.org/jira/browse/SPARK-36925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhinav Kumar updated SPARK-36925:
--
Description:
Hello team, One quick question.
I read somewhere in the doc - Order of priority
Abhinav Kumar created SPARK-36925:
-
Summary: Overriding parameters
Key: SPARK-36925
URL: https://issues.apache.org/jira/browse/SPARK-36925
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-36920:
Assignee: Max Gekk
> Support ANSI intervals by ABS
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423882#comment-17423882
]
Max Gekk commented on SPARK-36920:
--
I am working on this.
> Support ANSI intervals by ABS
>
[
https://issues.apache.org/jira/browse/SPARK-36917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423867#comment-17423867
]
Davide Benedetto commented on SPARK-36917:
--
[~srowen] Can You Please help me with this issue?
Max Gekk created SPARK-36924:
Summary: CAST between ANSI intervals and numerics
Key: SPARK-36924
URL: https://issues.apache.org/jira/browse/SPARK-36924
Project: Spark
Issue Type: Sub-task
Max Gekk created SPARK-36923:
Summary: Allow coercing of an interval expression to a specific
interval type
Key: SPARK-36923
URL: https://issues.apache.org/jira/browse/SPARK-36923
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-36922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-36922:
-
Description: Extend the *sign/signum* functions to support ANSI intervals.
(was: Extend the *sign*
[
https://issues.apache.org/jira/browse/SPARK-36922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-36922:
-
Summary: The SIGN/SIGNUM functions should support ANSI intervals (was: The
sign function should
Max Gekk created SPARK-36922:
Summary: The sign function should support ANSI intervals
Key: SPARK-36922
URL: https://issues.apache.org/jira/browse/SPARK-36922
Project: Spark
Issue Type: Sub-task
Max Gekk created SPARK-36921:
Summary: The DIV function should support ANSI intervals
Key: SPARK-36921
URL: https://issues.apache.org/jira/browse/SPARK-36921
Project: Spark
Issue Type: Sub-task
Max Gekk created SPARK-36920:
Summary: Support ANSI intervals by ABS
Key: SPARK-36920
URL: https://issues.apache.org/jira/browse/SPARK-36920
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423855#comment-17423855
]
Apache Spark commented on SPARK-36302:
--
User 'dchvn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423854#comment-17423854
]
Apache Spark commented on SPARK-36302:
--
User 'dchvn' has created a pull request for this issue:
87 matches
Mail list logo