[
https://issues.apache.org/jira/browse/SPARK-37265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441523#comment-17441523
]
Dongjoon Hyun commented on SPARK-37265:
---
Shall we close this, [~sarutak]?
> Support Java 17 in
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta resolved SPARK-37264.
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved in
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-37264:
---
Description:
Like hadoop-common and hadoop-hdfs, this PR proposes to exclude
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-37264:
---
Description:
In the current master, `run-tests.py` fails on Java 17 due to
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-37264:
---
Summary: [SPARK-37264][BUILD] Exclude hadoop-client-api transitive
dependency from orc-core
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-37264:
---
Summary: Cut the transitive dependency on hadoop-client-api which orc-shims
depends on only
[
https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi reassigned SPARK-36575:
Assignee: hujiahua
> Executor lost may cause spark stage to hang
>
[
https://issues.apache.org/jira/browse/SPARK-34230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441509#comment-17441509
]
Anton Okolnychyi commented on SPARK-34230:
--
We should also double check what impact SPARK-36315
[
https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441507#comment-17441507
]
angerszhu commented on SPARK-37201:
---
[~Kotlov] For case two, caused by SchemaPruning executed before
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37264:
Assignee: Kousuke Saruta (was: Apache Spark)
> Skip dependency testing on Java 17
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441505#comment-17441505
]
Apache Spark commented on SPARK-37264:
--
User 'sarutak' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441504#comment-17441504
]
Apache Spark commented on SPARK-37264:
--
User 'sarutak' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37264:
Assignee: Apache Spark (was: Kousuke Saruta)
> Skip dependency testing on Java 17
[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-37264:
---
Description:
In the current master, `run-tests.py` fails on Java 17 due to
Kousuke Saruta created SPARK-37265:
--
Summary: Support Java 17 in `dev/test-dependencies.sh`
Key: SPARK-37265
URL: https://issues.apache.org/jira/browse/SPARK-37265
Project: Spark
Issue
Kousuke Saruta created SPARK-37264:
--
Summary: Skip dependency testing on Java 17 temporarily
Key: SPARK-37264
URL: https://issues.apache.org/jira/browse/SPARK-37264
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-37260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441494#comment-17441494
]
dch nguyen edited comment on SPARK-37260 at 11/10/21, 4:03 AM:
---
ping
[
https://issues.apache.org/jira/browse/SPARK-37260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441494#comment-17441494
]
dch nguyen commented on SPARK-37260:
[~hyukjin.kwon] , is this issue resolved by
[
https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi reassigned SPARK-36575:
Assignee: (was: wuyi)
> Executor lost may cause spark stage to hang
>
[
https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441486#comment-17441486
]
wuyi commented on SPARK-36575:
--
Issue resolved by [https://github.com/apache/spark/pull/33872.]
To
[
https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi updated SPARK-36575:
-
Issue Type: Improvement (was: Bug)
> Executor lost may cause spark stage to hang
>
[
https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi updated SPARK-36575:
-
Fix Version/s: 3.3.0
> Executor lost may cause spark stage to hang
>
[
https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi reassigned SPARK-36575:
Assignee: wuyi
> Executor lost may cause spark stage to hang
>
[
https://issues.apache.org/jira/browse/SPARK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi resolved SPARK-36575.
--
Resolution: Fixed
> Executor lost may cause spark stage to hang
> ---
Haejoon Lee created SPARK-37263:
---
Summary: Reduce pandas-on-Spark warning for internal usage.
Key: SPARK-37263
URL: https://issues.apache.org/jira/browse/SPARK-37263
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37262:
Assignee: (was: Apache Spark)
> Not log empty aggregate and group by in JDBCScan
>
[
https://issues.apache.org/jira/browse/SPARK-37262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37262:
Assignee: Apache Spark
> Not log empty aggregate and group by in JDBCScan
>
[
https://issues.apache.org/jira/browse/SPARK-37262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441429#comment-17441429
]
Apache Spark commented on SPARK-37262:
--
User 'huaxingao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441425#comment-17441425
]
Apache Spark commented on SPARK-37120:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao updated SPARK-37262:
---
Description:
Address the comment
https://github.com/apache/spark/pull/34451#discussion_r740220800
Huaxin Gao created SPARK-37262:
--
Summary: Not log empty aggregate and group by in JDBCScan
Key: SPARK-37262
URL: https://issues.apache.org/jira/browse/SPARK-37262
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441339#comment-17441339
]
Apache Spark commented on SPARK-37221:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37261:
Assignee: Apache Spark (was: Max Gekk)
> Check adding partitions with ANSI intervals
>
[
https://issues.apache.org/jira/browse/SPARK-37261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441313#comment-17441313
]
Apache Spark commented on SPARK-37261:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37261:
Assignee: Max Gekk (was: Apache Spark)
> Check adding partitions with ANSI intervals
>
Max Gekk created SPARK-37261:
Summary: Check adding partitions with ANSI intervals
Key: SPARK-37261
URL: https://issues.apache.org/jira/browse/SPARK-37261
Project: Spark
Issue Type: Sub-task
Thomas Graves created SPARK-37260:
-
Summary: PYSPARK Arrow 3.2.0 docs link invalid
Key: SPARK-37260
URL: https://issues.apache.org/jira/browse/SPARK-37260
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-37246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37246:
--
Issue Type: Bug (was: Umbrella)
> Run PyArrow tests on Python 3.10
>
[
https://issues.apache.org/jira/browse/SPARK-37246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441257#comment-17441257
]
Dongjoon Hyun commented on SPARK-37246:
---
Never mind. This is also valuable. I converted this
[
https://issues.apache.org/jira/browse/SPARK-37246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reopened SPARK-37246:
---
> Run PyArrow tests on Python 3.10
>
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-37247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-37247.
-
> Failed test_create_nan_decimal_dataframe
> (pyspark.sql.tests.test_dataframe.DataFrameTests)
>
[
https://issues.apache.org/jira/browse/SPARK-37246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37246:
--
Summary: Run PyArrow tests on Python 3.10 (was: Support Python 3.10 in
PySpark)
> Run
[
https://issues.apache.org/jira/browse/SPARK-37247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37247:
--
Parent: (was: SPARK-37246)
Issue Type: Bug (was: Sub-task)
> Failed
[
https://issues.apache.org/jira/browse/SPARK-37248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37248:
--
Parent: (was: SPARK-37246)
Issue Type: Bug (was: Sub-task)
> Failed
[
https://issues.apache.org/jira/browse/SPARK-37248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-37248.
-
> Failed test_make_date (pyspark.sql.tests.test_functions.FunctionsTests)
>
[
https://issues.apache.org/jira/browse/SPARK-37249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37249:
--
Parent: (was: SPARK-37246)
Issue Type: Bug (was: Sub-task)
> ImportError: cannot
[
https://issues.apache.org/jira/browse/SPARK-37250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37250:
--
Parent: (was: SPARK-37246)
Issue Type: Bug (was: Sub-task)
> Failed
[
https://issues.apache.org/jira/browse/SPARK-37251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-37251.
-
> Failed _joinAsOf doctest
>
>
> Key: SPARK-37251
>
[
https://issues.apache.org/jira/browse/SPARK-37251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37251:
--
Parent: (was: SPARK-37246)
Issue Type: Bug (was: Sub-task)
> Failed _joinAsOf
[
https://issues.apache.org/jira/browse/SPARK-37250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-37250.
-
> Failed test_capture_user_friendly_exception
> (pyspark.sql.tests.test_utils.UtilsTests)
>
[
https://issues.apache.org/jira/browse/SPARK-37257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-37257.
---
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34533
[
https://issues.apache.org/jira/browse/SPARK-37257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-37257:
-
Assignee: Hyukjin Kwon
> Update setup.py for Python 3.10
>
[
https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441242#comment-17441242
]
Apache Spark commented on SPARK-35011:
--
User 'Ngone51' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Appel updated SPARK-37259:
Description:
The read jdbc is wrapping the query it sends to the database server inside a
select
[
https://issues.apache.org/jira/browse/SPARK-35557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441227#comment-17441227
]
Olivier Peyrusse commented on SPARK-35557:
--
Hello, everyone,
I see a similar issue when
Kevin Appel created SPARK-37259:
---
Summary: JDBC read is always going to wrap the query in a select
statement
Key: SPARK-37259
URL: https://issues.apache.org/jira/browse/SPARK-37259
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441205#comment-17441205
]
Apache Spark commented on SPARK-37201:
--
User 'AngersZh' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37201:
Assignee: (was: Apache Spark)
> Spark SQL reads unnecessary nested fields (filter
[
https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37201:
Assignee: Apache Spark
> Spark SQL reads unnecessary nested fields (filter after
[
https://issues.apache.org/jira/browse/SPARK-37258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-37258:
Description:
We need to add a volcano in [1].
There were some comments on k8s-client repo to
Yikun Jiang created SPARK-37258:
---
Summary: Add Volcano support in kubernetes-client
Key: SPARK-37258
URL: https://issues.apache.org/jira/browse/SPARK-37258
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441189#comment-17441189
]
angerszhu commented on SPARK-37201:
---
Working on this
> Spark SQL reads unnecessary nested fields
[
https://issues.apache.org/jira/browse/SPARK-37257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441180#comment-17441180
]
Apache Spark commented on SPARK-37257:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37257:
Assignee: Apache Spark
> Update setup.py for Python 3.10
>
[
https://issues.apache.org/jira/browse/SPARK-37257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441178#comment-17441178
]
Apache Spark commented on SPARK-37257:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37257:
Assignee: (was: Apache Spark)
> Update setup.py for Python 3.10
>
Hyukjin Kwon created SPARK-37257:
Summary: Update setup.py for Python 3.10
Key: SPARK-37257
URL: https://issues.apache.org/jira/browse/SPARK-37257
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-37256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37256:
Assignee: Apache Spark
> Replace `ScalaObjectMapper` with `ClassTagExtensions` to fix
[
https://issues.apache.org/jira/browse/SPARK-37256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37256:
Assignee: (was: Apache Spark)
> Replace `ScalaObjectMapper` with
[
https://issues.apache.org/jira/browse/SPARK-37256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441142#comment-17441142
]
Apache Spark commented on SPARK-37256:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441141#comment-17441141
]
Apache Spark commented on SPARK-37256:
--
User 'LuciferYang' has created a pull request for this
Yang Jie created SPARK-37256:
Summary: Replace `ScalaObjectMapper` with `ClassTagExtensions` to
fix compilation warnings
Key: SPARK-37256
URL: https://issues.apache.org/jira/browse/SPARK-37256
Project:
[
https://issues.apache.org/jira/browse/SPARK-25224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441131#comment-17441131
]
ramakrishna chilaka commented on SPARK-25224:
-
can anyone please confirm, if there are any
[
https://issues.apache.org/jira/browse/SPARK-37253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-37253.
--
Fix Version/s: 3.3.0
3.2.1
3.1.3
Resolution:
[
https://issues.apache.org/jira/browse/SPARK-37253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-37253:
Assignee: Apache Spark
> try_simplify_traceback should not fail when tb_frame.f_lineno
ramakrishna chilaka created SPARK-37255:
---
Summary: When Used with PyHive (by dropbox) query timeout doesn't
result in propagation to the UI
Key: SPARK-37255
URL:
[
https://issues.apache.org/jira/browse/SPARK-37254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ramakrishna chilaka updated SPARK-37254:
Description:
We are trying to use Spark thrift server as a distributed sql query
ramakrishna chilaka created SPARK-37254:
---
Summary: 100% CPU usage on Spark Thrift Server.
Key: SPARK-37254
URL: https://issues.apache.org/jira/browse/SPARK-37254
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441038#comment-17441038
]
Apache Spark commented on SPARK-37239:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37253:
--
Description:
{code}
Traceback (most recent call last):
File
[
https://issues.apache.org/jira/browse/SPARK-37253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37253:
--
Description:
{code}
During handling of the above exception, another exception occurred:
[
https://issues.apache.org/jira/browse/SPARK-37253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37253:
--
Affects Version/s: 3.2.0
3.1.2
> try_simplify_traceback should not
[
https://issues.apache.org/jira/browse/SPARK-37253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440998#comment-17440998
]
Apache Spark commented on SPARK-37253:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37253:
Assignee: (was: Apache Spark)
> try_simplify_traceback should not fail when
[
https://issues.apache.org/jira/browse/SPARK-37253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37253:
Assignee: Apache Spark
> try_simplify_traceback should not fail when tb_frame.f_lineno
[
https://issues.apache.org/jira/browse/SPARK-37253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440996#comment-17440996
]
Apache Spark commented on SPARK-37253:
--
User 'dongjoon-hyun' has created a pull request for this
Dongjoon Hyun created SPARK-37253:
-
Summary: try_simplify_traceback should not fail when
tb_frame.f_lineno is None
Key: SPARK-37253
URL: https://issues.apache.org/jira/browse/SPARK-37253
Project:
87 matches
Mail list logo