[
https://issues.apache.org/jira/browse/SPARK-27802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liupengcheng updated SPARK-27802:
-
Description:
Recently, we hit this issue when testing spark2.3. It report the following
error m
[
https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845594#comment-16845594
]
Patrick McGloin commented on SPARK-16738:
-
For what it's worth [~skonto] I think
[
https://issues.apache.org/jira/browse/SPARK-19468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845603#comment-16845603
]
Josh Rosen commented on SPARK-19468:
Chiming in to add a strong +1 here, since this
Wenchen Fan created SPARK-27803:
---
Summary: fix column pruning for python UDF
Key: SPARK-27803
URL: https://issues.apache.org/jira/browse/SPARK-27803
Project: Spark
Issue Type: Bug
Com
[
https://issues.apache.org/jira/browse/SPARK-27803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27803:
Assignee: Wenchen Fan (was: Apache Spark)
> fix column pruning for python UDF
>
[
https://issues.apache.org/jira/browse/SPARK-27803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27803:
Assignee: Apache Spark (was: Wenchen Fan)
> fix column pruning for python UDF
>
[
https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845719#comment-16845719
]
Stavros Kontopoulos commented on SPARK-16738:
-
[~hyukjin.kwon] Both Kafka St
[
https://issues.apache.org/jira/browse/SPARK-26045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845784#comment-16845784
]
Renze Post commented on SPARK-26045:
[~srowen] I think the issue here is that the Sp
duyu created SPARK-27804:
Summary: LiveListenerBus#addToQueue : create multiple
AsyncEventQueues under race condition
Key: SPARK-27804
URL: https://issues.apache.org/jira/browse/SPARK-27804
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
duyu updated SPARK-27804:
-
Description:
LiveListenerBus.scala
{code}
private[spark] def addToQueue(
listener: SparkListenerInterfac
[
https://issues.apache.org/jira/browse/SPARK-27804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845826#comment-16845826
]
Jungtaek Lim commented on SPARK-27804:
--
Did you encounter this actually? The reason
[
https://issues.apache.org/jira/browse/SPARK-26045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845832#comment-16845832
]
Sean Owen commented on SPARK-26045:
---
Yes this is consistent with the thread on dev@ ye
[
https://issues.apache.org/jira/browse/SPARK-27804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27804:
Assignee: Apache Spark
> LiveListenerBus#addToQueue : create multiple AsyncEventQueues un
[
https://issues.apache.org/jira/browse/SPARK-27804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27804:
Assignee: (was: Apache Spark)
> LiveListenerBus#addToQueue : create multiple AsyncEve
[
https://issues.apache.org/jira/browse/SPARK-27804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845899#comment-16845899
]
duyu commented on SPARK-27804:
--
I didn't.
You say this method is guided with synchronized,
[
https://issues.apache.org/jira/browse/SPARK-27804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845899#comment-16845899
]
duyu edited comment on SPARK-27804 at 5/22/19 2:08 PM:
---
I didn't.
David Vogelbacher created SPARK-27805:
-
Summary: toPandas does not propagate SparkExceptions with arrow
enabled
Key: SPARK-27805
URL: https://issues.apache.org/jira/browse/SPARK-27805
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-27805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27805:
Assignee: (was: Apache Spark)
> toPandas does not propagate SparkExceptions with arro
[
https://issues.apache.org/jira/browse/SPARK-27805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27805:
Assignee: Apache Spark
> toPandas does not propagate SparkExceptions with arrow enabled
>
[
https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845988#comment-16845988
]
Nandor Kollar commented on SPARK-27714:
---
Is this something similar that is impleme
[
https://issues.apache.org/jira/browse/SPARK-25139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25139:
--
Fix Version/s: 2.3.4
> PythonRunner#WriterThread released block after TaskRunner finally block
Wenchen Fan created SPARK-27806:
---
Summary: byName/byPosition should apply to struct fields as well
Key: SPARK-27806
URL: https://issues.apache.org/jira/browse/SPARK-27806
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-27804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846016#comment-16846016
]
duyu commented on SPARK-27804:
--
thank you [~kabhwan].
I ignored the word {color:#FF}sy
[
https://issues.apache.org/jira/browse/SPARK-27806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27806:
Assignee: Wenchen Fan (was: Apache Spark)
> byName/byPosition should apply to struct fie
[
https://issues.apache.org/jira/browse/SPARK-27806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27806:
Assignee: Apache Spark (was: Wenchen Fan)
> byName/byPosition should apply to struct fie
Yuming Wang created SPARK-27807:
---
Summary: Parallel resolve leaf statuses in InMemoryFileIndex
Key: SPARK-27807
URL: https://issues.apache.org/jira/browse/SPARK-27807
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27807:
Assignee: Apache Spark
> Parallel resolve leaf statuses in InMemoryFileIndex
> --
[
https://issues.apache.org/jira/browse/SPARK-27807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846041#comment-16846041
]
Apache Spark commented on SPARK-27807:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-27807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27807:
Assignee: (was: Apache Spark)
> Parallel resolve leaf statuses in InMemoryFileIndex
>
[
https://issues.apache.org/jira/browse/SPARK-27797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846068#comment-16846068
]
Marcelo Vanzin commented on SPARK-27797:
You're right. Looks just like some dead
Vladimir Matveev created SPARK-27808:
Summary: Ability to ignore existing files for structured streaming
Key: SPARK-27808
URL: https://issues.apache.org/jira/browse/SPARK-27808
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Matveev updated SPARK-27808:
-
Description:
Currently it is not easily possible to make a structured streaming query to
[
https://issues.apache.org/jira/browse/SPARK-27808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Matveev updated SPARK-27808:
-
Description:
Currently it is not easily possible to make a structured streaming query to
[
https://issues.apache.org/jira/browse/SPARK-27808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Matveev updated SPARK-27808:
-
Description:
Currently it is not easily possible to make a structured streaming query to
[
https://issues.apache.org/jira/browse/SPARK-16824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas reopened SPARK-16824:
--
Reviewing the links here, it seems that VectorUDT has been in use since 2016 at
the earli
[
https://issues.apache.org/jira/browse/SPARK-16824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-16824:
-
Affects Version/s: 2.4.3
> Add API docs for VectorUDT
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-16824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-16824:
-
Labels: (was: bulk-closed)
> Add API docs for VectorUDT
> --
>
[
https://issues.apache.org/jira/browse/SPARK-27804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-27804.
Resolution: Not A Problem
> LiveListenerBus#addToQueue : create multiple AsyncEventQueues
[
https://issues.apache.org/jira/browse/SPARK-26045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26045:
Assignee: Apache Spark
> Error in the spark 2.4 release package with the spark-avro_2.11
[
https://issues.apache.org/jira/browse/SPARK-26045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26045:
Assignee: (was: Apache Spark)
> Error in the spark 2.4 release package with the spark
Yesheng Ma created SPARK-27809:
--
Summary: Make optional clauses order insensitive for CREATE
DATABASE/VIEW SQL statement
Key: SPARK-27809
URL: https://issues.apache.org/jira/browse/SPARK-27809
Project: S
[
https://issues.apache.org/jira/browse/SPARK-27809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27809:
Assignee: Apache Spark
> Make optional clauses order insensitive for CREATE DATABASE/VIEW
[
https://issues.apache.org/jira/browse/SPARK-27809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27809:
Assignee: (was: Apache Spark)
> Make optional clauses order insensitive for CREATE DA
[
https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20547:
Assignee: Shixiong Zhu (was: Apache Spark)
> ExecutorClassLoader's findClass may not wor
[
https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20547:
Assignee: Apache Spark (was: Shixiong Zhu)
> ExecutorClassLoader's findClass may not wor
[
https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-20547:
-
Labels: (was: bulk-closed)
> ExecutorClassLoader's findClass may not work correctly when a tas
[
https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Erik Erlandson resolved SPARK-23153.
Resolution: Fixed
> Support application dependencies in submission client's local file sys
[
https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Erik Erlandson reassigned SPARK-23153:
--
Assignee: Stavros Kontopoulos
Fix Version/s: 3.0.0
> Support application dep
Travis Addair created SPARK-27810:
-
Summary: PySpark breaks Cloudpickle serialization of
collections.namedtuple objects
Key: SPARK-27810
URL: https://issues.apache.org/jira/browse/SPARK-27810
Project:
[
https://issues.apache.org/jira/browse/SPARK-27810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Addair updated SPARK-27810:
--
Description:
After importing pyspark, cloudpickle is no longer able to properly serialize
obj
[
https://issues.apache.org/jira/browse/SPARK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846389#comment-16846389
]
John-Michael Reed commented on SPARK-15015:
---
I would be willing to work to add
[
https://issues.apache.org/jira/browse/SPARK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John-Michael Reed reopened SPARK-15015:
---
See last comment.
> Log statements lack file name/number
>
[
https://issues.apache.org/jira/browse/SPARK-27807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-27807.
-
Resolution: Duplicate
> Parallel resolve leaf statuses in InMemoryFileIndex
> --
jiaan.geng created SPARK-27811:
--
Summary: Docs of spark.driver.memoryOverhead and
spark.executor.memoryOverhead exists a little ambiguity
Key: SPARK-27811
URL: https://issues.apache.org/jira/browse/SPARK-27811
[
https://issues.apache.org/jira/browse/SPARK-27811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846415#comment-16846415
]
Apache Spark commented on SPARK-27811:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-27811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27811:
Assignee: Apache Spark
> Docs of spark.driver.memoryOverhead and spark.executor.memoryOv
[
https://issues.apache.org/jira/browse/SPARK-27811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27811:
Assignee: (was: Apache Spark)
> Docs of spark.driver.memoryOverhead and spark.execut
[
https://issues.apache.org/jira/browse/SPARK-27322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Zhuge updated SPARK-27322:
---
Description:
Support multi-catalog in the following SELECT code paths:
* SELECT * FROM catalog.db.t
[
https://issues.apache.org/jira/browse/SPARK-27810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Addair updated SPARK-27810:
--
Description:
After importing pyspark, cloudpickle is no longer able to properly serialize
obj
[
https://issues.apache.org/jira/browse/SPARK-27810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Addair updated SPARK-27810:
--
Description:
After importing pyspark, cloudpickle is no longer able to properly serialize
obj
[
https://issues.apache.org/jira/browse/SPARK-27705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846458#comment-16846458
]
Henry Yu commented on SPARK-27705:
--
[~dongjoon] That's great! Could you make a pr?
An
[
https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846469#comment-16846469
]
Mathew Wicks commented on SPARK-26388:
--
This appears to still be an issue in Spark
[
https://issues.apache.org/jira/browse/SPARK-27657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846476#comment-16846476
]
Wesley Tang commented on SPARK-27657:
-
If you won't mind, i can send a PR to fix thi
Henry Yu created SPARK-27812:
Summary: kubernetes client import non-daemon thread which block
jvm exit.
Key: SPARK-27812
URL: https://issues.apache.org/jira/browse/SPARK-27812
Project: Spark
Iss
64 matches
Mail list logo