[
https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23599:
Assignee: Apache Spark
> The UUID() expression is too non-deterministic
>
[
https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23599:
Assignee: (was: Apache Spark)
> The UUID() expression is too non-deterministic
>
[
https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398121#comment-16398121
]
Apache Spark commented on SPARK-23599:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397809#comment-16397809
]
Wenchen Fan commented on SPARK-19842:
-
can we put the design doc to google doc so that other people
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell resolved SPARK-23598.
---
Resolution: Fixed
Assignee: Kazuaki Ishizaki
Fix Version/s: 2.4.0
>
[
https://issues.apache.org/jira/browse/SPARK-23674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Jiang updated SPARK-23674:
---
Description:
Currently, Spark provides status monitoring for different components of Spark,
like
[
https://issues.apache.org/jira/browse/SPARK-21479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397703#comment-16397703
]
Apache Spark commented on SPARK-21479:
--
User 'maryannxue' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397668#comment-16397668
]
Ming Jiang commented on SPARK-23674:
Hello,
I will work on this and propose a pr, thanks!
> Add
[
https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397662#comment-16397662
]
Suman Somasundar commented on SPARK-23529:
--
I have a couple of use-cases for this as explained
Mingjie Tang created SPARK-23674:
Summary: Add Spark ML Listener for Tracking ML Pipeline Status
Key: SPARK-23674
URL: https://issues.apache.org/jira/browse/SPARK-23674
Project: Spark
Issue
Ivan SPM created SPARK-23673:
Summary: PySpark dayofweek does not conform with ISO 8601
Key: SPARK-23673
URL: https://issues.apache.org/jira/browse/SPARK-23673
Project: Spark
Issue Type: Bug
holdenk created SPARK-23672:
---
Summary: Support returning lists in Arrow UDFs
Key: SPARK-23672
URL: https://issues.apache.org/jira/browse/SPARK-23672
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-23547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-23547.
-
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 20702
[
https://issues.apache.org/jira/browse/SPARK-23547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-23547:
---
Assignee: zuotingbing
> Cleanup the .pipeout file when the Hive Session closed
>
[
https://issues.apache.org/jira/browse/SPARK-23200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397432#comment-16397432
]
Anirudh Ramanathan commented on SPARK-23200:
Looks like the change was reverted.
[
https://issues.apache.org/jira/browse/SPARK-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23658:
Assignee: Apache Spark
> InProcessAppHandle uses the wrong class in getLogger
>
[
https://issues.apache.org/jira/browse/SPARK-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23658:
Assignee: (was: Apache Spark)
> InProcessAppHandle uses the wrong class in getLogger
[
https://issues.apache.org/jira/browse/SPARK-23658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397427#comment-16397427
]
Apache Spark commented on SPARK-23658:
--
User 'sahilTakiar' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan resolved SPARK-18278.
Resolution: Fixed
Closing this. Sub-issues have been created for remaining items
[
https://issues.apache.org/jira/browse/SPARK-22865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-22865:
---
Issue Type: New Feature (was: Sub-task)
Parent: (was: SPARK-18278)
>
[
https://issues.apache.org/jira/browse/SPARK-23067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-23067:
---
Issue Type: Bug (was: Sub-task)
Parent: (was: SPARK-18278)
> Allow for
[
https://issues.apache.org/jira/browse/SPARK-23010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan updated SPARK-23010:
---
Issue Type: New Feature (was: Sub-task)
Parent: (was: SPARK-18278)
>
[
https://issues.apache.org/jira/browse/SPARK-23324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan resolved SPARK-23324.
Resolution: Fixed
> Announce new Kubernetes back-end for 2.3 release notes
>
[
https://issues.apache.org/jira/browse/SPARK-23324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-23324:
--
Assignee: Erik Erlandson
> Announce new Kubernetes back-end for 2.3 release
[
https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397421#comment-16397421
]
Anirudh Ramanathan commented on SPARK-23529:
Can this wait till we have local PVs? Mounting
[
https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397417#comment-16397417
]
Anirudh Ramanathan commented on SPARK-23618:
Thanks Felix. The mechanism appears to work, but
[
https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-23618:
--
Assignee: (was: Anirudh Ramanathan)
> docker-image-tool.sh Fails While
[
https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-23618:
--
Assignee: Anirudh Ramanathan
> docker-image-tool.sh Fails While Building
[
https://issues.apache.org/jira/browse/SPARK-23136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-23136:
--
Assignee: Anirudh Ramanathan
> Mark packages as experimental
>
[
https://issues.apache.org/jira/browse/SPARK-23016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-23016:
--
Assignee: Anirudh Ramanathan
> Spark UI access and documentation
>
[
https://issues.apache.org/jira/browse/SPARK-22758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-22758:
--
Assignee: Marcelo Vanzin
> New Spark Jira component for Kubernetes
>
[
https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-22647:
--
Assignee: Yinan Li
> Docker files for image creation
>
[
https://issues.apache.org/jira/browse/SPARK-22645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-22645:
--
Assignee: Anirudh Ramanathan
> Add Scheduler Backend with static allocation
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397403#comment-16397403
]
Anirudh Ramanathan commented on SPARK-18278:
I think we should close this JIRA out and move
[
https://issues.apache.org/jira/browse/SPARK-23083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-23083:
--
Assignee: Anirudh Ramanathan
> Adding Kubernetes as an option to
[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirudh Ramanathan reassigned SPARK-18278:
--
Assignee: Anirudh Ramanathan
> SPIP: Support native submission of spark jobs
[
https://issues.apache.org/jira/browse/SPARK-23671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23671:
Assignee: (was: Apache Spark)
> SHS is ignoring number of replay threads
>
[
https://issues.apache.org/jira/browse/SPARK-23671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23671:
Assignee: Apache Spark
> SHS is ignoring number of replay threads
>
[
https://issues.apache.org/jira/browse/SPARK-23671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397398#comment-16397398
]
Apache Spark commented on SPARK-23671:
--
User 'vanzin' has created a pull request for this issue:
Marcelo Vanzin created SPARK-23671:
--
Summary: SHS is ignoring number of replay threads
Key: SPARK-23671
URL: https://issues.apache.org/jira/browse/SPARK-23671
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-23642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23642:
Assignee: Apache Spark
> isZero scaladoc for LongAccumulator describes wrong method
>
[
https://issues.apache.org/jira/browse/SPARK-23642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23642:
Assignee: (was: Apache Spark)
> isZero scaladoc for LongAccumulator describes wrong
[
https://issues.apache.org/jira/browse/SPARK-23642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397349#comment-16397349
]
Apache Spark commented on SPARK-23642:
--
User 'smallory' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397213#comment-16397213
]
Felix Cheung commented on SPARK-23632:
--
could you explain how you think these environment variables
[
https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397211#comment-16397211
]
Felix Cheung commented on SPARK-23618:
--
[~foxish] - Jira has a different user role system, I've
[
https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23670:
Assignee: Apache Spark
> Memory leak of SparkPlanGraphWrapper in sparkUI
>
[
https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23670:
Assignee: (was: Apache Spark)
> Memory leak of SparkPlanGraphWrapper in sparkUI
>
[
https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397104#comment-16397104
]
Apache Spark commented on SPARK-23670:
--
User 'myroslavlisniak' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23669:
Assignee: (was: Apache Spark)
> Executors fetch jars and name the jars with md5
[
https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23669:
Assignee: Apache Spark
> Executors fetch jars and name the jars with md5 prefix
>
[
https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397052#comment-16397052
]
Apache Spark commented on SPARK-23669:
--
User 'jinxing64' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Myroslav Lisniak updated SPARK-23670:
-
Attachment: heap.png
> Memory leak of SparkPlanGraphWrapper in sparkUI
>
Myroslav Lisniak created SPARK-23670:
Summary: Memory leak of SparkPlanGraphWrapper in sparkUI
Key: SPARK-23670
URL: https://issues.apache.org/jira/browse/SPARK-23670
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-23669:
-
Description:
In our cluster, there are lots of UDF jars, some of them have the same filename
but
[
https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-23669:
-
Description:
In our cluster, there are lots of UDF jars, some of them have the same filename
but
jin xing created SPARK-23669:
Summary: Executors fetch jars and name the jars with md5 prefix
Key: SPARK-23669
URL: https://issues.apache.org/jira/browse/SPARK-23669
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-23669:
-
Description:
In our cluster, there are lots of UDF jars, some of them have the same filename
but
[
https://issues.apache.org/jira/browse/SPARK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-23669:
-
Environment: (was: In our cluster, there are lots of UDF jars, some of
them have the same filename
[
https://issues.apache.org/jira/browse/SPARK-23656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell resolved SPARK-23656.
---
Resolution: Fixed
Assignee: Kazuaki Ishizaki
Fix Version/s: 2.4.0
>
[
https://issues.apache.org/jira/browse/SPARK-23668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396998#comment-16396998
]
Apache Spark commented on SPARK-23668:
--
User 'andrusha' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23668:
Assignee: (was: Apache Spark)
> Support for imagePullSecrets k8s option
>
[
https://issues.apache.org/jira/browse/SPARK-23668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23668:
Assignee: Apache Spark
> Support for imagePullSecrets k8s option
>
Andrew Korzhuev created SPARK-23668:
---
Summary: Support for imagePullSecrets k8s option
Key: SPARK-23668
URL: https://issues.apache.org/jira/browse/SPARK-23668
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396948#comment-16396948
]
Sergei Lebedev commented on SPARK-22674:
Just out of curiosity: what is the original motivation
[
https://issues.apache.org/jira/browse/SPARK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396926#comment-16396926
]
Apache Spark commented on SPARK-20114:
--
User 'WeichenXu123' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20114:
Assignee: (was: Apache Spark)
> spark.ml parity for sequential pattern mining -
[
https://issues.apache.org/jira/browse/SPARK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20114:
Assignee: Apache Spark
> spark.ml parity for sequential pattern mining - PrefixSpan
>
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396834#comment-16396834
]
Deepansh edited comment on SPARK-23650 at 3/13/18 11:37 AM:
I tried on local
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Deepansh updated SPARK-23650:
-
Attachment: sparkRlag.txt
> Slow SparkR udf (dapply)
>
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-23667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396842#comment-16396842
]
Apache Spark commented on SPARK-23667:
--
User 'gczsjdy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23667:
Assignee: (was: Apache Spark)
> Scala version check will fail due to launcher
[
https://issues.apache.org/jira/browse/SPARK-23667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23667:
Assignee: Apache Spark
> Scala version check will fail due to launcher directory doesn't
Chenzhao Guo created SPARK-23667:
Summary: Scala version check will fail due to launcher directory
doesn't exist
Key: SPARK-23667
URL: https://issues.apache.org/jira/browse/SPARK-23667
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396834#comment-16396834
]
Deepansh edited comment on SPARK-23650 at 3/13/18 11:25 AM:
I tried on local
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396834#comment-16396834
]
Deepansh commented on SPARK-23650:
--
I tried on local as well as yarn cluster, the result is more or less
[
https://issues.apache.org/jira/browse/SPARK-23666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396832#comment-16396832
]
Daniel Darabos commented on SPARK-23666:
I've looked at the code and both {{ScalaUDF.scala}} and
Daniel Darabos created SPARK-23666:
--
Summary: Undeterministic column name with UDFs
Key: SPARK-23666
URL: https://issues.apache.org/jira/browse/SPARK-23666
Project: Spark
Issue Type: Bug
zhoukang created SPARK-23665:
Summary: Add adaptive algorithm to select query result collect
method
Key: SPARK-23665
URL: https://issues.apache.org/jira/browse/SPARK-23665
Project: Spark
Issue
zhoukang created SPARK-23664:
Summary: Add interface to collect query result through file
iterator
Key: SPARK-23664
URL: https://issues.apache.org/jira/browse/SPARK-23664
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396706#comment-16396706
]
Jaehyeon Kim commented on SPARK-23632:
--
Spark packages are downloaded asynchronously and that is why
[
https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396683#comment-16396683
]
Jurgen Parker commented on SPARK-4820:
--
I suggest you to use Long Path Tool. It relay helped me solve
[
https://issues.apache.org/jira/browse/SPARK-22371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396640#comment-16396640
]
Mayank Agarwal commented on SPARK-22371:
Hi, Any update on the above issue
>
kaushik srinivas created SPARK-23663:
Summary: Spark Streaming Kafka 010 , fails with
"java.util.ConcurrentModificationException: KafkaConsumer is not safe for
multi-threaded access"
Key: SPARK-23663
URL:
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396607#comment-16396607
]
Felix Cheung commented on SPARK-23650:
--
which system/platform are you running on?
> Slow SparkR udf
[
https://issues.apache.org/jira/browse/SPARK-23632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396606#comment-16396606
]
Felix Cheung commented on SPARK-23632:
--
well, if download of packages is taking that long, then
85 matches
Mail list logo