[jira] [Commented] (SPARK-24492) Endless attempted task when TaskCommitDenied exception writing to S3A

[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506792#comment-16506792 ] Yu-Jhe Li commented on SPARK-24492: --- [~ste...@apache.org]: i thinks the TaskCommitDenied exception is

[jira] [Resolved] (SPARK-24468) DecimalType `adjustPrecisionScale` might fail when scale is negative

[ https://issues.apache.org/jira/browse/SPARK-24468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24468. - Resolution: Fixed Fix Version/s: 2.3.2 2.4.0 Issue resolved by pull

[jira] [Assigned] (SPARK-24468) DecimalType `adjustPrecisionScale` might fail when scale is negative

[ https://issues.apache.org/jira/browse/SPARK-24468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24468: --- Assignee: Marco Gaido > DecimalType `adjustPrecisionScale` might fail when scale is

[jira] [Resolved] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-24412. - Resolution: Fixed > Adding docs about automagical type casting in `isin` and `isInCollection` APIs >

[jira] [Commented] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506730#comment-16506730 ] Apache Spark commented on SPARK-24412: -- User 'trvskn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24412: Assignee: thrvskn (was: Apache Spark) > Adding docs about automagical type casting in

[jira] [Assigned] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24412: Assignee: Apache Spark (was: thrvskn) > Adding docs about automagical type casting in

[jira] [Commented] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506728#comment-16506728 ] Apache Spark commented on SPARK-24502: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24502: Assignee: Apache Spark (was: Wenchen Fan) > flaky test: UnsafeRowSerializerSuite >

[jira] [Assigned] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24502: Assignee: Wenchen Fan (was: Apache Spark) > flaky test: UnsafeRowSerializerSuite >

[jira] [Created] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

Wenchen Fan created SPARK-24502: --- Summary: flaky test: UnsafeRowSerializerSuite Key: SPARK-24502 URL: https://issues.apache.org/jira/browse/SPARK-24502 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24502: Description:

[jira] [Updated] (SPARK-24502) flaky test: UnsafeRowSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-24502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24502: Labels: flaky-test (was: ) > flaky test: UnsafeRowSerializerSuite >

[jira] [Commented] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506709#comment-16506709 ] Nicholas Parker commented on SPARK-24501: - PR: https://github.com/apache/spark/pull/21516 > Add

[jira] [Issue Comment Deleted] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Parker updated SPARK-24501: Comment: was deleted (was: PR: https://github.com/apache/spark/pull/21516) > Add metrics

[jira] [Assigned] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24501: Assignee: (was: Apache Spark) > Add metrics for Mesos Driver and Dispatcher >

[jira] [Assigned] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24501: Assignee: Apache Spark > Add metrics for Mesos Driver and Dispatcher >

[jira] [Commented] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506707#comment-16506707 ] Apache Spark commented on SPARK-24501: -- User 'nickbp' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24372) Create script for preparing RCs

[ https://issues.apache.org/jira/browse/SPARK-24372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24372: Assignee: (was: Apache Spark) > Create script for preparing RCs >

[jira] [Assigned] (SPARK-24372) Create script for preparing RCs

[ https://issues.apache.org/jira/browse/SPARK-24372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24372: Assignee: Apache Spark > Create script for preparing RCs >

[jira] [Commented] (SPARK-24372) Create script for preparing RCs

[ https://issues.apache.org/jira/browse/SPARK-24372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506703#comment-16506703 ] Apache Spark commented on SPARK-24372: -- User 'vanzin' has created a pull request for this issue:

[jira] [Created] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

Nicholas Parker created SPARK-24501: --- Summary: Add metrics for Mesos Driver and Dispatcher Key: SPARK-24501 URL: https://issues.apache.org/jira/browse/SPARK-24501 Project: Spark Issue

[jira] [Updated] (SPARK-24106) Spark Structure Streaming with RF model taking long time in processing probability for each mini batch

[ https://issues.apache.org/jira/browse/SPARK-24106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-24106: --- Fix Version/s: (was: 2.4.0) (was: 2.3.0) > Spark Structure

[jira] [Updated] (SPARK-24106) Spark Structure Streaming with RF model taking long time in processing probability for each mini batch

[ https://issues.apache.org/jira/browse/SPARK-24106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-24106: --- Target Version/s: (was: 2.2.1, 2.3.0) > Spark Structure Streaming with RF model taking

[jira] [Assigned] (SPARK-22860) Spark workers log ssl passwords passed to the executors

[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22860: Assignee: (was: Apache Spark) > Spark workers log ssl passwords passed to the

[jira] [Assigned] (SPARK-22860) Spark workers log ssl passwords passed to the executors

[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22860: Assignee: Apache Spark > Spark workers log ssl passwords passed to the executors >

[jira] [Commented] (SPARK-22860) Spark workers log ssl passwords passed to the executors

[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506693#comment-16506693 ] Apache Spark commented on SPARK-22860: -- User 'tooptoop4' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-24412: --- Assignee: thrvskn > Adding docs about automagical type casting in `isin` and `isInCollection` APIs

[jira] [Resolved] (SPARK-23010) Add integration testing for Kubernetes backend into the apache/spark repository

[ https://issues.apache.org/jira/browse/SPARK-23010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah resolved SPARK-23010. Resolution: Fixed Fix Version/s: 2.4.0 Some tests are missing but we got a basic set of

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506521#comment-16506521 ] Felix Cheung edited comment on SPARK-24359 at 6/8/18 8:16 PM: -- Thanks

[jira] [Comment Edited] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506521#comment-16506521 ] Felix Cheung edited comment on SPARK-24359 at 6/8/18 8:16 PM: -- Thanks

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506521#comment-16506521 ] Felix Cheung commented on SPARK-24359: -- Thanks Joseph - correct one possibility is to branch 2.4.0

[jira] [Commented] (SPARK-19826) spark.ml Python API for PIC

[ https://issues.apache.org/jira/browse/SPARK-19826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506503#comment-16506503 ] Apache Spark commented on SPARK-19826: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Created] (SPARK-24500) UnsupportedOperationException when trying to execute Union plan with Stream of children

Bogdan Raducanu created SPARK-24500: --- Summary: UnsupportedOperationException when trying to execute Union plan with Stream of children Key: SPARK-24500 URL: https://issues.apache.org/jira/browse/SPARK-24500

[jira] [Updated] (SPARK-22666) Spark datasource for image format

[ https://issues.apache.org/jira/browse/SPARK-22666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-22666: -- Target Version/s: 2.4.0 > Spark datasource for image format >

[jira] [Commented] (SPARK-22666) Spark datasource for image format

[ https://issues.apache.org/jira/browse/SPARK-22666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506471#comment-16506471 ] Xiangrui Meng commented on SPARK-22666: --- [~mhamilton] Do you want to take this task? > Spark

[jira] [Updated] (SPARK-22666) Spark datasource for image format

[ https://issues.apache.org/jira/browse/SPARK-22666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-22666: -- Shepherd: Xiangrui Meng > Spark datasource for image format >

[jira] [Resolved] (SPARK-24213) Power Iteration Clustering in the SparkML throws exception, when the ID is IntType

[ https://issues.apache.org/jira/browse/SPARK-24213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24213. Resolution: Fixed > Power Iteration Clustering in the SparkML throws exception, when the ID is > IntType

[jira] [Resolved] (SPARK-24217) Power Iteration Clustering is not displaying cluster indices corresponding to some vertices.

[ https://issues.apache.org/jira/browse/SPARK-24217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid resolved SPARK-24217. Resolution: Fixed > Power Iteration Clustering is not displaying cluster indices corresponding to > some

[jira] [Resolved] (SPARK-23984) PySpark Bindings for K8S

[ https://issues.apache.org/jira/browse/SPARK-23984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah resolved SPARK-23984. Resolution: Fixed Fix Version/s: 2.4.0 > PySpark Bindings for K8S >

[jira] [Commented] (SPARK-20712) [SPARK 2.1 REGRESSION][SQL] Spark can't read Hive table when column type has length greater than 4000 bytes

[ https://issues.apache.org/jira/browse/SPARK-20712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506456#comment-16506456 ] Wenchen Fan commented on SPARK-20712: - I looked into this. This is actually a hive bug and I feel

[jira] [Assigned] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

[ https://issues.apache.org/jira/browse/SPARK-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-17756: Assignee: Hyukjin Kwon > java.lang.ClassCastException when using cartesian with

[jira] [Resolved] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

[ https://issues.apache.org/jira/browse/SPARK-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-17756. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 19498

[jira] [Commented] (SPARK-24258) SPIP: Improve PySpark support for ML Matrix and Vector types

[ https://issues.apache.org/jira/browse/SPARK-24258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506399#comment-16506399 ] Li Jin commented on SPARK-24258: I ran into [~mengxr] and chatted about this. Seems a good first step is

[jira] [Comment Edited] (SPARK-24467) VectorAssemblerEstimator

[ https://issues.apache.org/jira/browse/SPARK-24467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506334#comment-16506334 ] Nick Pentreath edited comment on SPARK-24467 at 6/8/18 5:59 PM: Yeah the

[jira] [Commented] (SPARK-24467) VectorAssemblerEstimator

[ https://issues.apache.org/jira/browse/SPARK-24467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506334#comment-16506334 ] Nick Pentreath commented on SPARK-24467: Yeah the estimator would return a {{Model}} from

[jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506285#comment-16506285 ] Li Yuanjian commented on SPARK-24499: - No problem, thanks for ping me, our pleasure. We'll collect

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506250#comment-16506250 ] Xiao Li commented on SPARK-24498: - Thank you! > Add JDK compiler for runtime codegen >

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506239#comment-16506239 ] Kazuaki Ishizaki commented on SPARK-24498: -- Hi [~smilegator] Definetely, I am interested in

[jira] [Resolved] (SPARK-24454) ml.image doesn't have __all__ explicitly defined

[ https://issues.apache.org/jira/browse/SPARK-24454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-24454. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21483

[jira] [Assigned] (SPARK-24454) ml.image doesn't have __all__ explicitly defined

[ https://issues.apache.org/jira/browse/SPARK-24454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-24454: - Assignee: Hyukjin Kwon > ml.image doesn't have __all__ explicitly defined >

[jira] [Assigned] (SPARK-24477) Import submodules under pyspark.ml by default

[ https://issues.apache.org/jira/browse/SPARK-24477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-24477: - Assignee: Hyukjin Kwon > Import submodules under pyspark.ml by default >

[jira] [Resolved] (SPARK-24477) Import submodules under pyspark.ml by default

[ https://issues.apache.org/jira/browse/SPARK-24477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-24477. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21483

[jira] [Commented] (SPARK-24492) Endless attempted task when TaskCommitDenied exception writing to S3A

[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506232#comment-16506232 ] Jiang Xingbo commented on SPARK-24492: -- It is possible that one task attempt acquired the

[jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506219#comment-16506219 ] Xiao Li commented on SPARK-24499: - Apache Spark is widely adopted in the production systems of Baidu.

[jira] [Created] (SPARK-24499) Documentation improvement of Spark core and SQL

Xiao Li created SPARK-24499: --- Summary: Documentation improvement of Spark core and SQL Key: SPARK-24499 URL: https://issues.apache.org/jira/browse/SPARK-24499 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24499: Component/s: Spark Core Documentation > Documentation improvement of Spark core and SQL

[jira] [Commented] (SPARK-24481) GeneratedIteratorForCodegenStage1 grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-24481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506183#comment-16506183 ] Marco Gaido commented on SPARK-24481: - Yes, because before SPARK-22520 code generation was disabled

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506159#comment-16506159 ] Xiao Li commented on SPARK-24498: - cc [~kiszk] Are you interested in this task? Could you investigate

[jira] [Created] (SPARK-24498) Add JDK compiler for runtime codegen

Xiao Li created SPARK-24498: --- Summary: Add JDK compiler for runtime codegen Key: SPARK-24498 URL: https://issues.apache.org/jira/browse/SPARK-24498 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-24191) Scala example code for Power Iteration Clustering in Spark ML examples

[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24191. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21248

[jira] [Resolved] (SPARK-24224) Java example code for Power Iteration Clustering in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-24224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24224. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21283

[jira] [Assigned] (SPARK-24224) Java example code for Power Iteration Clustering in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-24224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24224: - Assignee: shahid Target Version/s: (was: 2.4.0) Priority: Trivial

[jira] [Assigned] (SPARK-24191) Scala example code for Power Iteration Clustering in Spark ML examples

[ https://issues.apache.org/jira/browse/SPARK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24191: - Assignee: shahid Target Version/s: (was: 2.4.0) Priority: Trivial

[jira] [Created] (SPARK-24497) Support recursive SQL query

Yuming Wang created SPARK-24497: --- Summary: Support recursive SQL query Key: SPARK-24497 URL: https://issues.apache.org/jira/browse/SPARK-24497 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-23534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506023#comment-16506023 ] Saisai Shao commented on SPARK-23534: - Yes, it is a Hadoop 2.8+ issue, but we don't a 2.8 profile

[jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-23534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506021#comment-16506021 ] Steve Loughran commented on SPARK-23534: [~jerryshao] is that the HDFS token identifier thing?

[jira] [Commented] (SPARK-24492) Endless attempted task when TaskCommitDenied exception writing to S3A

[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506009#comment-16506009 ] Steve Loughran commented on SPARK-24492: the retry problem looks like something with the commit

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception writing to S3A

[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-24492: --- Summary: Endless attempted task when TaskCommitDenied exception writing to S3A (was:

[jira] [Updated] (SPARK-24476) java.net.SocketTimeoutException: Read timed out under jets3t while running the Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-24476: --- Priority: Minor (was: Major) > java.net.SocketTimeoutException: Read timed out under

[jira] [Updated] (SPARK-24476) java.net.SocketTimeoutException: Read timed out under jets3t while running the Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-24476: --- Summary: java.net.SocketTimeoutException: Read timed out under jets3t while running the

[jira] [Updated] (SPARK-24476) java.net.SocketTimeoutException: Read timed out under jets3t while running the Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-24476: --- Component/s: (was: Spark Core) Structured Streaming >

[jira] [Commented] (SPARK-24476) java.net.SocketTimeoutException: Read timed out Exception while running the Spark Structured Streaming in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506002#comment-16506002 ] Steve Loughran commented on SPARK-24476: Switch from s3n to the s3a connector, see if it goes

[jira] [Commented] (SPARK-24496) CLONE - JSON data source fails to infer floats as decimal when precision is bigger than 38 or scale is bigger than precision.

[ https://issues.apache.org/jira/browse/SPARK-24496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506001#comment-16506001 ] SHAILENDRA SHAHANE commented on SPARK-24496: This issue is still there . I tried to fetch

[jira] [Updated] (SPARK-24496) CLONE - JSON data source fails to infer floats as decimal when precision is bigger than 38 or scale is bigger than precision.

[ https://issues.apache.org/jira/browse/SPARK-24496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SHAILENDRA SHAHANE updated SPARK-24496: --- Attachment: SparkJiraIssue08062018.txt > CLONE - JSON data source fails to infer

[jira] [Created] (SPARK-24496) CLONE - JSON data source fails to infer floats as decimal when precision is bigger than 38 or scale is bigger than precision.

SHAILENDRA SHAHANE created SPARK-24496: -- Summary: CLONE - JSON data source fails to infer floats as decimal when precision is bigger than 38 or scale is bigger than precision. Key: SPARK-24496 URL:

[jira] [Created] (SPARK-24495) SortMergeJoin with duplicate keys wrong results

Bogdan Raducanu created SPARK-24495: --- Summary: SortMergeJoin with duplicate keys wrong results Key: SPARK-24495 URL: https://issues.apache.org/jira/browse/SPARK-24495 Project: Spark Issue

[jira] [Resolved] (SPARK-24119) Add interpreted execution to SortPrefix expression

[ https://issues.apache.org/jira/browse/SPARK-24119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24119. --- Resolution: Fixed Assignee: Bruce Robbins Fix Version/s: 2.4.0 >

[jira] [Created] (SPARK-24494) Give users possibility to skip own classes in SparkContext.getCallSite()

Florian Kaspar created SPARK-24494: -- Summary: Give users possibility to skip own classes in SparkContext.getCallSite() Key: SPARK-24494 URL: https://issues.apache.org/jira/browse/SPARK-24494

[jira] [Resolved] (SPARK-24487) Add support for RabbitMQ.

[ https://issues.apache.org/jira/browse/SPARK-24487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-24487. - Resolution: Won't Fix > Add support for RabbitMQ. > - > >

[jira] [Commented] (SPARK-24487) Add support for RabbitMQ.

[ https://issues.apache.org/jira/browse/SPARK-24487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505786#comment-16505786 ] Saisai Shao commented on SPARK-24487: - I'm sure Spark community will not merge this into Spark code

[jira] [Updated] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0

[ https://issues.apache.org/jira/browse/SPARK-23151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-23151: Issue Type: Sub-task (was: Dependency upgrade) Parent: SPARK-23534 > Provide a

[jira] [Commented] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0

[ https://issues.apache.org/jira/browse/SPARK-23151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505783#comment-16505783 ] Saisai Shao commented on SPARK-23151: - I will convert this as a subtask of SPARK-23534. > Provide a

[jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-23534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505771#comment-16505771 ] Saisai Shao commented on SPARK-23534: - Spark with Hadoop 3 will be failed in token renew for long

[jira] [Comment Edited] (SPARK-24493) Kerberos Ticket Renewal is failing in Hadoop 2.8+ and Hadoop 3

[ https://issues.apache.org/jira/browse/SPARK-24493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505768#comment-16505768 ] Saisai Shao edited comment on SPARK-24493 at 6/8/18 6:56 AM: - Adding more

[jira] [Commented] (SPARK-24493) Kerberos Ticket Renewal is failing in Hadoop 2.8+ and Hadoop 3

[ https://issues.apache.org/jira/browse/SPARK-24493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505768#comment-16505768 ] Saisai Shao commented on SPARK-24493: - Adding more background, the issue is happened when building

[jira] [Updated] (SPARK-24493) Kerberos Ticket Renewal is failing in Hadoop 2.8+ and Hadoop 3

[ https://issues.apache.org/jira/browse/SPARK-24493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24493: Summary: Kerberos Ticket Renewal is failing in Hadoop 2.8+ and Hadoop 3 (was: Kerberos Ticket

[jira] [Commented] (SPARK-24487) Add support for RabbitMQ.

[ https://issues.apache.org/jira/browse/SPARK-24487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505760#comment-16505760 ] Saisai Shao commented on SPARK-24487: - You can add it in your own package with DataSource API.

[jira] [Commented] (SPARK-24487) Add support for RabbitMQ.

[ https://issues.apache.org/jira/browse/SPARK-24487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505759#comment-16505759 ] Michał Jurkiewicz commented on SPARK-24487: --- I meant to add support for RabbitMQ for Spark

[jira] [Updated] (SPARK-24493) Kerberos Ticket Renewal is failing in long running Spark job

[ https://issues.apache.org/jira/browse/SPARK-24493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24493: Component/s: Spark Core > Kerberos Ticket Renewal is failing in long running Spark job >

[jira] [Updated] (SPARK-24493) Kerberos Ticket Renewal is failing in long running Spark job

[ https://issues.apache.org/jira/browse/SPARK-24493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24493: Component/s: (was: Spark Core) YARN > Kerberos Ticket Renewal is failing in

[jira] [Updated] (SPARK-24493) Kerberos Ticket Renewal is failing in long running Spark job

[ https://issues.apache.org/jira/browse/SPARK-24493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24493: Priority: Major (was: Blocker) > Kerberos Ticket Renewal is failing in long running Spark job >