[jira] [Assigned] (SPARK-8374) Job frequently hangs after YARN preemption

[ https://issues.apache.org/jira/browse/SPARK-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8374: --- Assignee: (was: Apache Spark) Job frequently hangs after YARN preemption

[jira] [Assigned] (SPARK-8374) Job frequently hangs after YARN preemption

[ https://issues.apache.org/jira/browse/SPARK-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8374: --- Assignee: Apache Spark Job frequently hangs after YARN preemption

[jira] [Assigned] (SPARK-8704) Add additional methods to wrappers in ml.pyspark.feature

[ https://issues.apache.org/jira/browse/SPARK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8704: --- Assignee: Apache Spark Add additional methods to wrappers in ml.pyspark.feature

[jira] [Assigned] (SPARK-8704) Add additional methods to wrappers in ml.pyspark.feature

[ https://issues.apache.org/jira/browse/SPARK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8704: --- Assignee: (was: Apache Spark) Add additional methods to wrappers in ml.pyspark.feature

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605588#comment-14605588 ] Juan Rodríguez Hortalá commented on SPARK-8337: --- Hi [~jerryshao], That is

[jira] [Commented] (SPARK-6599) Improve reliability and usability of Kinesis-based Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605591#comment-14605591 ] Przemyslaw Pastuszka commented on SPARK-6599: - Is there any work being done on

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605657#comment-14605657 ] Lars Francke commented on SPARK-2447: - Hey Ted et. al, thanks for the work on this.

[jira] [Assigned] (SPARK-8693) profiles and goals are not printed in a nice way

[ https://issues.apache.org/jira/browse/SPARK-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8693: --- Assignee: (was: Apache Spark) profiles and goals are not printed in a nice way

[jira] [Assigned] (SPARK-8693) profiles and goals are not printed in a nice way

[ https://issues.apache.org/jira/browse/SPARK-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8693: --- Assignee: Apache Spark profiles and goals are not printed in a nice way

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605557#comment-14605557 ] Santiago M. Mola commented on SPARK-8636: - [~davies], [~animeshbaranawal] In SQL,

[jira] [Commented] (SPARK-8693) profiles and goals are not printed in a nice way

[ https://issues.apache.org/jira/browse/SPARK-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605606#comment-14605606 ] Apache Spark commented on SPARK-8693: - User 'brennonyork' has created a pull request

[jira] [Commented] (SPARK-8704) Add additional methods to wrappers in ml.pyspark.feature

[ https://issues.apache.org/jira/browse/SPARK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605611#comment-14605611 ] Apache Spark commented on SPARK-8704: - User 'MechCoder' has created a pull request for

[jira] [Closed] (SPARK-8666) checkpointing does not take advantage of persisted/cached RDDs

[ https://issues.apache.org/jira/browse/SPARK-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glenn Strycker closed SPARK-8666. - checkpointing does not take advantage of persisted/cached RDDs

[jira] [Created] (SPARK-8705) Javascript error in the web console when `totalExecutionTime` of a task is 0

Shixiong Zhu created SPARK-8705: --- Summary: Javascript error in the web console when `totalExecutionTime` of a task is 0 Key: SPARK-8705 URL: https://issues.apache.org/jira/browse/SPARK-8705 Project:

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605663#comment-14605663 ] Ted Malaska commented on SPARK-2447: Yeah, I have talked a lot with TD (Spark), Job

[jira] [Created] (SPARK-8704) Add additional methods to wrappers in ml.pyspark.feature

Manoj Kumar created SPARK-8704: -- Summary: Add additional methods to wrappers in ml.pyspark.feature Key: SPARK-8704 URL: https://issues.apache.org/jira/browse/SPARK-8704 Project: Spark Issue

[jira] [Commented] (SPARK-8587) Return cost and cluster index KMeansModel.predict

[ https://issues.apache.org/jira/browse/SPARK-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605639#comment-14605639 ] Rakesh Chalasani commented on SPARK-8587: - Hi Sam, computeCost now returns the

[jira] [Commented] (SPARK-8705) Javascript error in the web console when `totalExecutionTime` of a task is 0

[ https://issues.apache.org/jira/browse/SPARK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605646#comment-14605646 ] Shixiong Zhu commented on SPARK-8705: - A simple fix is don't add {{rect}} s to {{svg}}

[jira] [Commented] (SPARK-8660) Update comments that contain R statements in ml.logisticRegressionSuite

[ https://issues.apache.org/jira/browse/SPARK-8660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605481#comment-14605481 ] somil deshmukh commented on SPARK-8660: --- In LogisticRegressionSuite.class ,I will

[jira] [Created] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

yuhao yang created SPARK-8703: - Summary: Add CountVectorizer as a ml transformer to convert document to words count vector Key: SPARK-8703 URL: https://issues.apache.org/jira/browse/SPARK-8703 Project:

[jira] [Created] (SPARK-8702) Avoid massive concating strings in Javascript

Shixiong Zhu created SPARK-8702: --- Summary: Avoid massive concating strings in Javascript Key: SPARK-8702 URL: https://issues.apache.org/jira/browse/SPARK-8702 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7398) Add back-pressure to Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iulian Dragos updated SPARK-7398: - Description: Spark Streaming has trouble dealing with situations where batch processing time

[jira] [Commented] (SPARK-7398) Add back-pressure to Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605338#comment-14605338 ] Iulian Dragos commented on SPARK-7398: -- [~tdas] here it is:

[jira] [Commented] (SPARK-8374) Job frequently hangs after YARN preemption

[ https://issues.apache.org/jira/browse/SPARK-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605457#comment-14605457 ] Apache Spark commented on SPARK-8374: - User 'xuchenCN' has created a pull request for

[jira] [Commented] (SPARK-8310) Spark EC2 branch in 1.4 is wrong

[ https://issues.apache.org/jira/browse/SPARK-8310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605411#comment-14605411 ] Daniel Darabos commented on SPARK-8310: --- It's an easy mistake to make, and one of

[jira] [Commented] (SPARK-8374) Job frequently hangs after YARN preemption

[ https://issues.apache.org/jira/browse/SPARK-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605422#comment-14605422 ] Xu Chen commented on SPARK-8374: Seems AM didn't add ContainerRequest after resource has

[jira] [Commented] (SPARK-8661) Update comments that contain R statements in ml.LinearRegressionSuite

[ https://issues.apache.org/jira/browse/SPARK-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605483#comment-14605483 ] somil deshmukh commented on SPARK-8661: --- In LinearRegressionSuite.class,I can

[jira] [Commented] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

[ https://issues.apache.org/jira/browse/SPARK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605503#comment-14605503 ] Apache Spark commented on SPARK-8703: - User 'hhbyyh' has created a pull request for

[jira] [Updated] (SPARK-8702) Avoid massive concating strings in Javascript

[ https://issues.apache.org/jira/browse/SPARK-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-8702: -- Assignee: Shixiong Zhu Avoid massive concating strings in Javascript

[jira] [Commented] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605712#comment-14605712 ] Ángel Álvarez commented on SPARK-8385: -- A simple WordCount test worked fine in my

[jira] [Commented] (SPARK-7894) Graph Union Operator

[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605739#comment-14605739 ] Arnab commented on SPARK-7894: -- Short description of changes: Introduced union functionality

[jira] [Resolved] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8385. -- Resolution: Cannot Reproduce java.lang.UnsupportedOperationException: Not implemented by the TFS

[jira] [Comment Edited] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605744#comment-14605744 ] Ángel Álvarez edited comment on SPARK-8385 at 6/29/15 3:15 PM:

[jira] [Commented] (SPARK-8680) PropagateTypes is very slow when there are lots of columns

[ https://issues.apache.org/jira/browse/SPARK-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605747#comment-14605747 ] Apache Spark commented on SPARK-8680: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-8680) PropagateTypes is very slow when there are lots of columns

[ https://issues.apache.org/jira/browse/SPARK-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8680: --- Assignee: (was: Apache Spark) PropagateTypes is very slow when there are lots of

[jira] [Assigned] (SPARK-8680) PropagateTypes is very slow when there are lots of columns

[ https://issues.apache.org/jira/browse/SPARK-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8680: --- Assignee: Apache Spark PropagateTypes is very slow when there are lots of columns

[jira] [Commented] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605744#comment-14605744 ] Ángel Álvarez commented on SPARK-8385: -- I could finally reproduce this same error in

[jira] [Commented] (SPARK-8599) Use a Random operator to handle Random distribution generating expressions

[ https://issues.apache.org/jira/browse/SPARK-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605777#comment-14605777 ] Burak Yavuz commented on SPARK-8599: It would be great if it works for this case as

[jira] [Resolved] (SPARK-8702) Avoid massive concating strings in Javascript

[ https://issues.apache.org/jira/browse/SPARK-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-8702. --- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 Avoid

[jira] [Created] (SPARK-8706) Implement Pylint / Prospector checks for PySpark

Josh Rosen created SPARK-8706: - Summary: Implement Pylint / Prospector checks for PySpark Key: SPARK-8706 URL: https://issues.apache.org/jira/browse/SPARK-8706 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

[ https://issues.apache.org/jira/browse/SPARK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605902#comment-14605902 ] Liang-Chi Hsieh commented on SPARK-8703: Does

[jira] [Updated] (SPARK-8693) profiles and goals are not printed in a nice way

[ https://issues.apache.org/jira/browse/SPARK-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8693: -- Assignee: Brennon York profiles and goals are not printed in a nice way

[jira] [Updated] (SPARK-8686) DataFrame should support `where` with expression represented by String

[ https://issues.apache.org/jira/browse/SPARK-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8686: - Assignee: Kousuke Saruta DataFrame should support `where` with expression represented by String

[jira] [Updated] (SPARK-8554) Add the SparkR document files to `.rat-excludes` for `./dev/check-license`

[ https://issues.apache.org/jira/browse/SPARK-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8554: -- Assignee: Yu Ishikawa Add the SparkR document files to `.rat-excludes` for `./dev/check-license`

[jira] [Resolved] (SPARK-8554) Add the SparkR document files to `.rat-excludes` for `./dev/check-license`

[ https://issues.apache.org/jira/browse/SPARK-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8554. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6947

[jira] [Assigned] (SPARK-8705) Javascript error in the web console when `totalExecutionTime` of a task is 0

[ https://issues.apache.org/jira/browse/SPARK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8705: --- Assignee: (was: Apache Spark) Javascript error in the web console when

[jira] [Commented] (SPARK-8705) Javascript error in the web console when `totalExecutionTime` of a task is 0

[ https://issues.apache.org/jira/browse/SPARK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605870#comment-14605870 ] Apache Spark commented on SPARK-8705: - User 'zsxwing' has created a pull request for

[jira] [Updated] (SPARK-8693) profiles and goals are not printed in a nice way

[ https://issues.apache.org/jira/browse/SPARK-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8693: -- Affects Version/s: 1.5.0 profiles and goals are not printed in a nice way

[jira] [Resolved] (SPARK-8693) profiles and goals are not printed in a nice way

[ https://issues.apache.org/jira/browse/SPARK-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8693. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7085

[jira] [Commented] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605822#comment-14605822 ] Nicholas Chammas commented on SPARK-8670: - Not sure. Does Scala offer the same

[jira] [Assigned] (SPARK-8705) Javascript error in the web console when `totalExecutionTime` of a task is 0

[ https://issues.apache.org/jira/browse/SPARK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8705: --- Assignee: Apache Spark Javascript error in the web console when `totalExecutionTime` of a

[jira] [Updated] (SPARK-8707) RDD#toDebugString fails if any cached RDD has invalid partitions

[ https://issues.apache.org/jira/browse/SPARK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson updated SPARK-8707: -- Summary: RDD#toDebugString fails if any cached RDD has invalid partitions (was:

[jira] [Updated] (SPARK-8707) RDD#toDebugString fails if any cached RDD has invalid partitions

[ https://issues.apache.org/jira/browse/SPARK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson updated SPARK-8707: -- Description: Repro: {code} sc.textFile(/ThisFileDoesNotExist).cache() sc.parallelize(0 until

[jira] [Created] (SPARK-8707) RDD#toDebugString fails if any cached RDD is invalid

Aaron Davidson created SPARK-8707: - Summary: RDD#toDebugString fails if any cached RDD is invalid Key: SPARK-8707 URL: https://issues.apache.org/jira/browse/SPARK-8707 Project: Spark Issue

[jira] [Created] (SPARK-8708) MatrixFactorizationModel.predictAll() populates single partition only

Antony Mayi created SPARK-8708: -- Summary: MatrixFactorizationModel.predictAll() populates single partition only Key: SPARK-8708 URL: https://issues.apache.org/jira/browse/SPARK-8708 Project: Spark

[jira] [Commented] (SPARK-8372) History server shows incorrect information for application not started

[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605996#comment-14605996 ] Andrew Or commented on SPARK-8372: -- OK, per discussion on the #6827 I reverted this.

[jira] [Reopened] (SPARK-8372) History server shows incorrect information for application not started

[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-8372: -- Assignee: Marcelo Vanzin (was: Carson Wang) History server shows incorrect information for

[jira] [Updated] (SPARK-8705) Javascript error in the web console when `totalExecutionTime` of a task is 0

[ https://issues.apache.org/jira/browse/SPARK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8705: - Affects Version/s: 1.4.0 Javascript error in the web console when `totalExecutionTime` of a task is 0

[jira] [Updated] (SPARK-8705) Javascript error in the web console when `totalExecutionTime` of a task is 0

[ https://issues.apache.org/jira/browse/SPARK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8705: - Target Version/s: 1.5.0, 1.4.2 Javascript error in the web console when `totalExecutionTime` of a task

[jira] [Commented] (SPARK-8622) Spark 1.3.1 and 1.4.0 doesn't put executor working directory on executor classpath

[ https://issues.apache.org/jira/browse/SPARK-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605921#comment-14605921 ] Baswaraj commented on SPARK-8622: - Thats what i mean. Jars specified by --jars are not put

[jira] [Commented] (SPARK-3692) RBF Kernel implementation to SVM

[ https://issues.apache.org/jira/browse/SPARK-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605930#comment-14605930 ] Seth Hendrickson commented on SPARK-3692: - It looks like this JIRA will be taken

[jira] [Updated] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Fix Version/s: 1.4.1 Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[jira] [Commented] (SPARK-8410) Hive VersionsSuite RuntimeException

[ https://issues.apache.org/jira/browse/SPARK-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605977#comment-14605977 ] Burak Yavuz commented on SPARK-8410: Hi Joe, Is it possible to delete those files

[jira] [Updated] (SPARK-8372) History server shows incorrect information for application not started

[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8372: - Fix Version/s: (was: 1.4.1) (was: 1.5.0) History server shows incorrect

[jira] [Closed] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8567. Resolution: Fixed Fix Version/s: 1.5.0 Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[jira] [Updated] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Target Version/s: 1.4.1, 1.5.0 (was: 1.5.0) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[jira] [Commented] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605968#comment-14605968 ] Burak Yavuz commented on SPARK-8475: ping. I think you can go ahead with a PR for

[jira] [Commented] (SPARK-701) Wrong SPARK_MEM setting with different EC2 master and worker machine types

[ https://issues.apache.org/jira/browse/SPARK-701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606622#comment-14606622 ] Shivaram Venkataraman commented on SPARK-701: - Yeah so SPARK_MEM used to be

[jira] [Commented] (SPARK-8588) Could not use concat with UDF in where clause

[ https://issues.apache.org/jira/browse/SPARK-8588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606650#comment-14606650 ] Apache Spark commented on SPARK-8588: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-8716) Remove executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606649#comment-14606649 ] Marcelo Vanzin commented on SPARK-8716: --- bq. AFAIK this feature doesn't work under

[jira] [Updated] (SPARK-8716) Remove executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8716: - Priority: Major (was: Minor) Remove executor shared cache feature

[jira] [Updated] (SPARK-8669) Parquet 1.7 files that store binary enums crash when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8669: -- Target Version/s: 1.5.0 Parquet 1.7 files that store binary enums crash when inferring schema

[jira] [Closed] (SPARK-4069) [SPARK-YARN] ApplicationMaster should release all executors' containers before unregistering itself from Yarn RM

[ https://issues.apache.org/jira/browse/SPARK-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4069. Resolution: Won't Fix [SPARK-YARN] ApplicationMaster should release all executors' containers before

[jira] [Commented] (SPARK-4069) [SPARK-YARN] ApplicationMaster should release all executors' containers before unregistering itself from Yarn RM

[ https://issues.apache.org/jira/browse/SPARK-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606701#comment-14606701 ] Andrew Or commented on SPARK-4069: -- Fixed in YARN-3415. [SPARK-YARN] ApplicationMaster

[jira] [Closed] (SPARK-8634) Fix flaky test StreamingListenerSuite receiver info reporting

[ https://issues.apache.org/jira/browse/SPARK-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8634. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.4.2

[jira] [Updated] (SPARK-8119) HeartbeatReceiver should not call sc.killExecutor

[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8119: - Summary: HeartbeatReceiver should not call sc.killExecutor (was: Spark will set total executor when some

[jira] [Commented] (SPARK-8374) Job frequently hangs after YARN preemption

[ https://issues.apache.org/jira/browse/SPARK-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605425#comment-14605425 ] Shay Rojansky commented on SPARK-8374: -- Thanks for your comment and sure, I can help

[jira] [Assigned] (SPARK-8702) Avoid massive concating strings in Javascript

[ https://issues.apache.org/jira/browse/SPARK-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8702: --- Assignee: Apache Spark Avoid massive concating strings in Javascript

[jira] [Assigned] (SPARK-8702) Avoid massive concating strings in Javascript

[ https://issues.apache.org/jira/browse/SPARK-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8702: --- Assignee: (was: Apache Spark) Avoid massive concating strings in Javascript

[jira] [Commented] (SPARK-8702) Avoid massive concating strings in Javascript

[ https://issues.apache.org/jira/browse/SPARK-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605452#comment-14605452 ] Apache Spark commented on SPARK-8702: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

[ https://issues.apache.org/jira/browse/SPARK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8703: --- Assignee: Apache Spark Add CountVectorizer as a ml transformer to convert document to words

[jira] [Updated] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

[ https://issues.apache.org/jira/browse/SPARK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-8703: -- Description: Converts a text document to a sparse vector of token counts. Similar to

[jira] [Assigned] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

[ https://issues.apache.org/jira/browse/SPARK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8703: --- Assignee: (was: Apache Spark) Add CountVectorizer as a ml transformer to convert

[jira] [Resolved] (SPARK-8235) misc function: sha1 / sha

[ https://issues.apache.org/jira/browse/SPARK-8235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8235. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6963

[jira] [Commented] (SPARK-6830) Memoize frequently queried vals in RDD, such as numPartitions, count etc.

[ https://issues.apache.org/jira/browse/SPARK-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606157#comment-14606157 ] Sean Owen commented on SPARK-6830: -- Is this valid? For example, consider an RDD from a

[jira] [Comment Edited] (SPARK-5571) LDA should handle text as well

[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606161#comment-14606161 ] Alok Singh edited comment on SPARK-5571 at 6/29/15 7:00 PM: I

[jira] [Commented] (SPARK-5571) LDA should handle text as well

[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606159#comment-14606159 ] Alok Singh commented on SPARK-5571: --- Since there is already Tokenizer class. We can

[jira] [Commented] (SPARK-5571) LDA should handle text as well

[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606161#comment-14606161 ] Alok Singh commented on SPARK-5571: --- I would like to work to it if everyone is ok .

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606166#comment-14606166 ] Ted Malaska commented on SPARK-2447: Hey Andrew,

[jira] [Commented] (SPARK-6129) Add a section in user guide for model evaluation

[ https://issues.apache.org/jira/browse/SPARK-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606165#comment-14606165 ] Seth Hendrickson commented on SPARK-6129: - If no one else has started on this, I'd

[jira] [Resolved] (SPARK-8528) Add applicationId to SparkContext object in pyspark

[ https://issues.apache.org/jira/browse/SPARK-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8528. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6936

[jira] [Updated] (SPARK-8528) Add applicationId to SparkContext object in pyspark

[ https://issues.apache.org/jira/browse/SPARK-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8528: -- Assignee: Vladimir Vladimirov Add applicationId to SparkContext object in pyspark

[jira] [Commented] (SPARK-6830) Memoize frequently queried vals in RDD, such as numPartitions, count etc.

[ https://issues.apache.org/jira/browse/SPARK-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606176#comment-14606176 ] Perinkulam I Ganesh commented on SPARK-6830: This thought crossed our mind as

[jira] [Commented] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606178#comment-14606178 ] Nicholas Chammas commented on SPARK-8670: - FYI: `df.stats.age` works neither on

[jira] [Commented] (SPARK-8621) crosstab exception when one of the value is empty

[ https://issues.apache.org/jira/browse/SPARK-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606186#comment-14606186 ] Michael Armbrust commented on SPARK-8621: - Will you ever want to access the

[jira] [Created] (SPARK-8709) Exclude hadoop-client's mockito-all dependency to fix test compilation break for Hadoop 2

Josh Rosen created SPARK-8709: - Summary: Exclude hadoop-client's mockito-all dependency to fix test compilation break for Hadoop 2 Key: SPARK-8709 URL: https://issues.apache.org/jira/browse/SPARK-8709

[jira] [Commented] (SPARK-8668) expr function to convert SQL expression into a Column

[ https://issues.apache.org/jira/browse/SPARK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606067#comment-14606067 ] Tarek Auel commented on SPARK-8668: --- Hi, just to get it right: selectExpr of the

[jira] [Commented] (SPARK-8668) expr function to convert SQL expression into a Column

[ https://issues.apache.org/jira/browse/SPARK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606073#comment-14606073 ] Reynold Xin commented on SPARK-8668: This is not about selectExpr, but adding a new

[jira] [Assigned] (SPARK-8410) Hive VersionsSuite RuntimeException

[ https://issues.apache.org/jira/browse/SPARK-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8410: --- Assignee: Burak Yavuz (was: Apache Spark) Hive VersionsSuite RuntimeException

[jira] [Assigned] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8475: --- Assignee: (was: Apache Spark) SparkSubmit with Ivy jars is very slow to load with no

  1   2   3   4   >