[jira] [Resolved] (SPARK-8604) Parquet data source doesn't write summary file while doing appending

2015-06-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-8604. --- Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Issue resolved by pull request

[jira] [Commented] (SPARK-8587) Return cost and cluster index KMeansModel.predict

2015-06-25 Thread Sam Stoelinga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600825#comment-14600825 ] Sam Stoelinga commented on SPARK-8587: -- I also agree that this should have the same

[jira] [Created] (SPARK-8623) Some queries in spark-sql lead to NullPointerException when using Yarn

2015-06-25 Thread Bolke de Bruin (JIRA)
Bolke de Bruin created SPARK-8623: - Summary: Some queries in spark-sql lead to NullPointerException when using Yarn Key: SPARK-8623 URL: https://issues.apache.org/jira/browse/SPARK-8623 Project:

[jira] [Updated] (SPARK-8622) Spark 1.3.1 and 1.4.0 doesn't put executor working directory on executor classpath

2015-06-25 Thread Baswaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baswaraj updated SPARK-8622: Description: I ran into an issue that executor not able to pickup my configs/ function from my custom jar

[jira] [Updated] (SPARK-8622) Spark 1.3.1 and 1.4.0 doesn't put executor working directory on executor classpath

2015-06-25 Thread Baswaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baswaraj updated SPARK-8622: Description: I ran into an issue that executor not able to pickup my configs/ function from my custom jar

[jira] [Updated] (SPARK-8592) CoarseGrainedExecutorBackend: Cannot register with driver = NPE

2015-06-25 Thread Sjoerd Mulder (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sjoerd Mulder updated SPARK-8592: - Component/s: Scheduler CoarseGrainedExecutorBackend: Cannot register with driver = NPE

[jira] [Updated] (SPARK-8592) CoarseGrainedExecutorBackend: Cannot register with driver = NPE

2015-06-25 Thread Sjoerd Mulder (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sjoerd Mulder updated SPARK-8592: - Component/s: Spark Core CoarseGrainedExecutorBackend: Cannot register with driver = NPE

[jira] [Assigned] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8603: --- Assignee: Apache Spark In Windows,Not able to create a Spark context from R studio

[jira] [Commented] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600830#comment-14600830 ] Apache Spark commented on SPARK-8603: - User 'prakashpc' has created a pull request for

[jira] [Assigned] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8603: --- Assignee: (was: Apache Spark) In Windows,Not able to create a Spark context from R

[jira] [Commented] (SPARK-7977) Disallow println

2015-06-25 Thread Jon Alter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601827#comment-14601827 ] Jon Alter commented on SPARK-7977: -- Working on this. Disallow println

[jira] [Commented] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601900#comment-14601900 ] Apache Spark commented on SPARK-8567: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601899#comment-14601899 ] Apache Spark commented on SPARK-7287: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-06-25 Thread Shay Rojansky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601923#comment-14601923 ] Shay Rojansky commented on SPARK-7736: -- The problem is simply with the YARN status

[jira] [Assigned] (SPARK-8067) Add support for connecting to Hive 1.1

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8067: --- Assignee: (was: Apache Spark) Add support for connecting to Hive 1.1

[jira] [Assigned] (SPARK-8066) Add support for connecting to Hive 1.0 (0.14.1)

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8066: --- Assignee: Apache Spark Add support for connecting to Hive 1.0 (0.14.1)

[jira] [Commented] (SPARK-8067) Add support for connecting to Hive 1.1

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601789#comment-14601789 ] Apache Spark commented on SPARK-8067: - User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-8067) Add support for connecting to Hive 1.1

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8067: --- Assignee: Apache Spark Add support for connecting to Hive 1.1

[jira] [Commented] (SPARK-8066) Add support for connecting to Hive 1.0 (0.14.1)

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601788#comment-14601788 ] Apache Spark commented on SPARK-8066: - User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-8066) Add support for connecting to Hive 1.0 (0.14.1)

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8066: --- Assignee: (was: Apache Spark) Add support for connecting to Hive 1.0 (0.14.1)

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-06-25 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601914#comment-14601914 ] Neelesh Srinivas Salian commented on SPARK-7736: Could you add more

[jira] [Created] (SPARK-8643) local-cluster may not shutdown SparkContext gracefully

2015-06-25 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8643: --- Summary: local-cluster may not shutdown SparkContext gracefully Key: SPARK-8643 URL: https://issues.apache.org/jira/browse/SPARK-8643 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8643) local-cluster may not shutdown SparkContext gracefully

2015-06-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8643: Attachment: HiveSparkSubmitSuite (SPARK-8368).txt local-cluster may not shutdown SparkContext gracefully

[jira] [Created] (SPARK-8651) Lasso with SGD not Converging properly

2015-06-25 Thread Albert Azout (JIRA)
Albert Azout created SPARK-8651: --- Summary: Lasso with SGD not Converging properly Key: SPARK-8651 URL: https://issues.apache.org/jira/browse/SPARK-8651 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8372) History server shows incorrect information for application not started

2015-06-25 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602405#comment-14602405 ] Carson Wang commented on SPARK-8372: [~vanzin] The log path name may also end with an

[jira] [Updated] (SPARK-8620) cleanup CodeGenContext

2015-06-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8620: -- Assignee: Wenchen Fan cleanup CodeGenContext -- Key: SPARK-8620

[jira] [Resolved] (SPARK-8635) improve performance of CatalystTypeConverters

2015-06-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8635. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7018

[jira] [Commented] (SPARK-1859) Linear, Ridge and Lasso Regressions with SGD yield unexpected results

2015-06-25 Thread Albert Azout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602388#comment-14602388 ] Albert Azout commented on SPARK-1859: - Hi this is still an open issue for us. FYI. Any

[jira] [Commented] (SPARK-8588) Could not use concat with UDF in where clause

2015-06-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602401#comment-14602401 ] Wenchen Fan commented on SPARK-8588: cc [~marmbrus] this issue has already been fixed

[jira] [Resolved] (SPARK-8237) misc function: sha2

2015-06-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8237. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6934

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

2015-06-25 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602411#comment-14602411 ] Animesh Baranawal commented on SPARK-8636: -- So the condition should be : if (l ==

[jira] [Comment Edited] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

2015-06-25 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602411#comment-14602411 ] Animesh Baranawal edited comment on SPARK-8636 at 6/26/15 5:13 AM:

[jira] [Commented] (SPARK-8647) Potential issues with the constant hashCode

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602431#comment-14602431 ] Xiangrui Meng commented on SPARK-8647: -- All MatrixUDT instances are the same. So the

[jira] [Updated] (SPARK-8647) Potential issues with the constant hashCode

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8647: - Issue Type: Improvement (was: Bug) Potential issues with the constant hashCode

[jira] [Assigned] (SPARK-8625) Propagate user exceptions in tasks back to driver

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8625: --- Assignee: (was: Apache Spark) Propagate user exceptions in tasks back to driver

[jira] [Commented] (SPARK-8626) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601004#comment-14601004 ] Subhod Lagade commented on SPARK-8626: -- INFO] Compiling 1 source files to

[jira] [Commented] (SPARK-8627) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601023#comment-14601023 ] Subhod Lagade commented on SPARK-8627: -- can you help me in resolving this ??

[jira] [Commented] (SPARK-8627) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601024#comment-14601024 ] Subhod Lagade commented on SPARK-8627: -- can you help me in resolving this ??

[jira] [Issue Comment Deleted] (SPARK-8627) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subhod Lagade updated SPARK-8627: - Comment: was deleted (was: can you help me in resolving this ?? usersProducts is a RDD(int,int)

[jira] [Commented] (SPARK-5768) Spark UI Shows incorrect memory under Yarn

2015-06-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601082#comment-14601082 ] Kousuke Saruta commented on SPARK-5768: --- I can't change assignee field and I don't

[jira] [Created] (SPARK-8629) R code in SparkR

2015-06-25 Thread Arun (JIRA)
Arun created SPARK-8629: --- Summary: R code in SparkR Key: SPARK-8629 URL: https://issues.apache.org/jira/browse/SPARK-8629 Project: Spark Issue Type: Question Components: R

[jira] [Updated] (SPARK-8629) R code in SparkR

2015-06-25 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8629: Description: Data set: DC_City Dc_Code ItemNo Itemdescription dat Month

[jira] [Assigned] (SPARK-8625) Propagate user exceptions in tasks back to driver

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8625: --- Assignee: Apache Spark Propagate user exceptions in tasks back to driver

[jira] [Reopened] (SPARK-8627) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subhod Lagade reopened SPARK-8627: -- usersProducts is a RDD(int,int) it is still giving me error There is some issue with model.predict

[jira] [Resolved] (SPARK-5768) Spark UI Shows incorrect memory under Yarn

2015-06-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-5768. --- Resolution: Fixed Spark UI Shows incorrect memory under Yarn

[jira] [Commented] (SPARK-5768) Spark UI Shows incorrect memory under Yarn

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601098#comment-14601098 ] Sean Owen commented on SPARK-5768: -- I set it, and added you to the Committers role, which

[jira] [Updated] (SPARK-8629) R code in SparkR

2015-06-25 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8629: Description: Data set: DC_City Dc_Code ItemNo Itemdescription dat Month

[jira] [Updated] (SPARK-8629) R code in SparkR

2015-06-25 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8629: Description: Data set: DC_City Dc_Code ItemNo Itemdescription dat Month

[jira] [Updated] (SPARK-8624) DataFrameReader doesn't respect MERGE_SCHEMA setting for Parquet

2015-06-25 Thread Rex Xiong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rex Xiong updated SPARK-8624: - Description: In 1.4.0, parquet is read by DataFrameReader.parquet, when creating ParquetRelation2

[jira] [Updated] (SPARK-8628) Race condition in AbstractSparkSQLParser.parse

2015-06-25 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santiago M. Mola updated SPARK-8628: Description: SPARK-5009 introduced the following code in AbstractSparkSQLParser: {code}

[jira] [Commented] (SPARK-8627) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601019#comment-14601019 ] Subhod Lagade commented on SPARK-8627: -- can you help me in resolving this ??

[jira] [Closed] (SPARK-5768) Spark UI Shows incorrect memory under Yarn

2015-06-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta closed SPARK-5768. - Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Target

[jira] [Commented] (SPARK-8628) Race condition in AbstractSparkSQLParser.parse

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601086#comment-14601086 ] Apache Spark commented on SPARK-8628: - User 'vinodkc' has created a pull request for

[jira] [Assigned] (SPARK-8628) Race condition in AbstractSparkSQLParser.parse

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8628: --- Assignee: (was: Apache Spark) Race condition in AbstractSparkSQLParser.parse

[jira] [Assigned] (SPARK-8628) Race condition in AbstractSparkSQLParser.parse

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8628: --- Assignee: Apache Spark Race condition in AbstractSparkSQLParser.parse

[jira] [Created] (SPARK-8631) MLlib predict function error

2015-06-25 Thread Subhod Lagade (JIRA)
Subhod Lagade created SPARK-8631: Summary: MLlib predict function error Key: SPARK-8631 URL: https://issues.apache.org/jira/browse/SPARK-8631 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8625) Propagate user exceptions in tasks back to driver

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600997#comment-14600997 ] Apache Spark commented on SPARK-8625: - User 'tomwhite' has created a pull request for

[jira] [Commented] (SPARK-8626) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601002#comment-14601002 ] Subhod Lagade commented on SPARK-8626: -- /** * Created by subhod lagade on 25/06/15.

[jira] [Reopened] (SPARK-5768) Spark UI Shows incorrect memory under Yarn

2015-06-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reopened SPARK-5768: --- Spark UI Shows incorrect memory under Yarn --

[jira] [Assigned] (SPARK-8630) Prevent from checkpointing QueueInputDStream

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8630: --- Assignee: Apache Spark Prevent from checkpointing QueueInputDStream

[jira] [Updated] (SPARK-8629) R code in SparkR

2015-06-25 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8629: Description: Data set: DC_City Dc_Code ItemNo Itemdescription dat Month

[jira] [Resolved] (SPARK-8574) org/apache/spark/unsafe doesn't honor the java source/target versions

2015-06-25 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-8574. -- Resolution: Fixed Fix Version/s: 1.4.1 org/apache/spark/unsafe doesn't honor the java

[jira] [Resolved] (SPARK-8629) R code in SparkR

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8629. -- Resolution: Invalid R code in SparkR Key: SPARK-8629

[jira] [Created] (SPARK-8626) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
Subhod Lagade created SPARK-8626: Summary: ALS model predict error Key: SPARK-8626 URL: https://issues.apache.org/jira/browse/SPARK-8626 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-8627) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
Subhod Lagade created SPARK-8627: Summary: ALS model predict error Key: SPARK-8627 URL: https://issues.apache.org/jira/browse/SPARK-8627 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-8621) crosstab exception when one of the value is empty

2015-06-25 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601008#comment-14601008 ] Animesh Baranawal commented on SPARK-8621: -- How about enclosing the column names

[jira] [Issue Comment Deleted] (SPARK-8627) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subhod Lagade updated SPARK-8627: - Comment: was deleted (was: usersProducts is a RDD(int,int) it is still giving me error There is

[jira] [Created] (SPARK-8625) Propagate user exceptions in tasks back to driver

2015-06-25 Thread Tom White (JIRA)
Tom White created SPARK-8625: Summary: Propagate user exceptions in tasks back to driver Key: SPARK-8625 URL: https://issues.apache.org/jira/browse/SPARK-8625 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-8627) ALS model predict error

2015-06-25 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subhod Lagade updated SPARK-8627: - Comment: was deleted (was: can you help me in resolving this ?? usersProducts is a RDD(int,int)

[jira] [Updated] (SPARK-5768) Spark UI Shows incorrect memory under Yarn

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5768: - Assignee: Rekha Joshi Spark UI Shows incorrect memory under Yarn

[jira] [Updated] (SPARK-8629) R code in SparkR

2015-06-25 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8629: Description: Data set: DC_City Dc_Code ItemNo Itemdescription dat Month

[jira] [Commented] (SPARK-8628) Race condition in AbstractSparkSQLParser.parse

2015-06-25 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601012#comment-14601012 ] Santiago M. Mola commented on SPARK-8628: - Here is an example of failure with

[jira] [Resolved] (SPARK-8626) ALS model predict error

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8626. -- Resolution: Duplicate ... and you opened it twice. Please read

[jira] [Resolved] (SPARK-8627) ALS model predict error

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8627. -- Resolution: Invalid This is a compile error in your own code. ALS model predict error

[jira] [Created] (SPARK-8628) Race condition in AbstractSparkSQLParser.parse

2015-06-25 Thread Santiago M. Mola (JIRA)
Santiago M. Mola created SPARK-8628: --- Summary: Race condition in AbstractSparkSQLParser.parse Key: SPARK-8628 URL: https://issues.apache.org/jira/browse/SPARK-8628 Project: Spark Issue

[jira] [Updated] (SPARK-8629) R code in SparkR

2015-06-25 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8629: Description: Data set: DC_City Dc_Code ItemNo Itemdescription dat Month

[jira] [Created] (SPARK-8630) Prevent from checkpointing QueueInputDStream

2015-06-25 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8630: --- Summary: Prevent from checkpointing QueueInputDStream Key: SPARK-8630 URL: https://issues.apache.org/jira/browse/SPARK-8630 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-25 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601898#comment-14601898 ] Neelesh Srinivas Salian commented on SPARK-4352: Checking to see if this

[jira] [Commented] (SPARK-8622) Spark 1.3.1 and 1.4.0 doesn't put executor working directory on executor classpath

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600942#comment-14600942 ] Sean Owen commented on SPARK-8622: -- I don't think that is intended or even reasonable

[jira] [Commented] (SPARK-8615) sql programming guide recommends deprecated code

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600945#comment-14600945 ] Sean Owen commented on SPARK-8615: -- Sure, open a PR? sql programming guide recommends

[jira] [Updated] (SPARK-8642) Ungraceful failure when yarn client is not configured.

2015-06-25 Thread Juliet Hougland (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliet Hougland updated SPARK-8642: --- Attachment: yarnretries.log Log file from failed bc of misconfiguration spakr job. counting

[jira] [Created] (SPARK-8642) Ungraceful failure when yarn client is not configured.

2015-06-25 Thread Juliet Hougland (JIRA)
Juliet Hougland created SPARK-8642: -- Summary: Ungraceful failure when yarn client is not configured. Key: SPARK-8642 URL: https://issues.apache.org/jira/browse/SPARK-8642 Project: Spark

[jira] [Created] (SPARK-8644) SparkException thrown due to Executor exceptions should include caller site in stack trace

2015-06-25 Thread Aaron Davidson (JIRA)
Aaron Davidson created SPARK-8644: - Summary: SparkException thrown due to Executor exceptions should include caller site in stack trace Key: SPARK-8644 URL: https://issues.apache.org/jira/browse/SPARK-8644

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

2015-06-25 Thread biao luo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601273#comment-14601273 ] biao luo commented on SPARK-2883: - peopleSchemaRDD.saveAsOrcFile(people.orc) val orcFile =

[jira] [Updated] (SPARK-8546) PMML export for Naive Bayes

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8546: - Labels: (was: starter) PMML export for Naive Bayes ---

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Created] (SPARK-8634) Fix flaky test StreamingListenerSuite receiver info reporting

2015-06-25 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8634: --- Summary: Fix flaky test StreamingListenerSuite receiver info reporting Key: SPARK-8634 URL: https://issues.apache.org/jira/browse/SPARK-8634 Project: Spark

[jira] [Resolved] (SPARK-8631) MLlib predict function error

2015-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8631. -- Resolution: Invalid This is the third time you have opened this. As I explained this is not a valid

[jira] [Commented] (SPARK-7337) FPGrowth algo throwing OutOfMemoryError

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601348#comment-14601348 ] Xiangrui Meng commented on SPARK-7337: -- How large is the `minSupport`? The number of

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Updated] (SPARK-6805) ML Pipeline API in SparkR

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Assignee: (was: Xiangrui Meng) ML Pipeline API in SparkR -

[jira] [Assigned] (SPARK-8635) improve performance of CatalystTypeConverters

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8635: --- Assignee: (was: Apache Spark) improve performance of CatalystTypeConverters

[jira] [Assigned] (SPARK-8635) improve performance of CatalystTypeConverters

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8635: --- Assignee: Apache Spark improve performance of CatalystTypeConverters

[jira] [Commented] (SPARK-8635) improve performance of CatalystTypeConverters

2015-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601375#comment-14601375 ] Apache Spark commented on SPARK-8635: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-06-25 Thread Peter Prettenhofer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601385#comment-14601385 ] Peter Prettenhofer commented on SPARK-5133: --- [~josephkb] definitely - will start

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

2015-06-25 Thread biao luo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601275#comment-14601275 ] biao luo commented on SPARK-2883: - peopleSchemaRDD.saveAsOrcFile(people.orc) val orcFile =

[jira] [Updated] (SPARK-4127) Streaming Linear Regression- Python bindings

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4127: - Target Version/s: 1.5.0 Streaming Linear Regression- Python bindings

[jira] [Updated] (SPARK-4127) Streaming Linear Regression- Python bindings

2015-06-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4127: - Assignee: Manoj Kumar Streaming Linear Regression- Python bindings

[jira] [Commented] (SPARK-8632) Poor Python UDF performance because of RDD caching

2015-06-25 Thread Justin Uang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601288#comment-14601288 ] Justin Uang commented on SPARK-8632: [~davies], my current plan is to switch to a

  1   2   3   >