[jira] [Resolved] (SPARK-5536) Wrap the old ALS to use the new ALS implementation.

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5536. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4321 [https://githu

[jira] [Commented] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302895#comment-14302895 ] Josh Rosen commented on SPARK-5414: --- Yeah, on second thought I think we're fine to leave

[jira] [Updated] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5414: -- Target Version/s: 1.3.0 (was: 1.3.0, 1.2.1) > Add SparkListener implementation that allows users to rec

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302888#comment-14302888 ] Jacek Lewandowski commented on SPARK-5548: -- This test passes on my laptop (OSX).

[jira] [Commented] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302885#comment-14302885 ] Reynold Xin commented on SPARK-5414: Actually this doesn't look like something we need

[jira] [Resolved] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5414. Resolution: Fixed Fix Version/s: 1.3.0 > Add SparkListener implementation that allows users t

[jira] [Commented] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302883#comment-14302883 ] Reynold Xin commented on SPARK-5414: [~joshrosen] Did you submit a separate thing for

[jira] [Updated] (SPARK-5381) Publish org.apache.spark/spark-hive-thriftserver_2.10 artifact

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep updated SPARK-5381: --- Affects Version/s: 1.3.0 > Publish org.apache.spark/spark-hive-thriftserver_2.10 artifact > --

[jira] [Commented] (SPARK-5501) Write support for the data source API

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302880#comment-14302880 ] Reynold Xin commented on SPARK-5501: BTW would be great to paste the API in this JIRA

[jira] [Closed] (SPARK-1983) Expose private `inferSchema` method in SQLContext for Scala and Java API

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep closed SPARK-1983. -- Resolution: Fixed Available in new versions. > Expose private `inferSchema` method in SQLContext for Scala and

[jira] [Resolved] (SPARK-5501) Write support for the data source API

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5501. Resolution: Fixed Fix Version/s: 1.3.0 > Write support for the data source API >

[jira] [Updated] (SPARK-5552) Automated data science AMI creation and data science cluster deployment on EC2

2015-02-02 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-5552: --- Summary: Automated data science AMI creation and data science cluster deployment on EC2 (was:

[jira] [Resolved] (SPARK-5012) Python API for Gaussian Mixture Model

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5012. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4059 [https://githu

[jira] [Created] (SPARK-5552) Automated data science AMIs creation and cluster deployment on EC2

2015-02-02 Thread Florian Verhein (JIRA)
Florian Verhein created SPARK-5552: -- Summary: Automated data science AMIs creation and cluster deployment on EC2 Key: SPARK-5552 URL: https://issues.apache.org/jira/browse/SPARK-5552 Project: Spark

[jira] [Commented] (SPARK-5551) Create type alias for SchemaRDD for source backward compatibility

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302855#comment-14302855 ] Apache Spark commented on SPARK-5551: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-5551) Create type alias for SchemaRDD for source backward compatibility

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5551: --- Summary: Create type alias for SchemaRDD for source backward compatibility (was: Create type alias fo

[jira] [Created] (SPARK-5551) Create type alias for SchemaRDD to maintain source compatibility

2015-02-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5551: -- Summary: Create type alias for SchemaRDD to maintain source compatibility Key: SPARK-5551 URL: https://issues.apache.org/jira/browse/SPARK-5551 Project: Spark I

[jira] [Commented] (SPARK-5550) Custom UDF is case sensitive for HiveContext

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302850#comment-14302850 ] Apache Spark commented on SPARK-5550: - User 'chenghao-intel' has created a pull reques

[jira] [Updated] (SPARK-5550) Custom UDF is case sensitive for HiveContext

2015-02-02 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-5550: - Description: SQL in HiveContext, should be case insensitive, however, the following query will fail. ```

[jira] [Created] (SPARK-5550) Custom UDF is case sensitive for HiveContext

2015-02-02 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-5550: Summary: Custom UDF is case sensitive for HiveContext Key: SPARK-5550 URL: https://issues.apache.org/jira/browse/SPARK-5550 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-3778) newAPIHadoopRDD doesn't properly pass credentials for secure hdfs on yarn

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3778. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4292 [https://github.com/

[jira] [Resolved] (SPARK-4979) Add streaming logistic regression

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4979. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4306 [https://githu

[jira] [Comment Edited] (SPARK-5475) Java 8 tests are like maintenance overhead.

2015-02-02 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302817#comment-14302817 ] Prashant Sharma edited comment on SPARK-5475 at 2/3/15 6:32 AM:

[jira] [Commented] (SPARK-4508) Native Date type for SQL92 Date

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302823#comment-14302823 ] Apache Spark commented on SPARK-4508: - User 'adrian-wang' has created a pull request f

[jira] [Commented] (SPARK-5475) Java 8 tests are like maintenance overhead.

2015-02-02 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302817#comment-14302817 ] Prashant Sharma commented on SPARK-5475: Hi Sean, I can not get them to run. My

[jira] [Commented] (SPARK-5549) Define TaskContext interface in Scala

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302809#comment-14302809 ] Apache Spark commented on SPARK-5549: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-5549) Define TaskContext interface in Scala

2015-02-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5549: -- Summary: Define TaskContext interface in Scala Key: SPARK-5549 URL: https://issues.apache.org/jira/browse/SPARK-5549 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302794#comment-14302794 ] Hari Shreedharan commented on SPARK-5545: - I had not seen that one before. It look

[jira] [Resolved] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan resolved SPARK-5545. - Resolution: Duplicate > [STREAMING] DStream#saveAs**Files can fail after app restarts > --

[jira] [Resolved] (SPARK-5219) Race condition in TaskSchedulerImpl and TaskSetManager

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5219. Resolution: Fixed Fix Version/s: 1.3.0 > Race condition in TaskSchedulerImpl and TaskSetManag

[jira] [Closed] (SPARK-5475) Java 8 tests are like maintenance overhead.

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-5475. -- Resolution: Not a Problem > Java 8 tests are like maintenance overhead. > -

[jira] [Issue Comment Deleted] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-5529: Comment: was deleted (was: if set spark.akka.timeout=100, why executor is lost after half a hour. i

[jira] [Resolved] (SPARK-5542) Decouple publishing, packaging, and tagging in release script

2015-02-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5542. Resolution: Fixed Fix Version/s: 1.3.0 > Decouple publishing, packaging, and tagging

[jira] [Commented] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302772#comment-14302772 ] Lianhui Wang commented on SPARK-5529: - if set spark.akka.timeout=100, why executor is

[jira] [Commented] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302771#comment-14302771 ] Lianhui Wang commented on SPARK-5529: - if set spark.akka.timeout=100, why executor is

[jira] [Comment Edited] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302754#comment-14302754 ] Kuldeep edited comment on SPARK-5472 at 2/3/15 4:33 AM: Does this

[jira] [Comment Edited] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302754#comment-14302754 ] Kuldeep edited comment on SPARK-5472 at 2/3/15 4:30 AM: Does this

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302754#comment-14302754 ] Kuldeep commented on SPARK-5472: Does this PR handles ARRAY types appropriatelty? There is

[jira] [Commented] (SPARK-5547) With assembly jar to run example throws an exception

2015-02-02 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302747#comment-14302747 ] meiyoula commented on SPARK-5547: - [~srowen]can you have a test to see if master branch ha

[jira] [Updated] (SPARK-5543) Remove unused import JsonUtil from from org.apache.spark.util.JsonProtocol.scala which fails builds with older versions of hadoop-core

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5543: -- Assignee: Nathan McCarthy > Remove unused import JsonUtil from from > org.apache.spark.util.JsonProtoco

[jira] [Resolved] (SPARK-5543) Remove unused import JsonUtil from from org.apache.spark.util.JsonProtocol.scala which fails builds with older versions of hadoop-core

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5543. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4320 [https://github.com/

[jira] [Commented] (SPARK-5547) With assembly jar to run example throws an exception

2015-02-02 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302741#comment-14302741 ] meiyoula commented on SPARK-5547: - my build command is: mvn -Pyarn -Phadoop-2.3 -Phive -Ph

[jira] [Commented] (SPARK-5231) History Server shows wrong job submission time.

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302740#comment-14302740 ] Josh Rosen commented on SPARK-5231: --- I'm linking this JIRA to SPARK-5543, which fixes a

[jira] [Commented] (SPARK-5547) With assembly jar to run example throws an exception

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302739#comment-14302739 ] Sean Owen commented on SPARK-5547: -- What are you running, and how? how was it built? This

[jira] [Updated] (SPARK-4588) Add API for feature attributes

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4588: - Assignee: Sean Owen > Add API for feature attributes > -- > >

[jira] [Created] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-02 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-5548: -- Summary: Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server Key: SPARK-5548 URL: https://issues.apache.org/jira/browse/SPARK-5548

[jira] [Resolved] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5472. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4261 [https:/

[jira] [Created] (SPARK-5547) With assembly jar to run example throws an exception

2015-02-02 Thread meiyoula (JIRA)
meiyoula created SPARK-5547: --- Summary: With assembly jar to run example throws an exception Key: SPARK-5547 URL: https://issues.apache.org/jira/browse/SPARK-5547 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5512) Run the PIC algorithm with degree vector

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5512: - Assignee: Liang-Chi Hsieh > Run the PIC algorithm with degree vector > ---

[jira] [Resolved] (SPARK-5512) Run the PIC algorithm with degree vector

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5512. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4301 [https://githu

[jira] [Updated] (SPARK-5512) Run the PIC algorithm with degree vector

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5512: - Target Version/s: 1.3.0 > Run the PIC algorithm with degree vector > -

[jira] [Reopened] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-3039: -- Sounds like there's a lingering version of this issue from the Hive dependency. > Spark assembly for new ha

[jira] [Resolved] (SPARK-4631) Add real unit test for MQTT

2015-02-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4631. -- Resolution: Fixed > Add real unit test for MQTT > > >

[jira] [Created] (SPARK-5546) Improve path to Kafka assembly when trying Kafka Python API

2015-02-02 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5546: Summary: Improve path to Kafka assembly when trying Kafka Python API Key: SPARK-5546 URL: https://issues.apache.org/jira/browse/SPARK-5546 Project: Spark Is

[jira] [Resolved] (SPARK-5154) Python API for Kafka streaming

2015-02-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-5154. -- Resolution: Fixed Fix Version/s: 1.3.0 > Python API for Kafka streaming > ---

[jira] [Commented] (SPARK-3996) Shade Jetty in Spark deliverables

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302713#comment-14302713 ] Apache Spark commented on SPARK-3996: - User 'pwendell' has created a pull request for

[jira] [Commented] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302698#comment-14302698 ] Sean Owen commented on SPARK-5545: -- How does this differ from SPARK-4835? > [STREAMING]

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302692#comment-14302692 ] Sean Owen commented on SPARK-5531: -- The archive decompresses just fine for me with this c

[jira] [Commented] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302673#comment-14302673 ] Apache Spark commented on SPARK-5545: - User 'harishreedharan' has created a pull reque

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

2015-02-02 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302670#comment-14302670 ] DeepakVohra commented on SPARK-5531: The following url does not download a valid ("not

[jira] [Commented] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302665#comment-14302665 ] Hong Shen commented on SPARK-5529: -- But in fact, I have set spark.akka.timeout = 100 >

[jira] [Updated] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-5545: Priority: Critical (was: Major) > [STREAMING] DStream#saveAs**Files can fail after app rest

[jira] [Created] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-5545: --- Summary: [STREAMING] DStream#saveAs**Files can fail after app restarts Key: SPARK-5545 URL: https://issues.apache.org/jira/browse/SPARK-5545 Project: Spark

[jira] [Commented] (SPARK-5536) Wrap the old ALS to use the new ALS implementation.

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302653#comment-14302653 ] Apache Spark commented on SPARK-5536: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-5544) wholeTextFiles should recognize multiple input paths delimited by ,

2015-02-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5544: Summary: wholeTextFiles should recognize multiple input paths delimited by , Key: SPARK-5544 URL: https://issues.apache.org/jira/browse/SPARK-5544 Project: Spark

[jira] [Updated] (SPARK-4508) Native Date type for SQL92 Date

2015-02-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4508: --- Fix Version/s: (was: 1.3.0) > Native Date type for SQL92 Date > --

[jira] [Reopened] (SPARK-4508) Native Date type for SQL92 Date

2015-02-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-4508: This has caused several date-related test failures in the master and pull request builds, so I'

[jira] [Commented] (SPARK-5543) Remove unused import JsonUtil from from org.apache.spark.util.JsonProtocol.scala which fails builds with older versions of hadoop-core

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302641#comment-14302641 ] Apache Spark commented on SPARK-5543: - User 'nemccarthy' has created a pull request fo

[jira] [Created] (SPARK-5543) Remove unused import JsonUtil from from org.apache.spark.util.JsonProtocol.scala which fails builds with older versions of hadoop-core

2015-02-02 Thread Nathan M (JIRA)
Nathan M created SPARK-5543: --- Summary: Remove unused import JsonUtil from from org.apache.spark.util.JsonProtocol.scala which fails builds with older versions of hadoop-core Key: SPARK-5543 URL: https://issues.apache.o

[jira] [Updated] (SPARK-3883) Provide SSL support for Akka and HttpServer based connections

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3883: -- Assignee: Jacek Lewandowski > Provide SSL support for Akka and HttpServer based connections > --

[jira] [Resolved] (SPARK-3883) Provide SSL support for Akka and HttpServer based connections

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3883. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3571 [https://github.com/

[jira] [Resolved] (SPARK-5540) Hide ALS.solveLeastSquares.

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5540. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4318 [https://githu

[jira] [Resolved] (SPARK-5534) EdgeRDD, VertexRDD getStorageLevel return bad values

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5534. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4317 [https://githu

[jira] [Resolved] (SPARK-5514) collect should call executeCollect

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5514. Resolution: Fixed Fix Version/s: 1.3.0 > collect should call executeCollect > ---

[jira] [Updated] (SPARK-5454) [SQL] Self join with ArrayType columns problems

2015-02-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5454: Target Version/s: 1.3.0 > [SQL] Self join with ArrayType columns problems >

[jira] [Updated] (SPARK-5454) [SQL] Self join with ArrayType columns problems

2015-02-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5454: Priority: Blocker (was: Major) > [SQL] Self join with ArrayType columns problems >

[jira] [Commented] (SPARK-5542) Decouple publishing, packaging, and tagging in release script

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302578#comment-14302578 ] Apache Spark commented on SPARK-5542: - User 'pwendell' has created a pull request for

[jira] [Created] (SPARK-5542) Decouple publishing, packaging, and tagging in release script

2015-02-02 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-5542: -- Summary: Decouple publishing, packaging, and tagging in release script Key: SPARK-5542 URL: https://issues.apache.org/jira/browse/SPARK-5542 Project: Spark

[jira] [Updated] (SPARK-5195) when hive table is query with alias the cache data lose effectiveness.

2015-02-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5195: --- Fix Version/s: (was: 1.2.1) > when hive table is query with alias the cache data lose ef

[jira] [Updated] (SPARK-5231) History Server shows wrong job submission time.

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5231: -- Labels: backport-needed (was: ) > History Server shows wrong job submission time. > ---

[jira] [Commented] (SPARK-5195) when hive table is query with alias the cache data lose effectiveness.

2015-02-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302559#comment-14302559 ] Patrick Wendell commented on SPARK-5195: I reverted this from Spark 1.2. > when h

[jira] [Updated] (SPARK-5231) History Server shows wrong job submission time.

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5231: -- Target Version/s: 1.3.0, 1.2.2 (was: 1.3.0) > History Server shows wrong job submission time. > ---

[jira] [Commented] (SPARK-2005) Investigate linux container-based solution

2015-02-02 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302554#comment-14302554 ] Nicholas Chammas commented on SPARK-2005: - [~mengxr] - Do you mind if I renamed th

[jira] [Commented] (SPARK-2004) QA Automation

2015-02-02 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302549#comment-14302549 ] Nicholas Chammas commented on SPARK-2004: - [~mengxr] - Do you mind if I renamed th

[jira] [Commented] (SPARK-5541) Allow running Maven or SBT in run-tests

2015-02-02 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302525#comment-14302525 ] Nicholas Chammas commented on SPARK-5541: - Dup of SPARK-3355? > Allow running Mav

[jira] [Resolved] (SPARK-5195) when hive table is query with alias the cache data lose effectiveness.

2015-02-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5195. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Issue resolved by p

[jira] [Updated] (SPARK-5541) Allow running Maven or SBT in run-tests

2015-02-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5541: --- Summary: Allow running Maven or SBT in run-tests (was: Allow running Maven or SBT in the Spar

[jira] [Created] (SPARK-5541) Allow running Maven or SBT in the Spark build

2015-02-02 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-5541: -- Summary: Allow running Maven or SBT in the Spark build Key: SPARK-5541 URL: https://issues.apache.org/jira/browse/SPARK-5541 Project: Spark Issue Type: B

[jira] [Resolved] (SPARK-2309) Generalize the binary logistic regression into multinomial logistic regression

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2309. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3833 [https://githu

[jira] [Commented] (SPARK-5540) Hide ALS.solveLeastSquares.

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302495#comment-14302495 ] Apache Spark commented on SPARK-5540: - User 'mengxr' has created a pull request for th

[jira] [Resolved] (SPARK-5513) Add NMF option to the new ALS implementation

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5513. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4302 [https://githu

[jira] [Resolved] (SPARK-4508) Native Date type for SQL92 Date

2015-02-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4508. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3732 [https:/

[jira] [Commented] (SPARK-5131) A typo in configuration doc

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302342#comment-14302342 ] Sean Owen commented on SPARK-5131: -- Sometimes site changes reflect changes not in the cur

[jira] [Created] (SPARK-5540) Hide ALS.solveLeastSquares.

2015-02-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5540: Summary: Hide ALS.solveLeastSquares. Key: SPARK-5540 URL: https://issues.apache.org/jira/browse/SPARK-5540 Project: Spark Issue Type: Improvement C

[jira] [Updated] (SPARK-5536) Wrap the old ALS to use the new ALS implementation.

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5536: - Target Version/s: 1.3.0 > Wrap the old ALS to use the new ALS implementation. > --

[jira] [Commented] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

2015-02-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302326#comment-14302326 ] Patrick Wendell commented on SPARK-4550: Yeah, this is a good idea. I don't see wh

[jira] [Created] (SPARK-5539) User guide for LDA

2015-02-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5539: Summary: User guide for LDA Key: SPARK-5539 URL: https://issues.apache.org/jira/browse/SPARK-5539 Project: Spark Issue Type: Documentation Componen

[jira] [Created] (SPARK-5538) CachedTableSuite failure due to unpersisting RDDs in a non-blocking way

2015-02-02 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5538: - Summary: CachedTableSuite failure due to unpersisting RDDs in a non-blocking way Key: SPARK-5538 URL: https://issues.apache.org/jira/browse/SPARK-5538 Project: Spark

[jira] [Created] (SPARK-5537) Expand user guide for multinomial logistic regression

2015-02-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5537: Summary: Expand user guide for multinomial logistic regression Key: SPARK-5537 URL: https://issues.apache.org/jira/browse/SPARK-5537 Project: Spark Issue Typ

[jira] [Created] (SPARK-5536) Wrap the old ALS to use the new ALS implementation.

2015-02-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5536: Summary: Wrap the old ALS to use the new ALS implementation. Key: SPARK-5536 URL: https://issues.apache.org/jira/browse/SPARK-5536 Project: Spark Issue Type:

  1   2   3   >