[jira] [Commented] (SPARK-2004) QA Automation

2015-02-02 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302549#comment-14302549 ] Nicholas Chammas commented on SPARK-2004: - [~mengxr] - Do you mind if I renamed

[jira] [Created] (SPARK-5542) Decouple publishing, packaging, and tagging in release script

2015-02-02 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-5542: -- Summary: Decouple publishing, packaging, and tagging in release script Key: SPARK-5542 URL: https://issues.apache.org/jira/browse/SPARK-5542 Project: Spark

[jira] [Resolved] (SPARK-5540) Hide ALS.solveLeastSquares.

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5540. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4318

[jira] [Commented] (SPARK-5530) ApplicationMaster can't kill executor when using dynamicAllocation

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301222#comment-14301222 ] Apache Spark commented on SPARK-5530: - User 'XuTingjun' has created a pull request for

[jira] [Commented] (SPARK-5527) Improvements to standalone doc. - how to sync cluster conf file

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301307#comment-14301307 ] Apache Spark commented on SPARK-5527: - User 'lazyman500' has created a pull request

[jira] [Updated] (SPARK-5527) Add standalone document configiration to explain how to make cluster conf file consistency

2015-02-02 Thread dongxu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dongxu updated SPARK-5527: -- Description: We must make all node conf file consistent when we start our standalone cluster. For example, we

[jira] [Commented] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301216#comment-14301216 ] Hong Shen commented on SPARK-5529: -- If a blockManager has not send heartBeat more than

[jira] [Created] (SPARK-5530) ApplicationMaster can't kill executor when using dynamicAllocation

2015-02-02 Thread meiyoula (JIRA)
meiyoula created SPARK-5530: --- Summary: ApplicationMaster can't kill executor when using dynamicAllocation Key: SPARK-5530 URL: https://issues.apache.org/jira/browse/SPARK-5530 Project: Spark

[jira] [Commented] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301236#comment-14301236 ] Lianhui Wang commented on SPARK-5529: - i think when akka timeout time

[jira] [Updated] (SPARK-5527) Improvements to standalone doc. - how to make cluster conf file consistency

2015-02-02 Thread dongxu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dongxu updated SPARK-5527: -- Summary: Improvements to standalone doc. - how to make cluster conf file consistency (was: Add standalone

[jira] [Updated] (SPARK-5527) Improvements to standalone doc. - how to sync cluster conf file

2015-02-02 Thread dongxu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dongxu updated SPARK-5527: -- Summary: Improvements to standalone doc. - how to sync cluster conf file (was: Improvements to standalone doc.

[jira] [Created] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Hong Shen (JIRA)
Hong Shen created SPARK-5529: Summary: Executor is still hold while BlockManager has been removed Key: SPARK-5529 URL: https://issues.apache.org/jira/browse/SPARK-5529 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

2015-02-02 Thread Ashutosh Trivedi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301257#comment-14301257 ] Ashutosh Trivedi commented on SPARK-2335: - Hi Brian , We extended the

[jira] [Commented] (SPARK-5523) TaskMetrics and TaskInfo have innumerable copies of the hostname string

2015-02-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301089#comment-14301089 ] Tathagata Das commented on SPARK-5523: -- That is a little risky. In Java 6

[jira] [Created] (SPARK-5527) Add standalone document configiration to explain how to make cluster conf file consistency

2015-02-02 Thread dongxu (JIRA)
dongxu created SPARK-5527: - Summary: Add standalone document configiration to explain how to make cluster conf file consistency Key: SPARK-5527 URL: https://issues.apache.org/jira/browse/SPARK-5527 Project:

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

2015-02-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301124#comment-14301124 ] Jacek Lewandowski commented on SPARK-5524: -- [~srowen] thanks for reply. I meant

[jira] [Updated] (SPARK-5526) expression [date '2011-01-01' = cast(timestamp('2011-01-01 23:24:25') as date)] return false

2015-02-02 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xukun updated SPARK-5526: - Fix Version/s: (was: 1.3.0) expression [date '2011-01-01' = cast(timestamp('2011-01-01 23:24:25') as

[jira] [Created] (SPARK-5526) expression [date '2011-01-01' = cast(timestamp('2011-01-01 23:24:25') as date)] return false

2015-02-02 Thread xukun (JIRA)
xukun created SPARK-5526: Summary: expression [date '2011-01-01' = cast(timestamp('2011-01-01 23:24:25') as date)] return false Key: SPARK-5526 URL: https://issues.apache.org/jira/browse/SPARK-5526 Project:

[jira] [Commented] (SPARK-5523) TaskMetrics and TaskInfo have innumerable copies of the hostname string

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301073#comment-14301073 ] Sean Owen commented on SPARK-5523: -- How about `String.intern()` here, as a native

[jira] [Updated] (SPARK-5524) Remove messy dependencies to log4j

2015-02-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5524: - Issue Type: Task (was: Bug) Remove messy dependencies to log4j

[jira] [Commented] (SPARK-5526) expression [date '2011-01-01' = cast(timestamp('2011-01-01 23:24:25') as date)] return false

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301079#comment-14301079 ] Apache Spark commented on SPARK-5526: - User 'viper-kun' has created a pull request for

[jira] [Commented] (SPARK-5528) Support schema merging while reading Parquet files

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301197#comment-14301197 ] Apache Spark commented on SPARK-5528: - User 'liancheng' has created a pull request for

[jira] [Created] (SPARK-5525) [SPARK][SQL]

2015-02-02 Thread xukun (JIRA)
xukun created SPARK-5525: Summary: [SPARK][SQL] Key: SPARK-5525 URL: https://issues.apache.org/jira/browse/SPARK-5525 Project: Spark Issue Type: Bug Reporter: xukun -- This message

[jira] [Created] (SPARK-5528) Support schema merging while reading Parquet files

2015-02-02 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5528: - Summary: Support schema merging while reading Parquet files Key: SPARK-5528 URL: https://issues.apache.org/jira/browse/SPARK-5528 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5182) Partitioning support for tables created by the data source API

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301196#comment-14301196 ] Apache Spark commented on SPARK-5182: - User 'liancheng' has created a pull request for

[jira] [Resolved] (SPARK-5512) Run the PIC algorithm with degree vector

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5512. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4301

[jira] [Updated] (SPARK-5512) Run the PIC algorithm with degree vector

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5512: - Target Version/s: 1.3.0 Run the PIC algorithm with degree vector

[jira] [Updated] (SPARK-5512) Run the PIC algorithm with degree vector

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5512: - Assignee: Liang-Chi Hsieh Run the PIC algorithm with degree vector

[jira] [Created] (SPARK-5547) With assembly jar to run example throws an exception

2015-02-02 Thread meiyoula (JIRA)
meiyoula created SPARK-5547: --- Summary: With assembly jar to run example throws an exception Key: SPARK-5547 URL: https://issues.apache.org/jira/browse/SPARK-5547 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5547) With assembly jar to run example throws an exception

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302739#comment-14302739 ] Sean Owen commented on SPARK-5547: -- What are you running, and how? how was it built? This

[jira] [Comment Edited] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302754#comment-14302754 ] Kuldeep edited comment on SPARK-5472 at 2/3/15 4:30 AM: Does this

[jira] [Issue Comment Deleted] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-5529: Comment: was deleted (was: if set spark.akka.timeout=100, why executor is lost after half a hour. i

[jira] [Resolved] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan resolved SPARK-5545. - Resolution: Duplicate [STREAMING] DStream#saveAs**Files can fail after app restarts

[jira] [Commented] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302794#comment-14302794 ] Hari Shreedharan commented on SPARK-5545: - I had not seen that one before. It

[jira] [Resolved] (SPARK-4631) Add real unit test for MQTT

2015-02-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4631. -- Resolution: Fixed Add real unit test for MQTT

[jira] [Reopened] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-3039: -- Sounds like there's a lingering version of this issue from the Hive dependency. Spark assembly for new

[jira] [Created] (SPARK-5546) Improve path to Kafka assembly when trying Kafka Python API

2015-02-02 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5546: Summary: Improve path to Kafka assembly when trying Kafka Python API Key: SPARK-5546 URL: https://issues.apache.org/jira/browse/SPARK-5546 Project: Spark

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302754#comment-14302754 ] Kuldeep commented on SPARK-5472: Does this PR handles ARRAY types appropriatelty? There is

[jira] [Resolved] (SPARK-5542) Decouple publishing, packaging, and tagging in release script

2015-02-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5542. Resolution: Fixed Fix Version/s: 1.3.0 Decouple publishing, packaging, and tagging

[jira] [Closed] (SPARK-5475) Java 8 tests are like maintenance overhead.

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-5475. -- Resolution: Not a Problem Java 8 tests are like maintenance overhead.

[jira] [Created] (SPARK-5550) Custom UDF is case sensitive for HiveContext

2015-02-02 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-5550: Summary: Custom UDF is case sensitive for HiveContext Key: SPARK-5550 URL: https://issues.apache.org/jira/browse/SPARK-5550 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-3778) newAPIHadoopRDD doesn't properly pass credentials for secure hdfs on yarn

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3778. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4292

[jira] [Updated] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Shreedharan updated SPARK-5545: Priority: Critical (was: Major) [STREAMING] DStream#saveAs**Files can fail after app

[jira] [Created] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-5545: --- Summary: [STREAMING] DStream#saveAs**Files can fail after app restarts Key: SPARK-5545 URL: https://issues.apache.org/jira/browse/SPARK-5545 Project: Spark

[jira] [Updated] (SPARK-4588) Add API for feature attributes

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4588: - Assignee: Sean Owen Add API for feature attributes --

[jira] [Commented] (SPARK-5547) With assembly jar to run example throws an exception

2015-02-02 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302741#comment-14302741 ] meiyoula commented on SPARK-5547: - my build command is: mvn -Pyarn -Phadoop-2.3 -Phive

[jira] [Updated] (SPARK-5543) Remove unused import JsonUtil from from org.apache.spark.util.JsonProtocol.scala which fails builds with older versions of hadoop-core

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5543: -- Assignee: Nathan McCarthy Remove unused import JsonUtil from from

[jira] [Commented] (SPARK-5547) With assembly jar to run example throws an exception

2015-02-02 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302747#comment-14302747 ] meiyoula commented on SPARK-5547: - [~srowen]can you have a test to see if master branch

[jira] [Commented] (SPARK-5475) Java 8 tests are like maintenance overhead.

2015-02-02 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302817#comment-14302817 ] Prashant Sharma commented on SPARK-5475: Hi Sean, I can not get them to run. My

[jira] [Commented] (SPARK-4508) Native Date type for SQL92 Date

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302823#comment-14302823 ] Apache Spark commented on SPARK-4508: - User 'adrian-wang' has created a pull request

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

2015-02-02 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302670#comment-14302670 ] DeepakVohra commented on SPARK-5531: The following url does not download a valid (not

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302692#comment-14302692 ] Sean Owen commented on SPARK-5531: -- The archive decompresses just fine for me with this

[jira] [Commented] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302698#comment-14302698 ] Sean Owen commented on SPARK-5545: -- How does this differ from SPARK-4835? [STREAMING]

[jira] [Commented] (SPARK-3996) Shade Jetty in Spark deliverables

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302713#comment-14302713 ] Apache Spark commented on SPARK-3996: - User 'pwendell' has created a pull request for

[jira] [Created] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-02 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-5548: -- Summary: Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server Key: SPARK-5548 URL: https://issues.apache.org/jira/browse/SPARK-5548

[jira] [Resolved] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5472. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4261

[jira] [Commented] (SPARK-5231) History Server shows wrong job submission time.

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302740#comment-14302740 ] Josh Rosen commented on SPARK-5231: --- I'm linking this JIRA to SPARK-5543, which fixes a

[jira] [Commented] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302771#comment-14302771 ] Lianhui Wang commented on SPARK-5529: - if set spark.akka.timeout=100, why executor is

[jira] [Commented] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302772#comment-14302772 ] Lianhui Wang commented on SPARK-5529: - if set spark.akka.timeout=100, why executor is

[jira] [Commented] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-02 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302665#comment-14302665 ] Hong Shen commented on SPARK-5529: -- But in fact, I have set spark.akka.timeout = 100

[jira] [Resolved] (SPARK-5219) Race condition in TaskSchedulerImpl and TaskSetManager

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5219. Resolution: Fixed Fix Version/s: 1.3.0 Race condition in TaskSchedulerImpl and

[jira] [Resolved] (SPARK-4979) Add streaming logistic regression

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4979. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4306

[jira] [Updated] (SPARK-5550) Custom UDF is case sensitive for HiveContext

2015-02-02 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-5550: - Description: SQL in HiveContext, should be case insensitive, however, the following query will fail.

[jira] [Commented] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301380#comment-14301380 ] Apache Spark commented on SPARK-4705: - User 'twinkle-sachdeva' has created a pull

[jira] [Commented] (SPARK-5508) [hive context] Unable to query array once saved as parquet

2015-02-02 Thread Ayoub Benali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301349#comment-14301349 ] Ayoub Benali commented on SPARK-5508: - I narrowed down the problem, the issue seems to

[jira] [Resolved] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5414. Resolution: Fixed Fix Version/s: 1.3.0 Add SparkListener implementation that allows users

[jira] [Commented] (SPARK-5551) Create type alias for SchemaRDD for source backward compatibility

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302855#comment-14302855 ] Apache Spark commented on SPARK-5551: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-5012) Python API for Gaussian Mixture Model

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5012. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4059

[jira] [Resolved] (SPARK-5501) Write support for the data source API

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5501. Resolution: Fixed Fix Version/s: 1.3.0 Write support for the data source API

[jira] [Updated] (SPARK-5381) Publish org.apache.spark/spark-hive-thriftserver_2.10 artifact

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep updated SPARK-5381: --- Affects Version/s: 1.3.0 Publish org.apache.spark/spark-hive-thriftserver_2.10 artifact

[jira] [Closed] (SPARK-1983) Expose private `inferSchema` method in SQLContext for Scala and Java API

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep closed SPARK-1983. -- Resolution: Fixed Available in new versions. Expose private `inferSchema` method in SQLContext for Scala and

[jira] [Commented] (SPARK-5501) Write support for the data source API

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302880#comment-14302880 ] Reynold Xin commented on SPARK-5501: BTW would be great to paste the API in this JIRA

[jira] [Commented] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302885#comment-14302885 ] Reynold Xin commented on SPARK-5414: Actually this doesn't look like something we need

[jira] [Commented] (SPARK-5550) Custom UDF is case sensitive for HiveContext

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302850#comment-14302850 ] Apache Spark commented on SPARK-5550: - User 'chenghao-intel' has created a pull

[jira] [Created] (SPARK-5551) Create type alias for SchemaRDD to maintain source compatibility

2015-02-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5551: -- Summary: Create type alias for SchemaRDD to maintain source compatibility Key: SPARK-5551 URL: https://issues.apache.org/jira/browse/SPARK-5551 Project: Spark

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302888#comment-14302888 ] Jacek Lewandowski commented on SPARK-5548: -- This test passes on my laptop (OSX).

[jira] [Commented] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302895#comment-14302895 ] Josh Rosen commented on SPARK-5414: --- Yeah, on second thought I think we're fine to leave

[jira] [Updated] (SPARK-5414) Add SparkListener implementation that allows users to receive all listener events in one method

2015-02-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5414: -- Target Version/s: 1.3.0 (was: 1.3.0, 1.2.1) Add SparkListener implementation that allows users to

[jira] [Resolved] (SPARK-5536) Wrap the old ALS to use the new ALS implementation.

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5536. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4321

[jira] [Updated] (SPARK-5551) Create type alias for SchemaRDD for source backward compatibility

2015-02-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5551: --- Summary: Create type alias for SchemaRDD for source backward compatibility (was: Create type alias

[jira] [Created] (SPARK-5552) Automated data science AMIs creation and cluster deployment on EC2

2015-02-02 Thread Florian Verhein (JIRA)
Florian Verhein created SPARK-5552: -- Summary: Automated data science AMIs creation and cluster deployment on EC2 Key: SPARK-5552 URL: https://issues.apache.org/jira/browse/SPARK-5552 Project: Spark

[jira] [Updated] (SPARK-5552) Automated data science AMI creation and data science cluster deployment on EC2

2015-02-02 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Verhein updated SPARK-5552: --- Summary: Automated data science AMI creation and data science cluster deployment on EC2

[jira] [Commented] (SPARK-4587) Model export/import

2015-02-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301896#comment-14301896 ] Xiangrui Meng commented on SPARK-4587: -- [~selvinsource] Thanks for joining the

[jira] [Commented] (SPARK-5545) [STREAMING] DStream#saveAs**Files can fail after app restarts

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302673#comment-14302673 ] Apache Spark commented on SPARK-5545: - User 'harishreedharan' has created a pull

[jira] [Resolved] (SPARK-5154) Python API for Kafka streaming

2015-02-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-5154. -- Resolution: Fixed Fix Version/s: 1.3.0 Python API for Kafka streaming

[jira] [Comment Edited] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-02 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302754#comment-14302754 ] Kuldeep edited comment on SPARK-5472 at 2/3/15 4:33 AM: Does this

[jira] [Created] (SPARK-5549) Define TaskContext interface in Scala

2015-02-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5549: -- Summary: Define TaskContext interface in Scala Key: SPARK-5549 URL: https://issues.apache.org/jira/browse/SPARK-5549 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5549) Define TaskContext interface in Scala

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302809#comment-14302809 ] Apache Spark commented on SPARK-5549: - User 'rxin' has created a pull request for this

[jira] [Comment Edited] (SPARK-5475) Java 8 tests are like maintenance overhead.

2015-02-02 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302817#comment-14302817 ] Prashant Sharma edited comment on SPARK-5475 at 2/3/15 6:32 AM:

[jira] [Commented] (SPARK-5509) EqualTo operator doesn't handle binary type properly

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301699#comment-14301699 ] Apache Spark commented on SPARK-5509: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-3575) Hive Schema is ignored when using convertMetastoreParquet

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301700#comment-14301700 ] Apache Spark commented on SPARK-3575: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

2015-02-02 Thread Matthew Cornell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301751#comment-14301751 ] Matthew Cornell commented on SPARK-2173: Hello. I'm new to GraphX and Scala and my

[jira] [Resolved] (SPARK-5492) Thread statistics can break with older Hadoop versions

2015-02-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5492. Resolution: Fixed Fix Version/s: 1.3.0 Thanks, Sandy. Thread statistics can break

[jira] [Commented] (SPARK-4979) Add streaming logistic regression

2015-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301022#comment-14301022 ] Apache Spark commented on SPARK-4979: - User 'freeman-lab' has created a pull request

[jira] [Created] (SPARK-5524) Remove messy dependencies to log4j

2015-02-02 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-5524: Summary: Remove messy dependencies to log4j Key: SPARK-5524 URL: https://issues.apache.org/jira/browse/SPARK-5524 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

2015-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301036#comment-14301036 ] Sean Owen commented on SPARK-5524: -- If you mean, why call log4j directly at all instead

<    1   2