[jira] [Resolved] (SPARK-1996) Remove use of special Maven repo for Akka

[ https://issues.apache.org/jira/browse/SPARK-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1996. Resolution: Fixed Fix Version/s: (was: 1.0.1) 1.1.0 Fixed

[jira] [Created] (SPARK-2230) Improvements to Jenkins QA Harness

Patrick Wendell created SPARK-2230: -- Summary: Improvements to Jenkins QA Harness Key: SPARK-2230 URL: https://issues.apache.org/jira/browse/SPARK-2230 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-2231) dev/run-tests should include YARN and use a recent Hadoop version

Patrick Wendell created SPARK-2231: -- Summary: dev/run-tests should include YARN and use a recent Hadoop version Key: SPARK-2231 URL: https://issues.apache.org/jira/browse/SPARK-2231 Project: Spark

[jira] [Created] (SPARK-2232) Fix Jenkins tests in Maven

Patrick Wendell created SPARK-2232: -- Summary: Fix Jenkins tests in Maven Key: SPARK-2232 URL: https://issues.apache.org/jira/browse/SPARK-2232 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-1804) Mark 0.9.1 as released in JIRA

[ https://issues.apache.org/jira/browse/SPARK-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1804. Resolution: Fixed Mark 0.9.1 as released in JIRA --

[jira] [Resolved] (SPARK-1803) Rename test resources to be compatible with Windows FS

[ https://issues.apache.org/jira/browse/SPARK-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1803. Resolution: Fixed Resolved via: https://github.com/apache/spark/pull/739 Rename test

[jira] [Resolved] (SPARK-721) Fix remaining deprecation warnings

[ https://issues.apache.org/jira/browse/SPARK-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-721. --- Resolution: Fixed Assignee: (was: Gary Struthers) Fix remaining deprecation

[jira] [Created] (SPARK-2233) make-distribution script should list the git hash in the RELEASE file

Patrick Wendell created SPARK-2233: -- Summary: make-distribution script should list the git hash in the RELEASE file Key: SPARK-2233 URL: https://issues.apache.org/jira/browse/SPARK-2233 Project:

[jira] [Updated] (SPARK-2233) make-distribution script should list the git hash in the RELEASE file

[ https://issues.apache.org/jira/browse/SPARK-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2233: --- Issue Type: Improvement (was: Bug) make-distribution script should list the git hash in

[jira] [Resolved] (SPARK-2231) dev/run-tests should include YARN and use a recent Hadoop version

[ https://issues.apache.org/jira/browse/SPARK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2231. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1175

[jira] [Updated] (SPARK-2034) KafkaInputDStream doesn't close resources and may prevent JVM shutdown

[ https://issues.apache.org/jira/browse/SPARK-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2034: --- Assignee: Sean Owen KafkaInputDStream doesn't close resources and may prevent JVM shutdown

[jira] [Created] (SPARK-2234) Spark SQL basicOperators add Except operator

Yanjie Gao created SPARK-2234: - Summary: Spark SQL basicOperators add Except operator Key: SPARK-2234 URL: https://issues.apache.org/jira/browse/SPARK-2234 Project: Spark Issue Type: New

[jira] [Created] (SPARK-2235) Spark SQL basicOperator add Intersect operator

Yanjie Gao created SPARK-2235: - Summary: Spark SQL basicOperator add Intersect operator Key: SPARK-2235 URL: https://issues.apache.org/jira/browse/SPARK-2235 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-2234) Spark SQL basicOperators add Except operator

[ https://issues.apache.org/jira/browse/SPARK-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040155#comment-14040155 ] Yanjie Gao commented on SPARK-2234: --- https://github.com/apache/spark/pull/1151 Spark

[jira] [Created] (SPARK-2236) SparkSQL add SkewJoin

Yanjie Gao created SPARK-2236: - Summary: SparkSQL add SkewJoin Key: SPARK-2236 URL: https://issues.apache.org/jira/browse/SPARK-2236 Project: Spark Issue Type: New Feature Components:

[jira] [Commented] (SPARK-2236) SparkSQL add SkewJoin

[ https://issues.apache.org/jira/browse/SPARK-2236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040161#comment-14040161 ] Yanjie Gao commented on SPARK-2236: --- https://github.com/apache/spark/pull/1134

[jira] [Created] (SPARK-2237) Add ZLIBCompressionCodec code

Yanjie Gao created SPARK-2237: - Summary: Add ZLIBCompressionCodec code Key: SPARK-2237 URL: https://issues.apache.org/jira/browse/SPARK-2237 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-2239) Spark SQL add LeftSemiBloomFilterBroadcastJoin

Yanjie Gao created SPARK-2239: - Summary: Spark SQL add LeftSemiBloomFilterBroadcastJoin Key: SPARK-2239 URL: https://issues.apache.org/jira/browse/SPARK-2239 Project: Spark Issue Type: New

[jira] [Created] (SPARK-2240) Spark SQL add LeftSemiBloomFilterBroadcastJoin

Yanjie Gao created SPARK-2240: - Summary: Spark SQL add LeftSemiBloomFilterBroadcastJoin Key: SPARK-2240 URL: https://issues.apache.org/jira/browse/SPARK-2240 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-2239) Spark SQL basicOperator add Distinct operator

[ https://issues.apache.org/jira/browse/SPARK-2239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjie Gao updated SPARK-2239: -- Summary: Spark SQL basicOperator add Distinct operator (was: Spark SQL add

[jira] [Commented] (SPARK-2239) Spark SQL basicOperator add Distinct operator

[ https://issues.apache.org/jira/browse/SPARK-2239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040164#comment-14040164 ] Yanjie Gao commented on SPARK-2239: --- https://github.com/apache/spark/pull/1145 Spark

[jira] [Commented] (SPARK-2222) Add multiclass evaluation metrics

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040175#comment-14040175 ] Jun Xie commented on SPARK-: It makes sense. You are right. sum(fni)=sum(fpi). The

[jira] [Resolved] (SPARK-1316) Remove use of Commons IO

[ https://issues.apache.org/jira/browse/SPARK-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-1316. Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Sean Owen Remove use of Commons

[jira] [Resolved] (SPARK-2229) SizeBasedRollingPolicy throw an java.lang.IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2229. Resolution: Fixed Fix Version/s: 1.1.0 SizeBasedRollingPolicy throw an

[jira] [Updated] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2156: --- Target Version/s: 0.9.2, 1.0.1, 1.1.0 (was: 0.9.2, 1.0.1) When the size of serialized

[jira] [Updated] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1112: --- Fix Version/s: 1.0.1 When spark.akka.frameSize 10, task results bigger than 10MiB block

[jira] [Updated] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2156: --- Fix Version/s: 1.0.1 When the size of serialized results for one partition is slightly

[jira] [Updated] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1112: --- Target Version/s: 0.9.2, 1.0.1, 1.1.0 (was: 0.9.2, 1.0.1) When spark.akka.frameSize 10,

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040360#comment-14040360 ] Patrick Wendell commented on SPARK-2156: This is fixed in the 1.0 branch via:

[jira] [Updated] (SPARK-2241) EC2 script should handle quoted arguments correctly

[ https://issues.apache.org/jira/browse/SPARK-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2241: --- Description: We should pass quoted arguments correctly to the underlying ec2 script in

[jira] [Created] (SPARK-2241) EC2 script should handle quoted arguments correctly

Patrick Wendell created SPARK-2241: -- Summary: EC2 script should handle quoted arguments correctly Key: SPARK-2241 URL: https://issues.apache.org/jira/browse/SPARK-2241 Project: Spark Issue

[jira] [Updated] (SPARK-2241) EC2 script should handle quoted arguments correctly

[ https://issues.apache.org/jira/browse/SPARK-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2241: --- Description: We should pass quoted arguments correctly to the underlying ec2 in spark-ec2

[jira] [Resolved] (SPARK-2241) EC2 script should handle quoted arguments correctly

[ https://issues.apache.org/jira/browse/SPARK-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2241. Resolution: Fixed Fix Version/s: 1.1.0 0.9.2

[jira] [Created] (SPARK-2242) Running sc.parallelize(..).count() hangs pyspark

Xiangrui Meng created SPARK-2242: Summary: Running sc.parallelize(..).count() hangs pyspark Key: SPARK-2242 URL: https://issues.apache.org/jira/browse/SPARK-2242 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2242) Running sc.parallelize(..).count() hangs pyspark

[ https://issues.apache.org/jira/browse/SPARK-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2242: - Priority: Blocker (was: Critical) Running sc.parallelize(..).count() hangs pyspark

[jira] [Resolved] (SPARK-2166) Enumerating instances to be terminated before the prompting the users to continue.

[ https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2166. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 270

[jira] [Updated] (SPARK-1983) Expose private `inferSchema` method in SQLContext for Scala and Java API

[ https://issues.apache.org/jira/browse/SPARK-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep updated SPARK-1983: --- Description: