[jira] [Assigned] (SPARK-12530) Build break at Spark-Master-Maven-Snapshots from #1293

[ https://issues.apache.org/jira/browse/SPARK-12530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12530: Assignee: Apache Spark > Build break at Spark-Master-Maven-Snapshots from #1293 >

[jira] [Assigned] (SPARK-12530) Build break at Spark-Master-Maven-Snapshots from #1293

[ https://issues.apache.org/jira/browse/SPARK-12530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12530: Assignee: (was: Apache Spark) > Build break at Spark-Master-Maven-Snapshots from

[jira] [Commented] (SPARK-12530) Build break at Spark-Master-Maven-Snapshots from #1293

[ https://issues.apache.org/jira/browse/SPARK-12530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072103#comment-15072103 ] Apache Spark commented on SPARK-12530: -- User 'kiszk' has created a pull request for this issue:

[jira] [Commented] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072110#comment-15072110 ] Apache Spark commented on SPARK-12461: -- User 'vectorijk' has created a pull request for this issue:

[jira] [Commented] (SPARK-12517) No default RDD name for ones created by sc.textFile

[ https://issues.apache.org/jira/browse/SPARK-12517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072184#comment-15072184 ] yaron weinsberg commented on SPARK-12517: - https://github.com/apache/spark/pull/10456 > No

[jira] [Commented] (SPARK-12531) Add median and mode to Summary statistics

[ https://issues.apache.org/jira/browse/SPARK-12531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072196#comment-15072196 ] Sean Owen commented on SPARK-12531: --- Those are non-trivial to compute exactly; unlike moments, they

[jira] [Commented] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072225#comment-15072225 ] Sean Owen commented on SPARK-12521: --- PS see https://issues.apache.org/jira/browse/SPARK-12515 >

[jira] [Reopened] (SPARK-12518) Problem in Spark deserialization with htsjdk BAMRecordCodec

[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-12518: --- (Questions should go to the mailing list; this was not a Spark problem and was not resolved by a commit

[jira] [Commented] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072200#comment-15072200 ] Apache Spark commented on SPARK-12263: -- User 'nssalian' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12263: Assignee: Apache Spark > IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY

[jira] [Created] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

Xiao Li created SPARK-12532: --- Summary: Join-key Pushdown via Predicate Transitivity Key: SPARK-12532 URL: https://issues.apache.org/jira/browse/SPARK-12532 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12532: Description: {code} "SELECT * FROM upperCaseData JOIN lowerCaseData where lowerCaseData.n =

[jira] [Commented] (SPARK-12529) Spark streaming: java.lang.NoSuchFieldException: SHUTDOWN_HOOK_PRIORITY

[ https://issues.apache.org/jira/browse/SPARK-12529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072197#comment-15072197 ] Sean Owen commented on SPARK-12529: --- This means you've dragged in (old) Hadoop dependencies somehow in

[jira] [Resolved] (SPARK-12518) Problem in Spark deserialization with htsjdk BAMRecordCodec

[ https://issues.apache.org/jira/browse/SPARK-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12518. --- Resolution: Not A Problem > Problem in Spark deserialization with htsjdk BAMRecordCodec >

[jira] [Assigned] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12263: Assignee: (was: Apache Spark) > IllegalStateException: Memory can't be 0 for

[jira] [Resolved] (SPARK-12521) DataFrame Partitions in java does not work

[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12521. --- Resolution: Not A Problem It's already described as an arg that controls partition stride. It

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11600: - Target Version/s: 1.6.1 (was: 1.6.0) > Spark MLlib 1.6 QA umbrella >

[jira] [Updated] (SPARK-8447) Test external shuffle service with all shuffle managers

[ https://issues.apache.org/jira/browse/SPARK-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8447: Target Version/s: 1.6.1 (was: 1.6.0) > Test external shuffle service with all shuffle

[jira] [Updated] (SPARK-11224) Flaky test: o.a.s.ExternalShuffleServiceSuite

[ https://issues.apache.org/jira/browse/SPARK-11224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11224: - Target Version/s: 1.6.1 (was: 1.6.0) > Flaky test: o.a.s.ExternalShuffleServiceSuite >

[jira] [Updated] (SPARK-11266) Peak memory tests swallow failures

[ https://issues.apache.org/jira/browse/SPARK-11266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11266: - Target Version/s: 1.6.1 (was: 1.6.0) > Peak memory tests swallow failures >

[jira] [Updated] (SPARK-11607) Update MLlib website for 1.6

[ https://issues.apache.org/jira/browse/SPARK-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11607: - Target Version/s: 1.6.1 (was: 1.6.0) > Update MLlib website for 1.6 >

[jira] [Updated] (SPARK-11603) ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11603: - Target Version/s: 1.6.1 (was: 1.6.0) > ML 1.6 QA: API: Experimental, DeveloperApi,

[jira] [Updated] (SPARK-10680) Flaky test: network.RequestTimeoutIntegrationSuite.timeoutInactiveRequests

[ https://issues.apache.org/jira/browse/SPARK-10680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10680: - Target Version/s: 1.6.1 (was: 1.6.0) > Flaky test:

[jira] [Updated] (SPARK-12507) Update Streaming configurations for 1.6

[ https://issues.apache.org/jira/browse/SPARK-12507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12507: - Target Version/s: 1.6.1 (was: 1.6.0) > Update Streaming configurations for 1.6 >

[jira] [Created] (SPARK-12534) Document missing command line options to Spark properties mapping

Felix Cheung created SPARK-12534: Summary: Document missing command line options to Spark properties mapping Key: SPARK-12534 URL: https://issues.apache.org/jira/browse/SPARK-12534 Project: Spark

[jira] [Commented] (SPARK-4924) Factor out code to launch Spark applications into a separate library

[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072396#comment-15072396 ] Jiahongchao commented on SPARK-4924: Where is the official document? > Factor out code to launch

[jira] [Assigned] (SPARK-12534) Document missing command line options to Spark properties mapping

[ https://issues.apache.org/jira/browse/SPARK-12534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12534: Assignee: Apache Spark > Document missing command line options to Spark properties

[jira] [Assigned] (SPARK-12513) SocketReceiver hang in Netcat example

[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12513: Assignee: Apache Spark > SocketReceiver hang in Netcat example >

[jira] [Assigned] (SPARK-12513) SocketReceiver hang in Netcat example

[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12513: Assignee: (was: Apache Spark) > SocketReceiver hang in Netcat example >

[jira] [Assigned] (SPARK-12461) Add ExpressionDescription to math functions

[ https://issues.apache.org/jira/browse/SPARK-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12461: Assignee: Apache Spark > Add ExpressionDescription to math functions >

[jira] [Updated] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12532: - Shepherd: Michael Armbrust > Join-key Pushdown via Predicate Transitivity >

[jira] [Updated] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12532: - Target Version/s: 2.0.0 > Join-key Pushdown via Predicate Transitivity >

[jira] [Updated] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12532: - Assignee: Xiao Li > Join-key Pushdown via Predicate Transitivity >

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072435#comment-15072435 ] Apache Spark commented on SPARK-12453: -- User 'BrianLondon' has created a pull request for this

[jira] [Updated] (SPARK-12505) Pushdown a Limit on top of an Outer-Join

[ https://issues.apache.org/jira/browse/SPARK-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12505: - Target Version/s: 2.0.0 > Pushdown a Limit on top of an Outer-Join >

[jira] [Commented] (SPARK-12531) Add median and mode to Summary statistics

[ https://issues.apache.org/jira/browse/SPARK-12531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072386#comment-15072386 ] Gaurav Kumar commented on SPARK-12531: -- [~srowen], I agree these are not exactly difficult to

[jira] [Created] (SPARK-12533) hiveContext.table() throws the wrong exception

Michael Armbrust created SPARK-12533: Summary: hiveContext.table() throws the wrong exception Key: SPARK-12533 URL: https://issues.apache.org/jira/browse/SPARK-12533 Project: Spark Issue

[jira] [Assigned] (SPARK-11559) Make `runs` no effect in k-means

[ https://issues.apache.org/jira/browse/SPARK-11559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11559: Assignee: Apache Spark > Make `runs` no effect in k-means >

[jira] [Commented] (SPARK-11560) Optimize KMeans implementation

[ https://issues.apache.org/jira/browse/SPARK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072403#comment-15072403 ] Apache Spark commented on SPARK-11560: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11559) Make `runs` no effect in k-means

[ https://issues.apache.org/jira/browse/SPARK-11559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11559: Assignee: (was: Apache Spark) > Make `runs` no effect in k-means >

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072254#comment-15072254 ] Apache Spark commented on SPARK-12363: -- User 'nongli' has created a pull request for this issue:

[jira] [Commented] (SPARK-12533) hiveContext.table() throws the wrong exception

[ https://issues.apache.org/jira/browse/SPARK-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072447#comment-15072447 ] Thomas Sebastian commented on SPARK-12533: -- Hi Michael,Can you tell the scenario to replicate

[jira] [Comment Edited] (SPARK-12531) Add median and mode to Summary statistics

[ https://issues.apache.org/jira/browse/SPARK-12531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072386#comment-15072386 ] Gaurav Kumar edited comment on SPARK-12531 at 12/28/15 3:36 AM:

[jira] [Commented] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072402#comment-15072402 ] Sun Rui commented on SPARK-12239: - To have a formal fix for this issue, we can have two ways: 1. Similar

[jira] [Resolved] (SPARK-12520) Python API dataframe join returns wrong results on outer join

[ https://issues.apache.org/jira/browse/SPARK-12520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12520. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10477

[jira] [Updated] (SPARK-12520) Python API dataframe join returns wrong results on outer join

[ https://issues.apache.org/jira/browse/SPARK-12520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12520: --- Assignee: Xiao Li > Python API dataframe join returns wrong results on outer join >

[jira] [Updated] (SPARK-12520) Python API dataframe join returns wrong results on outer join

[ https://issues.apache.org/jira/browse/SPARK-12520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12520: --- Fix Version/s: 1.6.0 > Python API dataframe join returns wrong results on outer join >

[jira] [Updated] (SPARK-12520) Python API dataframe join returns wrong results on outer join

[ https://issues.apache.org/jira/browse/SPARK-12520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12520: --- Fix Version/s: 1.5.3 > Python API dataframe join returns wrong results on outer join >

[jira] [Created] (SPARK-12535) Generating scaladoc using sbt fails for network-common and catalyst modules

Jacek Laskowski created SPARK-12535: --- Summary: Generating scaladoc using sbt fails for network-common and catalyst modules Key: SPARK-12535 URL: https://issues.apache.org/jira/browse/SPARK-12535

[jira] [Commented] (SPARK-12535) Generating scaladoc using sbt fails for network-common and catalyst modules

[ https://issues.apache.org/jira/browse/SPARK-12535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072501#comment-15072501 ] Jacek Laskowski commented on SPARK-12535: - I fixed the others, but this one has no solution yet:

[jira] [Commented] (SPARK-12535) Generating scaladoc using sbt fails for network-common and catalyst modules

[ https://issues.apache.org/jira/browse/SPARK-12535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072525#comment-15072525 ] Herman van Hovell commented on SPARK-12535: --- This is caused by the same problem as SPARK-12530.

[jira] [Created] (SPARK-12531) Add median and mode to Summary statistics

Gaurav Kumar created SPARK-12531: Summary: Add median and mode to Summary statistics Key: SPARK-12531 URL: https://issues.apache.org/jira/browse/SPARK-12531 Project: Spark Issue Type: