[jira] [Commented] (SPARK-6624) Convert filters into CNF for data sources

[ https://issues.apache.org/jira/browse/SPARK-6624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069434#comment-15069434 ] Apache Spark commented on SPARK-6624: - User 'liancheng' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12496) Is thriftServer of spark 1.5.2 incompatible with hive-0.13.1-cdh5.3.3？

[ https://issues.apache.org/jira/browse/SPARK-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12496. --- Resolution: Not A Problem It's best to match versions to be sure, but I don't think this is a

[jira] [Commented] (SPARK-12492) SQL page of Spark-sql is always blank

[ https://issues.apache.org/jira/browse/SPARK-12492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069448#comment-15069448 ] Sean Owen commented on SPARK-12492: --- I can't reproduce this. Do you have any more detail? > SQL page

[jira] [Commented] (SPARK-12493) Can't open "details" span of ExecutionsPage in IE11

[ https://issues.apache.org/jira/browse/SPARK-12493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069450#comment-15069450 ] Sean Owen commented on SPARK-12493: --- Same, do you have any more info? is it a JS error? > Can't open

[jira] [Resolved] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11045. --- Resolution: Won't Fix > Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to

[jira] [Commented] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069453#comment-15069453 ] Sean Owen commented on SPARK-11045: --- Yeah, that's kind of the problem: you're wanting to put this in

[jira] [Commented] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069474#comment-15069474 ] Dibyendu Bhattacharya commented on SPARK-11045: --- Hi Sean, I think you misunderstood my

[jira] [Commented] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069482#comment-15069482 ] Sean Owen commented on SPARK-11045: --- Cody's comments argue that it's not as better as you say, and you

[jira] [Created] (SPARK-12498) BooleanSimplification cleanup

Cheng Lian created SPARK-12498: -- Summary: BooleanSimplification cleanup Key: SPARK-12498 URL: https://issues.apache.org/jira/browse/SPARK-12498 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12498) BooleanSimplification cleanup

[ https://issues.apache.org/jira/browse/SPARK-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12498: Assignee: Apache Spark (was: Cheng Lian) > BooleanSimplification cleanup >

[jira] [Updated] (SPARK-12472) OOM when sort a table and save as parquet

[ https://issues.apache.org/jira/browse/SPARK-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12472: -- Component/s: SQL > OOM when sort a table and save as parquet >

[jira] [Updated] (SPARK-12474) support deserialization for physical plan and hive logical plan from JSON string

[ https://issues.apache.org/jira/browse/SPARK-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12474: -- Component/s: SQL > support deserialization for physical plan and hive logical plan from JSON > string

[jira] [Assigned] (SPARK-12500) Fix Tachyon deprecations; pull Tachyon dependency into one class

[ https://issues.apache.org/jira/browse/SPARK-12500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12500: Assignee: Sean Owen (was: Apache Spark) > Fix Tachyon deprecations; pull Tachyon

[jira] [Assigned] (SPARK-12500) Fix Tachyon deprecations; pull Tachyon dependency into one class

[ https://issues.apache.org/jira/browse/SPARK-12500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12500: Assignee: Apache Spark (was: Sean Owen) > Fix Tachyon deprecations; pull Tachyon

[jira] [Created] (SPARK-12499) make_distribution should not override MAVEN_OPTS

Adrian Bridgett created SPARK-12499: --- Summary: make_distribution should not override MAVEN_OPTS Key: SPARK-12499 URL: https://issues.apache.org/jira/browse/SPARK-12499 Project: Spark Issue

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069720#comment-15069720 ] Brian London commented on SPARK-12453: -- To be clear then, the two changes are 1) remove the explicit

[jira] [Assigned] (SPARK-12481) Remove usage of Hadoop deprecated APIs and reflection that supported 1.x

[ https://issues.apache.org/jira/browse/SPARK-12481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12481: Assignee: Apache Spark (was: Sean Owen) > Remove usage of Hadoop deprecated APIs and

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069763#comment-15069763 ] Sean Owen commented on SPARK-12453: --- For the issue here, all you need is to remove the explicit SDK

[jira] [Commented] (SPARK-12498) BooleanSimplification cleanup

[ https://issues.apache.org/jira/browse/SPARK-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069616#comment-15069616 ] Apache Spark commented on SPARK-12498: -- User 'liancheng' has created a pull request for this issue:

[jira] [Commented] (SPARK-12499) make_distribution should not override MAVEN_OPTS

[ https://issues.apache.org/jira/browse/SPARK-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069777#comment-15069777 ] Adrian Bridgett commented on SPARK-12499: - https://github.com/apache/spark/pull/10448 is the

[jira] [Created] (SPARK-12500) Fix Tachyon deprecations; pull Tachyon dependency into one class

Sean Owen created SPARK-12500: - Summary: Fix Tachyon deprecations; pull Tachyon dependency into one class Key: SPARK-12500 URL: https://issues.apache.org/jira/browse/SPARK-12500 Project: Spark

[jira] [Assigned] (SPARK-12499) make_distribution should not override MAVEN_OPTS

[ https://issues.apache.org/jira/browse/SPARK-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12499: Assignee: Apache Spark > make_distribution should not override MAVEN_OPTS >

[jira] [Assigned] (SPARK-12499) make_distribution should not override MAVEN_OPTS

[ https://issues.apache.org/jira/browse/SPARK-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12499: Assignee: (was: Apache Spark) > make_distribution should not override MAVEN_OPTS >

[jira] [Commented] (SPARK-12499) make_distribution should not override MAVEN_OPTS

[ https://issues.apache.org/jira/browse/SPARK-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069806#comment-15069806 ] Apache Spark commented on SPARK-12499: -- User 'abridgett' has created a pull request for this issue:

[jira] [Commented] (SPARK-10363) DataframeWriter write failed when multi applications write the same partitioned directory

[ https://issues.apache.org/jira/browse/SPARK-10363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069786#comment-15069786 ] Cagatay Kavukcuoglu commented on SPARK-10363: - I ran into this as well, writing to the same

[jira] [Commented] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069953#comment-15069953 ] Sean Owen commented on SPARK-12502: --- Should be easy to fix; there's no need to parse the "_xx" update

[jira] [Resolved] (SPARK-1253) Need to load mapred-site.xml for reading mapreduce.application.classpath

[ https://issues.apache.org/jira/browse/SPARK-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1253. -- Resolution: Cannot Reproduce > Need to load mapred-site.xml for reading mapreduce.application.classpath

[jira] [Created] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

Suresh Thalamati created SPARK-12504: Summary: JDBC data source credentials are not masked in the data frame explain output. Key: SPARK-12504 URL: https://issues.apache.org/jira/browse/SPARK-12504

[jira] [Commented] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070002#comment-15070002 ] Suresh Thalamati commented on SPARK-12504: -- I am testing the fix for this issue , will post the

[jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources

[ https://issues.apache.org/jira/browse/SPARK-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070062#comment-15070062 ] Santiago M. Mola commented on SPARK-12449: -- The physical plan would not be consumed by data

[jira] [Commented] (SPARK-12459) Add ExpressionDescription to string functions

[ https://issues.apache.org/jira/browse/SPARK-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070061#comment-15070061 ] Huaxin Gao commented on SPARK-12459: Thanks for the suggestion. I will change and have a PR soon.

[jira] [Commented] (SPARK-11576) [SQL] Incorrect results when using the nested self-join

[ https://issues.apache.org/jira/browse/SPARK-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069921#comment-15069921 ] Apache Spark commented on SPARK-11576: -- User 'yzhou2001' has created a pull request for this issue:

[jira] [Created] (SPARK-12505) Pushdown a Limit on top of a Outer-Join

Xiao Li created SPARK-12505: --- Summary: Pushdown a Limit on top of a Outer-Join Key: SPARK-12505 URL: https://issues.apache.org/jira/browse/SPARK-12505 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12505) Pushdown a Limit on top of an Outer-Join

[ https://issues.apache.org/jira/browse/SPARK-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070012#comment-15070012 ] Xiao Li commented on SPARK-12505: - I am working on it. Thanks! > Pushdown a Limit on top of an

[jira] [Commented] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070054#comment-15070054 ] Suresh Thalamati commented on SPARK-12504: -- Pull Request:

[jira] [Created] (SPARK-12503) Pushdown a Limit on top of a Union

Xiao Li created SPARK-12503: --- Summary: Pushdown a Limit on top of a Union Key: SPARK-12503 URL: https://issues.apache.org/jira/browse/SPARK-12503 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12505) Pushdown a Limit on top of an Outer-Join

[ https://issues.apache.org/jira/browse/SPARK-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12505: Summary: Pushdown a Limit on top of an Outer-Join (was: Pushdown a Limit on top of a Outer-Join) >

[jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources

[ https://issues.apache.org/jira/browse/SPARK-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070027#comment-15070027 ] Reynold Xin commented on SPARK-12449: - This is great, but our internal logical/physical plan

[jira] [Created] (SPARK-12506) Push down WHERE clause arithmetic operator to JDBC layer

Huaxin Gao created SPARK-12506: -- Summary: Push down WHERE clause arithmetic operator to JDBC layer Key: SPARK-12506 URL: https://issues.apache.org/jira/browse/SPARK-12506 Project: Spark Issue

[jira] [Updated] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12504: Description: Currently JDBC data source credentials are not masked in the explain output. This

[jira] [Created] (SPARK-12507) Update Streaming configurations for 1.6

Shixiong Zhu created SPARK-12507: Summary: Update Streaming configurations for 1.6 Key: SPARK-12507 URL: https://issues.apache.org/jira/browse/SPARK-12507 Project: Spark Issue Type:

[jira] [Created] (SPARK-12501) spark fails to build with mesos-0.26.0 (secret)

Adrian Bridgett created SPARK-12501: --- Summary: spark fails to build with mesos-0.26.0 (secret) Key: SPARK-12501 URL: https://issues.apache.org/jira/browse/SPARK-12501 Project: Spark Issue

[jira] [Commented] (SPARK-12459) Add ExpressionDescription to string functions

[ https://issues.apache.org/jira/browse/SPARK-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069904#comment-15069904 ] Yin Huai commented on SPARK-12459: -- For base64, maybe using {{_FUNC_(binary)}} will be better? For the

[jira] [Created] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

Kazuaki Ishizaki created SPARK-12502: Summary: Script /dev/run-tests fails when IBM Java is used Key: SPARK-12502 URL: https://issues.apache.org/jira/browse/SPARK-12502 Project: Spark

[jira] [Assigned] (SPARK-12503) Pushdown a Limit on top of a Union

[ https://issues.apache.org/jira/browse/SPARK-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12503: Assignee: Apache Spark > Pushdown a Limit on top of a Union >

[jira] [Commented] (SPARK-12503) Pushdown a Limit on top of a Union

[ https://issues.apache.org/jira/browse/SPARK-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069989#comment-15069989 ] Apache Spark commented on SPARK-12503: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12503) Pushdown a Limit on top of a Union

[ https://issues.apache.org/jira/browse/SPARK-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12503: Assignee: (was: Apache Spark) > Pushdown a Limit on top of a Union >

[jira] [Commented] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069991#comment-15069991 ] Kazuaki Ishizaki commented on SPARK-12502: -- Yes, I will do it. I will change a format of

[jira] [Commented] (SPARK-12506) Push down WHERE clause arithmetic operator to JDBC layer

[ https://issues.apache.org/jira/browse/SPARK-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070058#comment-15070058 ] Huaxin Gao commented on SPARK-12506: I am working on this and will have a PR soon. > Push down

[jira] [Assigned] (SPARK-12507) Update Streaming configurations for 1.6

[ https://issues.apache.org/jira/browse/SPARK-12507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12507: Assignee: Apache Spark > Update Streaming configurations for 1.6 >

[jira] [Assigned] (SPARK-12507) Update Streaming configurations for 1.6

[ https://issues.apache.org/jira/browse/SPARK-12507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12507: Assignee: (was: Apache Spark) > Update Streaming configurations for 1.6 >

[jira] [Commented] (SPARK-12426) Docker JDBC integration tests are failing again

[ https://issues.apache.org/jira/browse/SPARK-12426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070064#comment-15070064 ] Josh Rosen commented on SPARK-12426: This is probably an environment / configuration issue. These

[jira] [Commented] (SPARK-1253) Need to load mapred-site.xml for reading mapreduce.application.classpath

[ https://issues.apache.org/jira/browse/SPARK-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069890#comment-15069890 ] Devaraj K commented on SPARK-1253: -- Thanks [~srowen] for letting me know. I tried to reproduce it but

[jira] [Commented] (SPARK-12501) spark fails to build with mesos-0.26.0 (secret)

[ https://issues.apache.org/jira/browse/SPARK-12501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069975#comment-15069975 ] Sean Owen commented on SPARK-12501: --- Yeah, not sure what to do about that since it can only be

[jira] [Updated] (SPARK-12503) Pushdown a Limit on top of a Union

[ https://issues.apache.org/jira/browse/SPARK-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12503: Description: "Rule that applies to a Limit on top of a Union. The original Limit won't go away after

[jira] [Updated] (SPARK-12411) Reconsider executor heartbeats rpc timeout

[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12411: -- Target Version/s: 1.6.1, 2.0.0 (was: 2.0.0) > Reconsider executor heartbeats rpc timeout >

[jira] [Updated] (SPARK-12411) Reconsider executor heartbeats rpc timeout

[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12411: -- Fix Version/s: 1.6.1 > Reconsider executor heartbeats rpc timeout >

[jira] [Updated] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-12511: Description: Spark streaming application when configured with checkpointing is filling driver's

[jira] [Assigned] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12502: Assignee: (was: Apache Spark) > Script /dev/run-tests fails when IBM Java is used >

[jira] [Created] (SPARK-12515) Minor clarification on DataFrameReader.jdbc doc

Felix Cheung created SPARK-12515: Summary: Minor clarification on DataFrameReader.jdbc doc Key: SPARK-12515 URL: https://issues.apache.org/jira/browse/SPARK-12515 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12356) Implement unhandledFilter interface for ORC

[ https://issues.apache.org/jira/browse/SPARK-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070344#comment-15070344 ] Hyukjin Kwon commented on SPARK-12356: -- [~yhuai] I think this should not be fixed as ORC filters

[jira] [Created] (SPARK-12512) WithColumn does not work on multiple column with special character

JO EE created SPARK-12512: - Summary: WithColumn does not work on multiple column with special character Key: SPARK-12512 URL: https://issues.apache.org/jira/browse/SPARK-12512 Project: Spark Issue

[jira] [Updated] (SPARK-12512) WithColumn does not work on multiple column with special character

[ https://issues.apache.org/jira/browse/SPARK-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JO EE updated SPARK-12512: -- Description: Just for simplicity I am using Scalaide scala-worksheet to show the problem the withColumn could

[jira] [Commented] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070543#comment-15070543 ] Apache Spark commented on SPARK-12502: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12502) Script /dev/run-tests fails when IBM Java is used

[ https://issues.apache.org/jira/browse/SPARK-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12502: Assignee: Apache Spark > Script /dev/run-tests fails when IBM Java is used >

[jira] [Commented] (SPARK-12513) SocketReceiver hang in Netcat example

[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070550#comment-15070550 ] Apache Spark commented on SPARK-12513: -- User 'guoxu1231' has created a pull request for this issue:

[jira] [Commented] (SPARK-12513) SocketReceiver hang in Netcat example

[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070548#comment-15070548 ] Shawn Guo commented on SPARK-12513: --- Close client side socket connection before restart socket

[jira] [Assigned] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-10359: -- Assignee: Josh Rosen (was: Patrick Wendell) > Enumerate Spark's dependencies in a file and

[jira] [Resolved] (SPARK-12499) make_distribution should not override MAVEN_OPTS

[ https://issues.apache.org/jira/browse/SPARK-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12499. Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Commented] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070500#comment-15070500 ] Timothy Hunter commented on SPARK-12247: Sorry for the delay. That sounds great! Let me know when

[jira] [Updated] (SPARK-12513) SocketReceiver hang in Netcat example

[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-12513: -- Component/s: Streaming > SocketReceiver hang in Netcat example > -

[jira] [Updated] (SPARK-12513) SocketReceiver hang in Netcat example

[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-12513: -- Description: I add a SocketReceiver test based on the NetworkWordCount. Using pipeline and tail the

[jira] [Updated] (SPARK-12513) SocketReceiver hang in Netcat example

[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-12513: -- Description: I add a SocketReceiver test based on the NetworkWordCount. Using pipeline and tail the

[jira] [Assigned] (SPARK-12513) SocketReceiver hang in Netcat example

[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12513: Assignee: (was: Apache Spark) > SocketReceiver hang in Netcat example >

[jira] [Assigned] (SPARK-12513) SocketReceiver hang in Netcat example

[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12513: Assignee: Apache Spark > SocketReceiver hang in Netcat example >

[jira] [Assigned] (SPARK-12375) VectorIndexer: allow unknown categories

[ https://issues.apache.org/jira/browse/SPARK-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12375: Assignee: Apache Spark > VectorIndexer: allow unknown categories >

[jira] [Commented] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070325#comment-15070325 ] Apache Spark commented on SPARK-10359: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Updated] (SPARK-12499) make_distribution should not override MAVEN_OPTS

[ https://issues.apache.org/jira/browse/SPARK-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12499: --- Assignee: Adrian Bridgett > make_distribution should not override MAVEN_OPTS >

[jira] [Commented] (SPARK-12356) Implement unhandledFilter interface for ORC

[ https://issues.apache.org/jira/browse/SPARK-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070346#comment-15070346 ] Yin Huai commented on SPARK-12356: -- oh, yes. Let's close it. ORC does not apply filter to every row. >

[jira] [Resolved] (SPARK-12356) Implement unhandledFilter interface for ORC

[ https://issues.apache.org/jira/browse/SPARK-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12356. -- Resolution: Invalid > Implement unhandledFilter interface for ORC >

[jira] [Created] (SPARK-12513) SocketReceiver hang in Netcat example

Shawn Guo created SPARK-12513: - Summary: SocketReceiver hang in Netcat example Key: SPARK-12513 URL: https://issues.apache.org/jira/browse/SPARK-12513 Project: Spark Issue Type: Bug Affects

[jira] [Assigned] (SPARK-12515) Minor clarification on DataFrameReader.jdbc doc

[ https://issues.apache.org/jira/browse/SPARK-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12515: Assignee: Apache Spark > Minor clarification on DataFrameReader.jdbc doc >

[jira] [Commented] (SPARK-12262) describe extended doesn't return table on detail info tabled stored as PARQUET format

[ https://issues.apache.org/jira/browse/SPARK-12262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070503#comment-15070503 ] Xiu (Joe) Guo commented on SPARK-12262: --- The property

[jira] [Created] (SPARK-12514) Spark MetricsSystem can fill disks/cause OOMs when using GangliaSink

Aaron Tokhy created SPARK-12514: --- Summary: Spark MetricsSystem can fill disks/cause OOMs when using GangliaSink Key: SPARK-12514 URL: https://issues.apache.org/jira/browse/SPARK-12514 Project: Spark

[jira] [Assigned] (SPARK-12499) make_distribution should not override MAVEN_OPTS

[ https://issues.apache.org/jira/browse/SPARK-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12499: Assignee: (was: Apache Spark) > make_distribution should not override MAVEN_OPTS >

[jira] [Updated] (SPARK-12420) Have a built-in CSV data source implementation

[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-12420: --- Attachment: Built-in CSV datasource in Spark.pdf Design doc for submitting spark-csv as a

[jira] [Assigned] (SPARK-12505) Pushdown a Limit on top of an Outer-Join

[ https://issues.apache.org/jira/browse/SPARK-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12505: Assignee: Apache Spark > Pushdown a Limit on top of an Outer-Join >

[jira] [Updated] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-12511: Description: Spark streaming application when configured with checkpointing is filling driver's

[jira] [Commented] (SPARK-12505) Pushdown a Limit on top of an Outer-Join

[ https://issues.apache.org/jira/browse/SPARK-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070115#comment-15070115 ] Apache Spark commented on SPARK-12505: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-12420) Have a built-in CSV data source implementation

[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070147#comment-15070147 ] Hossein Falaki edited comment on SPARK-12420 at 12/23/15 8:28 PM: -- Just

[jira] [Updated] (SPARK-7995) Remove AkkaRpcEnv and remove Akka from the dependencies of Core

[ https://issues.apache.org/jira/browse/SPARK-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-7995: Summary: Remove AkkaRpcEnv and remove Akka from the dependencies of Core (was: Move AkkaRpcEnv to

[jira] [Created] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

Antony Mayi created SPARK-12511: --- Summary: streaming driver with checkpointing unable to finalize leading to OOM Key: SPARK-12511 URL: https://issues.apache.org/jira/browse/SPARK-12511 Project: Spark

[jira] [Assigned] (SPARK-7995) Remove AkkaRpcEnv and remove Akka from the dependencies of Core

[ https://issues.apache.org/jira/browse/SPARK-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7995: --- Assignee: Apache Spark > Remove AkkaRpcEnv and remove Akka from the dependencies of Core >

[jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources

[ https://issues.apache.org/jira/browse/SPARK-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070088#comment-15070088 ] Yan commented on SPARK-12449: - To push down map-side (partial) ops, Physical Plan would need to be checked I

[jira] [Commented] (SPARK-12449) Pushing down arbitrary logical plans to data sources

[ https://issues.apache.org/jira/browse/SPARK-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070135#comment-15070135 ] Yan commented on SPARK-12449: - Conceivably, if only logical plan is used, the Spark SQL execution would

[jira] [Created] (SPARK-12509) Fix error messages for DataFrame correlation and covariance

Narine Kokhlikyan created SPARK-12509: - Summary: Fix error messages for DataFrame correlation and covariance Key: SPARK-12509 URL: https://issues.apache.org/jira/browse/SPARK-12509 Project: Spark

[jira] [Updated] (SPARK-12509) Fix error messages for DataFrame correlation and covariance

[ https://issues.apache.org/jira/browse/SPARK-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-12509: -- Description: Currently, when we call corr or cov on dataframe with invalid input we

[jira] [Updated] (SPARK-12510) Refactor ActorReceiver to support Java

[ https://issues.apache.org/jira/browse/SPARK-12510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12510: - Issue Type: Improvement (was: Documentation) > Refactor ActorReceiver to support Java >

[jira] [Commented] (SPARK-12509) Fix error messages for DataFrame correlation and covariance

[ https://issues.apache.org/jira/browse/SPARK-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070190#comment-15070190 ] Apache Spark commented on SPARK-12509: -- User 'NarineK' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12509) Fix error messages for DataFrame correlation and covariance

[ https://issues.apache.org/jira/browse/SPARK-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12509: Assignee: Apache Spark > Fix error messages for DataFrame correlation and covariance >

  1   2   >