[jira] [Updated] (SPARK-12153) Word2Vec uses a fixed length for sentences which is not reasonable for reality, and similarity functions and fields are not accessible

[ https://issues.apache.org/jira/browse/SPARK-12153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YongGang Cao updated SPARK-12153: - Description: sentence boundary matters for sliding window, we shouldn't train model from a windo

[jira] [Updated] (SPARK-12153) Word2Vec uses a fixed length for sentences which is not reasonable for reality, and similarity functions and fields are not accessible

[ https://issues.apache.org/jira/browse/SPARK-12153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YongGang Cao updated SPARK-12153: - Issue Type: Bug (was: Improvement) > Word2Vec uses a fixed length for sentences which is not rea

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15065263#comment-15065263 ] Shivaram Venkataraman commented on SPARK-12360: --- Yeah we can return a integ

[jira] [Commented] (SPARK-12339) NullPointerException on stage kill from web UI

[ https://issues.apache.org/jira/browse/SPARK-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15065225#comment-15065225 ] Alex Bozarth commented on SPARK-12339: -- I have a solution ready, just need to test i

[jira] [Resolved] (SPARK-12091) [PySpark] Removal of the JAVA-specific deserialized storage levels

[ https://issues.apache.org/jira/browse/SPARK-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12091. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10092 [https://github.

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15065207#comment-15065207 ] Felix Cheung commented on SPARK-12360: -- +1 string. How would parse error (eg. should

[jira] [Updated] (SPARK-12437) Reserved words (like table) throws error when writing a data frame to JDBC

[ https://issues.apache.org/jira/browse/SPARK-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12437: Labels: starter (was: ) > Reserved words (like table) throws error when writing a data frame to JD

[jira] [Created] (SPARK-12437) Reserved words (like table) throws error when writing a data frame to JDBC

Reynold Xin created SPARK-12437: --- Summary: Reserved words (like table) throws error when writing a data frame to JDBC Key: SPARK-12437 URL: https://issues.apache.org/jira/browse/SPARK-12437 Project: Spa

[jira] [Created] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

Reynold Xin created SPARK-12436: --- Summary: If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType Key: SPARK-12436 URL: https://issues.apache.org/jira/browse/SPARK-124

[jira] [Updated] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

[ https://issues.apache.org/jira/browse/SPARK-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12436: Labels: starter (was: ) > If all values of a JSON field is null, JSON's inferSchema should return

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15065047#comment-15065047 ] Andrew Or commented on SPARK-12345: --- For those who are following: There are 4 patches

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12413: -- Fix Version/s: (was: 2.0.0) > Mesos ZK persistence throws a NotSerializableException >

[jira] [Resolved] (SPARK-12435) Installing Spark

[ https://issues.apache.org/jira/browse/SPARK-12435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12435. Resolution: Duplicate See if the workaround works for you: https://issues.apache.org/jira/b

[jira] [Resolved] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11097. --- Resolution: Fixed Fix Version/s: 2.0.0 > Add connection established callback to lower level RP

[jira] [Commented] (SPARK-7301) Issue with duplicated fields in interpreted json schemas

[ https://issues.apache.org/jira/browse/SPARK-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15065021#comment-15065021 ] Simeon Simeonov commented on SPARK-7301: It would be nice if using backticks to re

[jira] [Resolved] (SPARK-12411) Reconsider executor heartbeats rpc timeout

[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12411. --- Resolution: Fixed Assignee: Nong Li Fix Version/s: 2.0.0 Target Version/s

[jira] [Created] (SPARK-12435) Installing Spark

Amit created SPARK-12435: Summary: Installing Spark Key: SPARK-12435 URL: https://issues.apache.org/jira/browse/SPARK-12435 Project: Spark Issue Type: Bug Components: Build Affects Vers

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12429: Assignee: Apache Spark (was: Shixiong Zhu) > Update documentation to show how to use accu

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12429: Assignee: Shixiong Zhu (was: Apache Spark) > Update documentation to show how to use accu

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-12429: Assignee: Shixiong Zhu (was: Apache Spark) > Update documentation to show how to use accu

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12429: Assignee: Apache Spark (was: Shixiong Zhu) > Update documentation to show how to use accu

[jira] [Resolved] (SPARK-11985) Update Spark Streaming - Kinesis Library Documentation regarding data de-aggregation and message handler

[ https://issues.apache.org/jira/browse/SPARK-11985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-11985. -- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 1.6.0 > Update Spark Str

[jira] [Created] (SPARK-12434) Make parts of the streaming testing API public to assist developers making their own tests.

holdenk created SPARK-12434: --- Summary: Make parts of the streaming testing API public to assist developers making their own tests. Key: SPARK-12434 URL: https://issues.apache.org/jira/browse/SPARK-12434 Pro

[jira] [Created] (SPARK-12433) Make parts of the core Spark testing API public to assist developers making their own tests.

holdenk created SPARK-12433: --- Summary: Make parts of the core Spark testing API public to assist developers making their own tests. Key: SPARK-12433 URL: https://issues.apache.org/jira/browse/SPARK-12433 Pr

[jira] [Created] (SPARK-12432) Make parts of the Spark testing API public to assist developers making their own tests.

holdenk created SPARK-12432: --- Summary: Make parts of the Spark testing API public to assist developers making their own tests. Key: SPARK-12432 URL: https://issues.apache.org/jira/browse/SPARK-12432 Project

[jira] [Updated] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11097: -- Assignee: Shixiong Zhu (was: Apache Spark) > Add connection established callback to lower level RPC la

[jira] [Updated] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12374: Description: Creating an actual logical/physical operator for range for matching the performance of RDD Ra

[jira] [Resolved] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12404. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10357 [htt

[jira] [Created] (SPARK-12431) add local checkpointing to GraphX

Edward Seidl created SPARK-12431: Summary: add local checkpointing to GraphX Key: SPARK-12431 URL: https://issues.apache.org/jira/browse/SPARK-12431 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-3821) Develop an automated way of creating Spark images (AMI, Docker, and others)

[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203280#comment-14203280 ] Nicholas Chammas edited comment on SPARK-3821 at 12/18/15 9:08 PM: -

[jira] [Updated] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

[ https://issues.apache.org/jira/browse/SPARK-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12365: -- Target Version/s: 2.0.0 (was: 1.6.1, 2.0.0) > Use ShutdownHookManager where Runtime.getRuntime.addShut

[jira] [Updated] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

[ https://issues.apache.org/jira/browse/SPARK-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12365: -- Fix Version/s: (was: 1.6.1) > Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is

[jira] [Assigned] (SPARK-12425) DStream union optimisation

[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12425: Assignee: Apache Spark > DStream union optimisation > -- > >

[jira] [Assigned] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12409: Assignee: (was: Apache Spark) > JDBC AND operator push down > ---

[jira] [Assigned] (SPARK-12425) DStream union optimisation

[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12425: Assignee: (was: Apache Spark) > DStream union optimisation > -

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064744#comment-15064744 ] Jo Voordeckers commented on SPARK-11327: This PR is now superseded by this one ag

[jira] [Assigned] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12409: Assignee: Apache Spark > JDBC AND operator push down > > >

[jira] [Commented] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064742#comment-15064742 ] Apache Spark commented on SPARK-12409: -- User 'huaxingao' has created a pull request

[jira] [Created] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

Fede Bar created SPARK-12430: Summary: Temporary folders do not get deleted after Task completes causing problems with disk space. Key: SPARK-12430 URL: https://issues.apache.org/jira/browse/SPARK-12430 P

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12429: Assignee: Shixiong Zhu (was: Apache Spark) > Update documentation to show how to use accu

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12429: Assignee: Apache Spark (was: Shixiong Zhu) > Update documentation to show how to use accu

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064664#comment-15064664 ] Matt Pollock commented on SPARK-6817: - Will this only support UDFs that operate on a f

[jira] [Created] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

Shixiong Zhu created SPARK-12429: Summary: Update documentation to show how to use accumulators and broadcasts with Spark Streaming Key: SPARK-12429 URL: https://issues.apache.org/jira/browse/SPARK-12429

[jira] [Commented] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064628#comment-15064628 ] shane knapp commented on SPARK-12427: - if we NEED to store for longer than 2 weeks, w

[jira] [Commented] (SPARK-12428) Write a script to run all PySpark MLlib examples for testing

[ https://issues.apache.org/jira/browse/SPARK-12428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064610#comment-15064610 ] holdenk commented on SPARK-12428: - I can start working on this a bit over the holidays :)

[jira] [Created] (SPARK-12428) Write a script to run all PySpark MLlib examples for testing

holdenk created SPARK-12428: --- Summary: Write a script to run all PySpark MLlib examples for testing Key: SPARK-12428 URL: https://issues.apache.org/jira/browse/SPARK-12428 Project: Spark Issue Typ

[jira] [Commented] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064572#comment-15064572 ] shane knapp commented on SPARK-12427: - [~joshrosen] > spark builds filling up jenkin

[jira] [Commented] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064568#comment-15064568 ] Sean Owen commented on SPARK-12427: --- I doubt we really need build history for more than

[jira] [Updated] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-12427: Attachment: graph.png disk usage over the past year, for lols. > spark builds filling up jenkins'

[jira] [Updated] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-12427: Attachment: jenkins_disk_usage.txt > spark builds filling up jenkins' disk > --

[jira] [Created] (SPARK-12427) spark builds filling up jenkins' disk

shane knapp created SPARK-12427: --- Summary: spark builds filling up jenkins' disk Key: SPARK-12427 URL: https://issues.apache.org/jira/browse/SPARK-12427 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12372) Document limitations of MLlib local linear algebra

[ https://issues.apache.org/jira/browse/SPARK-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064476#comment-15064476 ] Christos Iraklis Tsatsoulis commented on SPARK-12372: - You are very w

[jira] [Assigned] (SPARK-12218) Invalid splitting of nested AND expressions in Data Source filter API

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-12218: Assignee: Yin Huai > Invalid splitting of nested AND expressions in Data Source filter API > -

[jira] [Resolved] (SPARK-12218) Invalid splitting of nested AND expressions in Data Source filter API

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12218. -- Resolution: Fixed Fix Version/s: 1.6.0 1.5.3 2.0.0 Issue r

[jira] [Commented] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

[ https://issues.apache.org/jira/browse/SPARK-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064447#comment-15064447 ] Apache Spark commented on SPARK-7142: - User 'gatorsmile' has created a pull request fo

[jira] [Created] (SPARK-12426) Docker JDBC integration tests are failing again

Mark Grover created SPARK-12426: --- Summary: Docker JDBC integration tests are failing again Key: SPARK-12426 URL: https://issues.apache.org/jira/browse/SPARK-12426 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-12341) The "comment" field of DESCRIBE result set should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12341. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > The "co

[jira] [Resolved] (SPARK-12342) Corr (Pearson correlation) should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12342. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > Corr (P

[jira] [Assigned] (SPARK-12341) The "comment" field of DESCRIBE result set should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12341: -- Assignee: Davies Liu (was: Apache Spark) > The "comment" field of DESCRIBE result set should

[jira] [Assigned] (SPARK-12342) Corr (Pearson correlation) should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12342: -- Assignee: Davies Liu (was: Cheng Lian) > Corr (Pearson correlation) should be nullable >

[jira] [Resolved] (SPARK-12336) Outer join using multiple columns results in wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12336. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > Outer j

[jira] [Assigned] (SPARK-12336) Outer join using multiple columns results in wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12336: -- Assignee: Davies Liu (was: Cheng Lian) > Outer join using multiple columns results in wrong n

[jira] [Resolved] (SPARK-12335) CentralMomentAgg should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12335. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > Central

[jira] [Assigned] (SPARK-12335) CentralMomentAgg should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12335: -- Assignee: Davies Liu (was: Apache Spark) > CentralMomentAgg should be nullable >

[jira] [Updated] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12409: - Target Version/s: (was: 1.6.0) > JDBC AND operator push down > > >

[jira] [Updated] (SPARK-12391) JDBC OR operator push down

[ https://issues.apache.org/jira/browse/SPARK-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12391: - Target Version/s: (was: 1.6.0) > JDBC OR operator push down > -- > >

[jira] [Commented] (SPARK-12425) DStream union optimisation

[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064376#comment-15064376 ] Apache Spark commented on SPARK-12425: -- User 'gpoulin' has created a pull request fo

[jira] [Resolved] (SPARK-12054) Consider nullable in codegen

[ https://issues.apache.org/jira/browse/SPARK-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12054. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10333 [https://github.

[jira] [Created] (SPARK-12425) DStream union optimisation

Guillaume Poulin created SPARK-12425: Summary: DStream union optimisation Key: SPARK-12425 URL: https://issues.apache.org/jira/browse/SPARK-12425 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12353: Assignee: (was: Apache Spark) > wrong output for countByValue and countByValueAndWindo

[jira] [Assigned] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12353: Assignee: Apache Spark > wrong output for countByValue and countByValueAndWindow > ---

[jira] [Updated] (SPARK-11619) cannot use UDTF in DataFrame.selectExpr

[ https://issues.apache.org/jira/browse/SPARK-11619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11619: - Assignee: Dilip Biswal > cannot use UDTF in DataFrame.selectExpr > --

[jira] [Resolved] (SPARK-11619) cannot use UDTF in DataFrame.selectExpr

[ https://issues.apache.org/jira/browse/SPARK-11619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11619. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9981 [https://github.com/a

[jira] [Resolved] (SPARK-12350) VectorAssembler#transform() initially throws an exception

[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12350. Resolution: Fixed Assignee: Marcelo Vanzin (was: Apache Spark) Fix Version/

[jira] [Assigned] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12409: Assignee: (was: Apache Spark) > JDBC AND operator push down > ---

[jira] [Assigned] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12409: Assignee: Apache Spark > JDBC AND operator push down > > >

[jira] [Commented] (SPARK-10291) Add statsByKey method to compute StatCounters for each key in an RDD

[ https://issues.apache.org/jira/browse/SPARK-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064266#comment-15064266 ] Sean Owen commented on SPARK-10291: --- My POV is that this isn't likely worth adding a me

[jira] [Commented] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064200#comment-15064200 ] Thomas Graves commented on SPARK-11701: --- I ran into another instance of this and it

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: Apache Spark > The implementation of ParamMap#filter is wrong. > ---

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: (was: Apache Spark) > The implementation of ParamMap#filter is wrong. >

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: Apache Spark > The implementation of ParamMap#filter is wrong. > ---

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: (was: Apache Spark) > The implementation of ParamMap#filter is wrong. >

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: Apache Spark > The implementation of ParamMap#filter is wrong. > ---

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: (was: Apache Spark) > The implementation of ParamMap#filter is wrong. >

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Environment: Problems apparent on BE, LE could be impacted too (was: Problems are evident on BE)

[jira] [Commented] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064113#comment-15064113 ] Apache Spark commented on SPARK-12424: -- User 'sarutak' has created a pull request fo

[jira] [Created] (SPARK-12424) The implementation of ParamMap#filter is wrong.

Kousuke Saruta created SPARK-12424: -- Summary: The implementation of ParamMap#filter is wrong. Key: SPARK-12424 URL: https://issues.apache.org/jira/browse/SPARK-12424 Project: Spark Issue Typ

[jira] [Commented] (SPARK-12369) DataFrameReader fails on globbing parquet paths

[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064059#comment-15064059 ] Apache Spark commented on SPARK-12369: -- User 'yanakad' has created a pull request fo

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Environment: Problems are evident on BE (was: BE platforms) > Address endian specific problems s

[jira] [Updated] (SPARK-9057) Add Scala, Java and Python example to show DStream.transform

[ https://issues.apache.org/jira/browse/SPARK-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9057: - Assignee: Jeff Lam > Add Scala, Java and Python example to show DStream.transform > --

[jira] [Resolved] (SPARK-8318) Spark Streaming Starter JIRAs

[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8318. -- Resolution: Implemented > Spark Streaming Starter JIRAs > - > >

[jira] [Assigned] (SPARK-12369) DataFrameReader fails on globbing parquet paths

[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12369: Assignee: (was: Apache Spark) > DataFrameReader fails on globbing parquet paths >

[jira] [Resolved] (SPARK-9057) Add Scala, Java and Python example to show DStream.transform

[ https://issues.apache.org/jira/browse/SPARK-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9057. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 8431 [https://github.com/ap

[jira] [Assigned] (SPARK-12369) DataFrameReader fails on globbing parquet paths

[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12369: Assignee: Apache Spark > DataFrameReader fails on globbing parquet paths > ---

[jira] [Updated] (SPARK-12370) Documentation should link to examples from its own release version

[ https://issues.apache.org/jira/browse/SPARK-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12370: -- Priority: Minor (was: Major) Component/s: Documentation > Documentation should link to examples

[jira] [Resolved] (SPARK-12418) spark shuffle FAILED_TO_UNCOMPRESS

[ https://issues.apache.org/jira/browse/SPARK-12418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12418. --- Resolution: Duplicate Target Version/s: (was: 1.5.1) Please search JIRA first > spark sh

[jira] [Updated] (SPARK-12401) Add support for enums in postgres

[ https://issues.apache.org/jira/browse/SPARK-12401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12401: -- Priority: Minor (was: Major) Component/s: SQL > Add support for enums in postgres > ---

[jira] [Updated] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12346: -- Component/s: SparkR > GLM summary crashes with NoSuchElementException if attributes are missing > name

[jira] [Updated] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12403: -- Fix Version/s: (was: 1.4.1) (was: 1.3.1) [~lunendl] please read https://cwi

[jira] [Updated] (SPARK-12387) JDBC IN operator push down

[ https://issues.apache.org/jira/browse/SPARK-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12387: -- Fix Version/s: (was: 1.6.0) > JDBC IN operator push down > --- > >

  1   2   >