[jira] [Assigned] (SPARK-20668) Modify ScalaUDF to handle nullability.

2017-05-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20668: --- Assignee: Takuya Ueshin > Modify ScalaUDF to handle nullability. > -

[jira] [Resolved] (SPARK-20668) Modify ScalaUDF to handle nullability.

2017-05-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20668. - Resolution: Fixed Fix Version/s: 2.3.0 > Modify ScalaUDF to handle nullability. >

[jira] [Assigned] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20666: Assignee: Apache Spark > Flaky test - SparkListenerBus randomly failing java.lang.IllegalA

[jira] [Commented] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004164#comment-16004164 ] Apache Spark commented on SPARK-20666: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20666: Assignee: (was: Apache Spark) > Flaky test - SparkListenerBus randomly failing java.la

[jira] [Resolved] (SPARK-20686) PropagateEmptyRelation incorrectly handles aggregate without grouping expressions

2017-05-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20686. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 2.1.2 >

[jira] [Resolved] (SPARK-20670) Simplify FPGrowth transform

2017-05-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20670. -- Resolution: Fixed Assignee: yuhao yang Fix Version/s: 2.3.0 Target

[jira] [Updated] (SPARK-20689) python doctest leaking bucketed table

2017-05-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20689: - Description: When trying to address build test failure in SPARK-20661 we discovered some tables

[jira] [Updated] (SPARK-20689) python doctest leaking bucketed table

2017-05-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20689: - Description: When trying to address build test failure in SPARK-20661 we discovered some tables

[jira] [Assigned] (SPARK-20689) python doctest leaking bucketed table

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20689: Assignee: Felix Cheung (was: Apache Spark) > python doctest leaking bucketed table >

[jira] [Assigned] (SPARK-20689) python doctest leaking bucketed table

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20689: Assignee: Apache Spark (was: Felix Cheung) > python doctest leaking bucketed table >

[jira] [Commented] (SPARK-20689) python doctest leaking bucketed table

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004149#comment-16004149 ] Apache Spark commented on SPARK-20689: -- User 'felixcheung' has created a pull reques

[jira] [Updated] (SPARK-20689) python doctest leaking bucketed table

2017-05-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20689: - Description: When trying to address build test failure in SPARK-20661 we discovered some tables

[jira] [Created] (SPARK-20689) python doctest leaking bucketed table

2017-05-09 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20689: Summary: python doctest leaking bucketed table Key: SPARK-20689 URL: https://issues.apache.org/jira/browse/SPARK-20689 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20590) Map default input data source formats to inlined classes

2017-05-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20590: --- Assignee: Hyukjin Kwon > Map default input data source formats to inlined classes >

[jira] [Resolved] (SPARK-20590) Map default input data source formats to inlined classes

2017-05-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20590. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull req

[jira] [Commented] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004103#comment-16004103 ] Apache Spark commented on SPARK-12837: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-20688) correctly check analysis for scalar sub-queries

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20688: Assignee: Apache Spark (was: Wenchen Fan) > correctly check analysis for scalar sub-queri

[jira] [Assigned] (SPARK-20688) correctly check analysis for scalar sub-queries

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20688: Assignee: Wenchen Fan (was: Apache Spark) > correctly check analysis for scalar sub-queri

[jira] [Commented] (SPARK-20688) correctly check analysis for scalar sub-queries

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004060#comment-16004060 ] Apache Spark commented on SPARK-20688: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-20688) correctly check analysis for scalar sub-queries

2017-05-09 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-20688: --- Summary: correctly check analysis for scalar sub-queries Key: SPARK-20688 URL: https://issues.apache.org/jira/browse/SPARK-20688 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-20687) mllib.Matrices.fromBreeze may crash when converting breeze CSCMatrix

2017-05-09 Thread Ignacio Bermudez Corrales (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ignacio Bermudez Corrales updated SPARK-20687: -- Description: Conversion of Breeze sparse matrices to Matrix is broken w

[jira] [Issue Comment Deleted] (SPARK-20687) mllib.Matrices.fromBreeze may crash when converting breeze CSCMatrix

2017-05-09 Thread Ignacio Bermudez Corrales (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ignacio Bermudez Corrales updated SPARK-20687: -- Comment: was deleted (was: test("breeze conversion bug") { // (2,

[jira] [Updated] (SPARK-20687) mllib.Matrices.fromBreeze may crash when converting breeze CSCMatrix

2017-05-09 Thread Ignacio Bermudez Corrales (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ignacio Bermudez Corrales updated SPARK-20687: -- test("breeze conversion bug") { // (2, 0, 0) // (2, 0, 0) val

[jira] [Commented] (SPARK-20687) mllib.Matrices.fromBreeze may crash when converting breeze CSCMatrix

2017-05-09 Thread Ignacio Bermudez Corrales (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004038#comment-16004038 ] Ignacio Bermudez Corrales commented on SPARK-20687: --- The bug on SPARK-1

[jira] [Created] (SPARK-20687) mllib.Matrices.fromBreeze may crash when converting breeze CSCMatrix

2017-05-09 Thread Ignacio Bermudez Corrales (JIRA)
Ignacio Bermudez Corrales created SPARK-20687: - Summary: mllib.Matrices.fromBreeze may crash when converting breeze CSCMatrix Key: SPARK-20687 URL: https://issues.apache.org/jira/browse/SPARK-20687

[jira] [Commented] (SPARK-20554) Remove usage of scala.language.reflectiveCalls

2017-05-09 Thread Umesh Chaudhary (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004020#comment-16004020 ] Umesh Chaudhary commented on SPARK-20554: - [~srowen] Recently I did not get time

[jira] [Comment Edited] (SPARK-14584) Improve recognition of non-nullability in Dataset transformations

2017-05-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003996#comment-16003996 ] Hyukjin Kwon edited comment on SPARK-14584 at 5/10/17 3:56 AM:

[jira] [Commented] (SPARK-14584) Improve recognition of non-nullability in Dataset transformations

2017-05-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003996#comment-16003996 ] Hyukjin Kwon commented on SPARK-14584: -- [~joshrosen] SPARK-18284 fixes this. Before

[jira] [Updated] (SPARK-20665) Spark-sql, "Bround" and "Round" function return NULL

2017-05-09 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-20665: Summary: Spark-sql, "Bround" and "Round" function return NULL (was: Spark-sql, "Bround" function return NU

[jira] [Resolved] (SPARK-17685) WholeStageCodegenExec throws IndexOutOfBoundsException

2017-05-09 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17685. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-18528) limit + groupBy leads to java.lang.NullPointerException

2017-05-09 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003882#comment-16003882 ] Takeshi Yamamuro commented on SPARK-18528: -- You tried spark-v2.1.1? This issue i

[jira] [Commented] (SPARK-20683) Make table uncache chaining optional

2017-05-09 Thread Shea Parkes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003864#comment-16003864 ] Shea Parkes commented on SPARK-20683: - For anyone that found this issue and just want

[jira] [Updated] (SPARK-20665) Spark-sql, "Bround" function return NULL

2017-05-09 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-20665: Description: >select bround(12.3, 2); >NULL For this case, the expected result is 12.3, but it is null "R

[jira] [Assigned] (SPARK-20686) PropagateEmptyRelation incorrectly handles aggregate without grouping expressions

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20686: Assignee: Josh Rosen (was: Apache Spark) > PropagateEmptyRelation incorrectly handles agg

[jira] [Assigned] (SPARK-20686) PropagateEmptyRelation incorrectly handles aggregate without grouping expressions

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20686: Assignee: Apache Spark (was: Josh Rosen) > PropagateEmptyRelation incorrectly handles agg

[jira] [Commented] (SPARK-20686) PropagateEmptyRelation incorrectly handles aggregate without grouping expressions

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003848#comment-16003848 ] Apache Spark commented on SPARK-20686: -- User 'JoshRosen' has created a pull request

[jira] [Created] (SPARK-20686) PropagateEmptyRelation incorrectly handles aggregate without grouping expressions

2017-05-09 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-20686: -- Summary: PropagateEmptyRelation incorrectly handles aggregate without grouping expressions Key: SPARK-20686 URL: https://issues.apache.org/jira/browse/SPARK-20686 Project

[jira] [Commented] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003841#comment-16003841 ] Apache Spark commented on SPARK-20311: -- User 'maropu' has created a pull request for

[jira] [Resolved] (SPARK-20500) ML, Graph 2.2 QA: API: Binary incompatible changes

2017-05-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-20500. --- Resolution: Done Fix Version/s: 2.2.0 > ML, Graph 2.2 QA: API: Binary incompat

[jira] [Commented] (SPARK-20500) ML, Graph 2.2 QA: API: Binary incompatible changes

2017-05-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003813#comment-16003813 ] Joseph K. Bradley commented on SPARK-20500: --- I checked the full MiMa output for

[jira] [Commented] (SPARK-20376) Make StateStoreProvider plugable

2017-05-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003729#comment-16003729 ] Michael Armbrust commented on SPARK-20376: -- /cc [~tdas] > Make StateStoreProvid

[jira] [Commented] (SPARK-20685) BatchPythonEvaluation UDF evaluator fails for case of single UDF with repeated argument

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003662#comment-16003662 ] Apache Spark commented on SPARK-20685: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-20685) BatchPythonEvaluation UDF evaluator fails for case of single UDF with repeated argument

2017-05-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-20685: -- Assignee: Josh Rosen > BatchPythonEvaluation UDF evaluator fails for case of single UDF with

[jira] [Created] (SPARK-20685) BatchPythonEvaluation UDF evaluator fails for case of single UDF with repeated argument

2017-05-09 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-20685: -- Summary: BatchPythonEvaluation UDF evaluator fails for case of single UDF with repeated argument Key: SPARK-20685 URL: https://issues.apache.org/jira/browse/SPARK-20685 P

[jira] [Assigned] (SPARK-20373) Batch queries with 'Dataset/DataFrame.withWatermark()` does not execute

2017-05-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-20373: Assignee: Genmao Yu > Batch queries with 'Dataset/DataFrame.withWatermark()` does not exec

[jira] [Updated] (SPARK-20373) Batch queries with 'Dataset/DataFrame.withWatermark()` does not execute

2017-05-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20373: - Fix Version/s: 2.3.0 2.2.1 > Batch queries with 'Dataset/DataFrame.withWaterma

[jira] [Assigned] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20311: Assignee: Apache Spark (was: Takeshi Yamamuro) > SQL "range(N) as alias" or "range(N) ali

[jira] [Assigned] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20311: Assignee: Takeshi Yamamuro (was: Apache Spark) > SQL "range(N) as alias" or "range(N) ali

[jira] [Reopened] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-20311: -- > SQL "range(N) as alias" or "range(N) alias" doesn't work > --

[jira] [Commented] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003626#comment-16003626 ] Yin Huai commented on SPARK-20311: -- It introduced a regression (https://github.com/apac

[jira] [Updated] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-20311: - Fix Version/s: (was: 2.2.1) (was: 2.3.0) > SQL "range(N) as alias" or "range(N

[jira] [Created] (SPARK-20684) expose createGlobalTempView in SparkR

2017-05-09 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-20684: -- Summary: expose createGlobalTempView in SparkR Key: SPARK-20684 URL: https://issues.apache.org/jira/browse/SPARK-20684 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20205) DAGScheduler posts SparkListenerStageSubmitted before updating stage

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20205: Assignee: Apache Spark > DAGScheduler posts SparkListenerStageSubmitted before updating st

[jira] [Assigned] (SPARK-20205) DAGScheduler posts SparkListenerStageSubmitted before updating stage

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20205: Assignee: (was: Apache Spark) > DAGScheduler posts SparkListenerStageSubmitted before

[jira] [Commented] (SPARK-20205) DAGScheduler posts SparkListenerStageSubmitted before updating stage

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003471#comment-16003471 ] Apache Spark commented on SPARK-20205: -- User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-20683) Make table uncache chaining optional

2017-05-09 Thread Robert Kruszewski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003464#comment-16003464 ] Robert Kruszewski commented on SPARK-20683: --- +1, have the similar use case wher

[jira] [Created] (SPARK-20683) Make table uncache chaining optional

2017-05-09 Thread Shea Parkes (JIRA)
Shea Parkes created SPARK-20683: --- Summary: Make table uncache chaining optional Key: SPARK-20683 URL: https://issues.apache.org/jira/browse/SPARK-20683 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20682: Assignee: Apache Spark > Support a new faster ORC data source based on Apache ORC > --

[jira] [Assigned] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20682: Assignee: (was: Apache Spark) > Support a new faster ORC data source based on Apache O

[jira] [Commented] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003369#comment-16003369 ] Apache Spark commented on SPARK-20682: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Commented] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003344#comment-16003344 ] Dongjoon Hyun commented on SPARK-20682: --- Yes. I think it's worth for Spark to have

[jira] [Commented] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Robert Kruszewski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003339#comment-16003339 ] Robert Kruszewski commented on SPARK-20682: --- Awesome, didn't know that there ar

[jira] [Updated] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20682: -- Description: Since SPARK-2883, Apache Spark supports Apache ORC inside `sql/hive` module with

[jira] [Comment Edited] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003326#comment-16003326 ] Dongjoon Hyun edited comment on SPARK-20682 at 5/9/17 7:10 PM:

[jira] [Commented] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003326#comment-16003326 ] Dongjoon Hyun commented on SPARK-20682: --- Yep. That was a old huddle before 1.4.0. 1

[jira] [Commented] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Robert Kruszewski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003321#comment-16003321 ] Robert Kruszewski commented on SPARK-20682: --- Would it make sense to bring hive-

[jira] [Created] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-05-09 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-20682: - Summary: Support a new faster ORC data source based on Apache ORC Key: SPARK-20682 URL: https://issues.apache.org/jira/browse/SPARK-20682 Project: Spark Is

[jira] [Comment Edited] (SPARK-18528) limit + groupBy leads to java.lang.NullPointerException

2017-05-09 Thread Esther Kundin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003265#comment-16003265 ] Esther Kundin edited comment on SPARK-18528 at 5/9/17 6:43 PM:

[jira] [Comment Edited] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2017-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003267#comment-16003267 ] Reynold Xin edited comment on SPARK-12297 at 5/9/17 6:40 PM: -

[jira] [Comment Edited] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2017-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003267#comment-16003267 ] Reynold Xin edited comment on SPARK-12297 at 5/9/17 6:39 PM: -

[jira] [Commented] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2017-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003267#comment-16003267 ] Reynold Xin commented on SPARK-12297: - I looked at the issue again and reverted the p

[jira] [Commented] (SPARK-18528) limit + groupBy leads to java.lang.NullPointerException

2017-05-09 Thread Esther Kundin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003265#comment-16003265 ] Esther Kundin commented on SPARK-18528: --- I have just found the same bug with Spark

[jira] [Updated] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2017-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12297: Fix Version/s: (was: 2.3.0) > Add work-around for Parquet/Hive int96 timestamp bug. > -

[jira] [Reopened] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2017-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-12297: - Assignee: (was: Imran Rashid) > Add work-around for Parquet/Hive int96 timestamp bug. > ---

[jira] [Comment Edited] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2017-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001214#comment-16001214 ] Reynold Xin edited comment on SPARK-12297 at 5/9/17 6:35 PM: -

[jira] [Resolved] (SPARK-20627) Remove pip local version string (PEP440)

2017-05-09 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-20627. - Resolution: Fixed Fix Version/s: 2.1.2 2.3.0 2.2.1 Issue res

[jira] [Assigned] (SPARK-20627) Remove pip local version string (PEP440)

2017-05-09 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-20627: --- Assignee: holdenk > Remove pip local version string (PEP440) > -

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

2017-05-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-20666: --- Summary: Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError (was: F

[jira] [Commented] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

2017-05-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003116#comment-16003116 ] Marcelo Vanzin commented on SPARK-20666: I'm raising the severity because lots of

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

2017-05-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-20666: --- Priority: Critical (was: Major) > Flaky test - SparkListenerBus randomly failing java.lang.I

[jira] [Commented] (SPARK-10408) Autoencoder

2017-05-09 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003110#comment-16003110 ] Alexander Ulanov commented on SPARK-10408: -- Autoencoder is implemented in the re

[jira] [Commented] (SPARK-14584) Improve recognition of non-nullability in Dataset transformations

2017-05-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003082#comment-16003082 ] Josh Rosen commented on SPARK-14584: [~hyukjin.kwon], yeah, this does appear to be fi

[jira] [Commented] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

2017-05-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003055#comment-16003055 ] Marcelo Vanzin commented on SPARK-20666: [~cloud_fan] do you think your fix for S

[jira] [Comment Edited] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

2017-05-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002962#comment-16002962 ] Marcelo Vanzin edited comment on SPARK-20666 at 5/9/17 4:52 PM: ---

[jira] [Resolved] (SPARK-20674) Support registering UserDefinedFunction as named UDF

2017-05-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20674. - Resolution: Fixed Fix Version/s: 2.2.0 > Support registering UserDefinedFunction as named UDF > --

[jira] [Commented] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

2017-05-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002962#comment-16002962 ] Marcelo Vanzin commented on SPARK-20666: This doesn't fail just on Windows. It's

[jira] [Comment Edited] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

2017-05-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002962#comment-16002962 ] Marcelo Vanzin edited comment on SPARK-20666 at 5/9/17 4:18 PM: ---

[jira] [Resolved] (SPARK-20548) Flaky Test: ReplSuite.newProductSeqEncoder with REPL defined class

2017-05-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20548. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull req

[jira] [Commented] (SPARK-20608) Standby namenodes should be allowed to included in yarn.spark.access.namenodes to support HDFS HA

2017-05-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002956#comment-16002956 ] Marcelo Vanzin commented on SPARK-20608: bq. I think it is unreasonable that spar

[jira] [Created] (SPARK-20681) DataFram.Drop doesn't take effective, neither does error

2017-05-09 Thread Xi Wang (JIRA)
Xi Wang created SPARK-20681: --- Summary: DataFram.Drop doesn't take effective, neither does error Key: SPARK-20681 URL: https://issues.apache.org/jira/browse/SPARK-20681 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-09 Thread Dmitry Naumenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002852#comment-16002852 ] Dmitry Naumenko commented on SPARK-13747: - [~revolucion09] It's a bit an off-topi

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-09 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002814#comment-16002814 ] Saif Addin commented on SPARK-13747: [~dnaumenko] Nonetheless, if I am not mistaken,

[jira] [Resolved] (SPARK-20355) Display Spark version on history page

2017-05-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-20355. --- Resolution: Fixed Assignee: Sanket Reddy Fix Version/s: 2.3.0 > Display Spark

[jira] [Updated] (SPARK-20489) Different results in local mode and yarn mode when working with dates (silent corruption due to system timezone setting)

2017-05-09 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Moritz updated SPARK-20489: Summary: Different results in local mode and yarn mode when working with dates (silent corruption d

[jira] [Commented] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-05-09 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002762#comment-16002762 ] Rick Moritz commented on SPARK-20489: - Okay, I had a look at timezones, and it appear

[jira] [Assigned] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20591: Assignee: (was: Apache Spark) > Succeeded tasks num not equal in job page and job deta

[jira] [Assigned] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20591: Assignee: Apache Spark > Succeeded tasks num not equal in job page and job detail page on

[jira] [Commented] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002686#comment-16002686 ] Apache Spark commented on SPARK-20591: -- User 'fjh100456' has created a pull request

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2017-05-09 Thread Dmitry Naumenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002674#comment-16002674 ] Dmitry Naumenko commented on SPARK-13747: - [~zsxwing] I've tried to build a Spark

  1   2   >