[jira] [Updated] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23020: --- Fix Version/s: (was: 2.3.0) > Re-enable Flaky Test: > org.apache.spark.launcher.SparkLau

[jira] [Updated] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23020: --- Affects Version/s: (was: 2.3.0) 2.4.0 > Re-enable Flaky Test: > o

[jira] [Updated] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23020: --- Target Version/s: 2.4.0 (was: 2.3.0) > Re-enable Flaky Test: > org.apache.spark.launcher.Sp

[jira] [Reopened] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reopened SPARK-23020: > Re-enable Flaky Test: > org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher >

[jira] [Commented] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342985#comment-16342985 ] Sameer Agarwal commented on SPARK-23020: I'm sorry but the flakiness in the test

[jira] [Updated] (SPARK-20254) SPARK-19716 generates unnecessary data conversion for Dataset with primitive array

[ https://issues.apache.org/jira/browse/SPARK-20254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20254: Fix Version/s: (was: 2.3.0) > SPARK-19716 generates unnecessary data conversion for Dataset with primit

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342949#comment-16342949 ] Gaurav Garg commented on SPARK-18016: - It also throws the same "*constant pool*" exce

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342941#comment-16342941 ] Gaurav Garg commented on SPARK-18016: - [~Tagar]  Sorry, I have implemented the same l

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342940#comment-16342940 ] Gaurav Garg commented on SPARK-18016: - [~kiszk], this programs also gives the Constan

[jira] [Assigned] (SPARK-23196) Unify continuous and microbatch V2 sinks

[ https://issues.apache.org/jira/browse/SPARK-23196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-23196: --- Assignee: Jose Torres > Unify continuous and microbatch V2 sinks > -

[jira] [Resolved] (SPARK-23196) Unify continuous and microbatch V2 sinks

[ https://issues.apache.org/jira/browse/SPARK-23196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23196. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20369 [https://githu

[jira] [Commented] (SPARK-23187) Accumulator object can not be sent from Executor to Driver

[ https://issues.apache.org/jira/browse/SPARK-23187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342824#comment-16342824 ] Saisai Shao commented on SPARK-23187: - I think I tried, {{accumUpdates}} can be recei

[jira] [Commented] (SPARK-22916) shouldn't bias towards build right if user does not specify

[ https://issues.apache.org/jira/browse/SPARK-22916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342821#comment-16342821 ] Apache Spark commented on SPARK-22916: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-23032) Add a per-query codegenStageId to WholeStageCodegenExec

[ https://issues.apache.org/jira/browse/SPARK-23032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342799#comment-16342799 ] Apache Spark commented on SPARK-23032: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-790) Implement the reregistered() callback in MesosScheduler to support master failover

[ https://issues.apache.org/jira/browse/SPARK-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-790: -- Assignee: Apache Spark > Implement the reregistered() callback in MesosScheduler to support mast

[jira] [Commented] (SPARK-790) Implement the reregistered() callback in MesosScheduler to support master failover

[ https://issues.apache.org/jira/browse/SPARK-790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342778#comment-16342778 ] Apache Spark commented on SPARK-790: User 'rekhajoshm' has created a pull request for t

[jira] [Assigned] (SPARK-790) Implement the reregistered() callback in MesosScheduler to support master failover

[ https://issues.apache.org/jira/browse/SPARK-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-790: -- Assignee: (was: Apache Spark) > Implement the reregistered() callback in MesosScheduler to s

[jira] [Commented] (SPARK-17949) Introduce a JVM object based aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-17949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342766#comment-16342766 ] dciborow commented on SPARK-17949: -- I am seeing the following frequently in my log. Read

[jira] [Resolved] (SPARK-22873) Init lastReportTimestamp with system current time when start() called in AsyncEventQueue

[ https://issues.apache.org/jira/browse/SPARK-22873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22873. --- Resolution: Not A Problem > Init lastReportTimestamp with system current time when start() called in

[jira] [Resolved] (SPARK-23250) Typo in JavaDoc/ScalaDoc for DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-23250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23250. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20417 [https://github.co

[jira] [Assigned] (SPARK-23250) Typo in JavaDoc/ScalaDoc for DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-23250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23250: - Assignee: Charles Chen > Typo in JavaDoc/ScalaDoc for DataFrameWriter >

[jira] [Commented] (SPARK-23240) PythonWorkerFactory issues unhelpful message when pyspark.daemon produces bogus stdout

[ https://issues.apache.org/jira/browse/SPARK-23240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342688#comment-16342688 ] Bruce Robbins commented on SPARK-23240: --- Hi [~hyukjin.kwon], I am not sure this up

[jira] [Updated] (SPARK-20901) Feature parity for ORC with Parquet

[ https://issues.apache.org/jira/browse/SPARK-20901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20901: -- Affects Version/s: 2.2.1 > Feature parity for ORC with Parquet > --

[jira] [Assigned] (SPARK-23166) Add maxDF Parameter to CountVectorizer

[ https://issues.apache.org/jira/browse/SPARK-23166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23166: - Assignee: Yacine Mazari > Add maxDF Parameter to CountVectorizer > -

[jira] [Resolved] (SPARK-23166) Add maxDF Parameter to CountVectorizer

[ https://issues.apache.org/jira/browse/SPARK-23166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23166. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20367 [https://github.co

[jira] [Commented] (SPARK-23223) Stacking dataset transforms performs poorly

[ https://issues.apache.org/jira/browse/SPARK-23223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342513#comment-16342513 ] Hyukjin Kwon commented on SPARK-23223: -- I think this fixes SPARK-17006 as well. > S