[jira] [Commented] (SPARK-26390) ColumnPruning rule should only do column pruning

[ https://issues.apache.org/jira/browse/SPARK-26390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723773#comment-16723773 ] ASF GitHub Bot commented on SPARK-26390: cloud-fan opened a new pull request #23

[jira] [Assigned] (SPARK-26390) ColumnPruning rule should only do column pruning

[ https://issues.apache.org/jira/browse/SPARK-26390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26390: Assignee: Wenchen Fan (was: Apache Spark) > ColumnPruning rule should only do column pru

[jira] [Assigned] (SPARK-26390) ColumnPruning rule should only do column pruning

[ https://issues.apache.org/jira/browse/SPARK-26390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26390: Assignee: Apache Spark (was: Wenchen Fan) > ColumnPruning rule should only do column pru

[jira] [Created] (SPARK-26390) ColumnPruning rule should only do column pruning

Wenchen Fan created SPARK-26390: --- Summary: ColumnPruning rule should only do column pruning Key: SPARK-26390 URL: https://issues.apache.org/jira/browse/SPARK-26390 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-26324) Spark submit does not work with messos over ssl [Missing docs]

[ https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723761#comment-16723761 ] Jorge Machado commented on SPARK-26324: --- [~hyukjin.kwon] I created a PR for this d

[jira] [Commented] (SPARK-26324) Spark submit does not work with messos over ssl [Missing docs]

[ https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723754#comment-16723754 ] ASF GitHub Bot commented on SPARK-26324: jomach opened a new pull request #23342

[jira] [Assigned] (SPARK-26324) Spark submit does not work with messos over ssl [Missing docs]

[ https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26324: Assignee: Apache Spark > Spark submit does not work with messos over ssl [Missing docs] >

[jira] [Assigned] (SPARK-26324) Spark submit does not work with messos over ssl [Missing docs]

[ https://issues.apache.org/jira/browse/SPARK-26324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26324: Assignee: (was: Apache Spark) > Spark submit does not work with messos over ssl [Miss

[jira] [Comment Edited] (SPARK-26223) Scan: track metastore operation time

[ https://issues.apache.org/jira/browse/SPARK-26223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723111#comment-16723111 ] Yuanjian Li edited comment on SPARK-26223 at 12/18/18 6:34 AM: ---

[jira] [Commented] (SPARK-26246) Infer timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723717#comment-16723717 ] ASF GitHub Bot commented on SPARK-26246: asfgit closed pull request #23201: [SPA

[jira] [Resolved] (SPARK-26246) Infer timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26246. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23201 [https://gi

[jira] [Assigned] (SPARK-26246) Infer timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26246: Assignee: Maxim Gekk > Infer timestamp types from JSON > ---

[jira] [Commented] (SPARK-26081) Do not write empty files by text datasources

[ https://issues.apache.org/jira/browse/SPARK-26081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723679#comment-16723679 ] ASF GitHub Bot commented on SPARK-26081: HyukjinKwon opened a new pull request #

[jira] [Updated] (SPARK-26389) temp checkpoint folder at executor should be deleted on graceful shutdown

[ https://issues.apache.org/jira/browse/SPARK-26389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengyu Cao updated SPARK-26389: --- Description: {{spark-submit --master mesos:// -conf spark.streaming.stopGracefullyOnShutdown=true }

[jira] [Updated] (SPARK-26389) temp checkpoint folder at executor should be deleted on graceful shutdown

[ https://issues.apache.org/jira/browse/SPARK-26389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengyu Cao updated SPARK-26389: --- Description: `spark-submit --master mesos://- -conf spark.streaming.stopGracefullyOnShutdown=true `

[jira] [Updated] (SPARK-26389) temp checkpoint folder at executor should be deleted on graceful shutdown

[ https://issues.apache.org/jira/browse/SPARK-26389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengyu Cao updated SPARK-26389: --- Description: {{spark-submit --master mesos:// -conf spark.streaming.stopGracefullyOnShutdown=true }

[jira] [Created] (SPARK-26389) temp checkpoint folder at executor should be deleted on graceful shutdown

Fengyu Cao created SPARK-26389: -- Summary: temp checkpoint folder at executor should be deleted on graceful shutdown Key: SPARK-26389 URL: https://issues.apache.org/jira/browse/SPARK-26389 Project: Spark

[jira] [Assigned] (SPARK-23431) Expose the new executor memory metrics at the stage level

[ https://issues.apache.org/jira/browse/SPARK-23431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23431: Assignee: Apache Spark > Expose the new executor memory metrics at the stage level >

[jira] [Assigned] (SPARK-23431) Expose the new executor memory metrics at the stage level

[ https://issues.apache.org/jira/browse/SPARK-23431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23431: Assignee: (was: Apache Spark) > Expose the new executor memory metrics at the stage l

[jira] [Commented] (SPARK-23431) Expose the new executor memory metrics at the stage level

[ https://issues.apache.org/jira/browse/SPARK-23431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723610#comment-16723610 ] ASF GitHub Bot commented on SPARK-23431: edwinalu opened a new pull request #233

[jira] [Commented] (SPARK-24561) User-defined window functions with pandas udf (bounded window)

[ https://issues.apache.org/jira/browse/SPARK-24561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723552#comment-16723552 ] ASF GitHub Bot commented on SPARK-24561: asfgit closed pull request #22305: [SPA

[jira] [Resolved] (SPARK-24561) User-defined window functions with pandas udf (bounded window)

[ https://issues.apache.org/jira/browse/SPARK-24561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24561. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22305 [https://gi

[jira] [Assigned] (SPARK-24561) User-defined window functions with pandas udf (bounded window)

[ https://issues.apache.org/jira/browse/SPARK-24561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24561: Assignee: Li Jin > User-defined window functions with pandas udf (bounded window) > -

[jira] [Updated] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-26388: Affects Version/s: 2.3.2 > No support for "alter table .. replace columns" to drop columns > -

[jira] [Assigned] (SPARK-25689) Move token renewal logic to driver in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-25689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25689: Assignee: (was: Apache Spark) > Move token renewal logic to driver in yarn-client mod

[jira] [Assigned] (SPARK-25689) Move token renewal logic to driver in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-25689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25689: Assignee: Apache Spark > Move token renewal logic to driver in yarn-client mode > ---

[jira] [Commented] (SPARK-25689) Move token renewal logic to driver in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-25689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723523#comment-16723523 ] ASF GitHub Bot commented on SPARK-25689: vanzin opened a new pull request #23338

[jira] [Created] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

nirav patel created SPARK-26388: --- Summary: No support for "alter table .. replace columns" to drop columns Key: SPARK-26388 URL: https://issues.apache.org/jira/browse/SPARK-26388 Project: Spark

[jira] [Commented] (SPARK-26346) Upgrade parquet to 1.11.0

[ https://issues.apache.org/jira/browse/SPARK-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723518#comment-16723518 ] Dongjoon Hyun commented on SPARK-26346: --- +1 > Upgrade parquet to 1.11.0 > ---

[jira] [Resolved] (SPARK-26367) Remove ReplaceExceptWithFilter from nonExcludableRules

[ https://issues.apache.org/jira/browse/SPARK-26367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26367. --- Resolution: Won't Do Assignee: (was: Xiao Li) Since the PR is closed, I'll close t

[jira] [Updated] (SPARK-26375) Rule PruneFileSourcePartitions should be fired before any other rules based on table statistics

[ https://issues.apache.org/jira/browse/SPARK-26375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26375: -- Component/s: (was: Optimizer) SQL > Rule PruneFileSourcePartitions should

[jira] [Commented] (SPARK-26377) java.lang.IllegalStateException: No current assignment for partition

[ https://issues.apache.org/jira/browse/SPARK-26377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723469#comment-16723469 ] Dongjoon Hyun commented on SPARK-26377: --- Hi, [~kumarg.pavan]. JIRA is not for Q&A.

[jira] [Commented] (SPARK-26377) java.lang.IllegalStateException: No current assignment for partition

[ https://issues.apache.org/jira/browse/SPARK-26377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723472#comment-16723472 ] Dongjoon Hyun commented on SPARK-26377: --- BTW, did you try the latest version, Apac

[jira] [Updated] (SPARK-26377) java.lang.IllegalStateException: No current assignment for partition

[ https://issues.apache.org/jira/browse/SPARK-26377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26377: -- Fix Version/s: (was: 2.2.1) > java.lang.IllegalStateException: No current assignment for p

[jira] [Updated] (SPARK-26377) java.lang.IllegalStateException: No current assignment for partition

[ https://issues.apache.org/jira/browse/SPARK-26377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26377: -- Target Version/s: (was: 2.2.1) > java.lang.IllegalStateException: No current assignment for

[jira] [Commented] (SPARK-26019) pyspark/accumulators.py: "TypeError: object of type 'NoneType' has no len()" in authenticate_and_accum_updates()

[ https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723418#comment-16723418 ] ASF GitHub Bot commented on SPARK-26019: squito opened a new pull request #23337

[jira] [Created] (SPARK-26387) Parallelism seems to cause difference in CrossValidation model metrics

Evan Zamir created SPARK-26387: -- Summary: Parallelism seems to cause difference in CrossValidation model metrics Key: SPARK-26387 URL: https://issues.apache.org/jira/browse/SPARK-26387 Project: Spark

[jira] [Commented] (SPARK-25922) [K8] Spark Driver/Executor "spark-app-selector" label mismatch

[ https://issues.apache.org/jira/browse/SPARK-25922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723392#comment-16723392 ] ASF GitHub Bot commented on SPARK-25922: asfgit closed pull request #23322: [SPA

[jira] [Commented] (SPARK-19261) Support `ALTER TABLE table_name ADD COLUMNS(..)` statement

[ https://issues.apache.org/jira/browse/SPARK-19261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723382#comment-16723382 ] nirav patel commented on SPARK-19261: - It happens for `Replace columns` as well `Ex

[jira] [Resolved] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

[ https://issues.apache.org/jira/browse/SPARK-26386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nihar Sheth resolved SPARK-26386. - Resolution: Not A Problem Attempted reinvention of "spark.kubernetes.driver.pod.name", which han

[jira] [Updated] (SPARK-26246) Infer timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-26246: --- Summary: Infer timestamp types from JSON (was: Infer date and timestamp types from JSON) > Infer t

[jira] [Updated] (SPARK-26246) Infer timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-26246: --- Description: Currently, TimestampType cannot be inferred from JSON. To parse JSON string, you have t

[jira] [Commented] (SPARK-24933) SinkProgress should report written rows

[ https://issues.apache.org/jira/browse/SPARK-24933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723316#comment-16723316 ] ASF GitHub Bot commented on SPARK-24933: asfgit closed pull request #21919: [SPA

[jira] [Resolved] (SPARK-24933) SinkProgress should report written rows

[ https://issues.apache.org/jira/browse/SPARK-24933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24933. - Resolution: Fixed Assignee: Vaclav Kosar Fix Version/s: 3.0.0 > SinkProgress should repo

[jira] [Commented] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

[ https://issues.apache.org/jira/browse/SPARK-26386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723299#comment-16723299 ] Nihar Sheth commented on SPARK-26386: - Ah, yes, that seems like it does...Testing it

[jira] [Commented] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

[ https://issues.apache.org/jira/browse/SPARK-26386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723281#comment-16723281 ] Nihar Sheth commented on SPARK-26386: - I'll be working on this > [K8s] Add configur

[jira] [Commented] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

[ https://issues.apache.org/jira/browse/SPARK-26386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723283#comment-16723283 ] Marcelo Vanzin commented on SPARK-26386: Doesn't {{spark.kubernetes.driver.pod.n

[jira] [Created] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

Nihar Sheth created SPARK-26386: --- Summary: [K8s] Add configuration for executor OwnerReference when running in client mode Key: SPARK-26386 URL: https://issues.apache.org/jira/browse/SPARK-26386 Project

[jira] [Commented] (SPARK-26371) Increase Kafka ConfigUpdater test coverage

[ https://issues.apache.org/jira/browse/SPARK-26371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723243#comment-16723243 ] ASF GitHub Bot commented on SPARK-26371: asfgit closed pull request #23321: [SPA

[jira] [Resolved] (SPARK-26371) Increase Kafka ConfigUpdater test coverage

[ https://issues.apache.org/jira/browse/SPARK-26371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26371. --- Resolution: Fixed Assignee: Gabor Somogyi Fix Version/s: 3.0.0 This is resol

[jira] [Commented] (SPARK-26349) Pyspark should not accept insecure p4yj gateways

[ https://issues.apache.org/jira/browse/SPARK-26349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723219#comment-16723219 ] Imran Rashid commented on SPARK-26349: -- I'm working on this > Pyspark should not a

[jira] [Commented] (SPARK-26019) pyspark/accumulators.py: "TypeError: object of type 'NoneType' has no len()" in authenticate_and_accum_updates()

[ https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723218#comment-16723218 ] Imran Rashid commented on SPARK-26019: -- I'm working on this > pyspark/accumulators

[jira] [Commented] (SPARK-26255) Custom error/exception is not thrown for the SQL tab when UI filters are added in spark-sql launch

[ https://issues.apache.org/jira/browse/SPARK-26255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723213#comment-16723213 ] ASF GitHub Bot commented on SPARK-26255: asfgit closed pull request #23312: [SPA

[jira] [Assigned] (SPARK-26255) Custom error/exception is not thrown for the SQL tab when UI filters are added in spark-sql launch

[ https://issues.apache.org/jira/browse/SPARK-26255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26255: -- Assignee: Chakravarthi > Custom error/exception is not thrown for the SQL tab when UI

[jira] [Resolved] (SPARK-26255) Custom error/exception is not thrown for the SQL tab when UI filters are added in spark-sql launch

[ https://issues.apache.org/jira/browse/SPARK-26255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26255. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23312 [https:

[jira] [Comment Edited] (SPARK-26223) Scan: track metastore operation time

[ https://issues.apache.org/jira/browse/SPARK-26223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723111#comment-16723111 ] Yuanjian Li edited comment on SPARK-26223 at 12/17/18 4:10 PM: ---

[jira] [Commented] (SPARK-26223) Scan: track metastore operation time

[ https://issues.apache.org/jira/browse/SPARK-26223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723111#comment-16723111 ] Yuanjian Li commented on SPARK-26223: - The usage of externalCatalog in `SessionCatal

[jira] [Assigned] (SPARK-26378) Queries of wide CSV data slowed after SPARK-26151

[ https://issues.apache.org/jira/browse/SPARK-26378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26378: Assignee: Apache Spark > Queries of wide CSV data slowed after SPARK-26151 >

[jira] [Assigned] (SPARK-26378) Queries of wide CSV data slowed after SPARK-26151

[ https://issues.apache.org/jira/browse/SPARK-26378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26378: Assignee: (was: Apache Spark) > Queries of wide CSV data slowed after SPARK-26151 > -

[jira] [Commented] (SPARK-26378) Queries of wide CSV data slowed after SPARK-26151

[ https://issues.apache.org/jira/browse/SPARK-26378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723095#comment-16723095 ] ASF GitHub Bot commented on SPARK-26378: bersprockets opened a new pull request

[jira] [Commented] (SPARK-20351) Add trait hasTrainingSummary to replace the duplicate code

[ https://issues.apache.org/jira/browse/SPARK-20351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723078#comment-16723078 ] ASF GitHub Bot commented on SPARK-20351: srowen closed pull request #17654: [SPA

[jira] [Resolved] (SPARK-20351) Add trait hasTrainingSummary to replace the duplicate code

[ https://issues.apache.org/jira/browse/SPARK-20351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20351. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 17654 [https://github.c

[jira] [Assigned] (SPARK-20351) Add trait hasTrainingSummary to replace the duplicate code

[ https://issues.apache.org/jira/browse/SPARK-20351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20351: - Assignee: yuhao yang > Add trait hasTrainingSummary to replace the duplicate code > ---

[jira] [Commented] (SPARK-20894) Error while checkpointing to HDFS

[ https://issues.apache.org/jira/browse/SPARK-20894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723062#comment-16723062 ] Alexander Panzhin commented on SPARK-20894: --- I don't know why you would place

[jira] [Commented] (SPARK-26352) join reordering should not change the order of output attributes

[ https://issues.apache.org/jira/browse/SPARK-26352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723050#comment-16723050 ] ASF GitHub Bot commented on SPARK-26352: cloud-fan closed pull request #2: [

[jira] [Updated] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T M updated SPARK-26385: Summary: YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache (was: YARN - Spark S

[jira] [Commented] (SPARK-26352) join reordering should not change the order of output attributes

[ https://issues.apache.org/jira/browse/SPARK-26352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723039#comment-16723039 ] ASF GitHub Bot commented on SPARK-26352: cloud-fan closed pull request #23330: [

[jira] [Commented] (SPARK-26243) Use java.time API for parsing timestamps and dates from JSON

[ https://issues.apache.org/jira/browse/SPARK-26243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16722995#comment-16722995 ] ASF GitHub Bot commented on SPARK-26243: asfgit closed pull request #23329: [SPA

[jira] [Updated] (SPARK-26385) YARN - Spark Stateful Structured streaming

[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] T M updated SPARK-26385: Description:   Hello,   I have Spark Structured Streaming job which is runnning on YARN(Hadoop 2.6.0, Spark 2.

[jira] [Created] (SPARK-26385) YARN - Spark Stateful Structured streaming

T M created SPARK-26385: --- Summary: YARN - Spark Stateful Structured streaming Key: SPARK-26385 URL: https://issues.apache.org/jira/browse/SPARK-26385 Project: Spark Issue Type: Bug Component

[jira] [Updated] (SPARK-26318) Deprecate function merge in Row

[ https://issues.apache.org/jira/browse/SPARK-26318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26318: -- Priority: Trivial (was: Minor) Summary: Deprecate function merge in Row (was: Enhance function m

[jira] [Created] (SPARK-26383) NPE when use DataFrameReader.jdbc with wrong URL

clouds created SPARK-26383: -- Summary: NPE when use DataFrameReader.jdbc with wrong URL Key: SPARK-26383 URL: https://issues.apache.org/jira/browse/SPARK-26383 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-26384) CSV schema inferring does not respect spark.sql.legacy.timeParser.enabled

Maxim Gekk created SPARK-26384: -- Summary: CSV schema inferring does not respect spark.sql.legacy.timeParser.enabled Key: SPARK-26384 URL: https://issues.apache.org/jira/browse/SPARK-26384 Project: Spark

[jira] [Assigned] (SPARK-26382) prefix sorter should handle -0.0

[ https://issues.apache.org/jira/browse/SPARK-26382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26382: Assignee: Apache Spark (was: Wenchen Fan) > prefix sorter should handle -0.0 > -

[jira] [Assigned] (SPARK-26382) prefix sorter should handle -0.0

[ https://issues.apache.org/jira/browse/SPARK-26382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26382: Assignee: Wenchen Fan (was: Apache Spark) > prefix sorter should handle -0.0 > -

[jira] [Commented] (SPARK-26382) prefix sorter should handle -0.0

[ https://issues.apache.org/jira/browse/SPARK-26382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16722791#comment-16722791 ] ASF GitHub Bot commented on SPARK-26382: cloud-fan opened a new pull request #23

[jira] [Created] (SPARK-26382) prefix sorter should handle -0.0

Wenchen Fan created SPARK-26382: --- Summary: prefix sorter should handle -0.0 Key: SPARK-26382 URL: https://issues.apache.org/jira/browse/SPARK-26382 Project: Spark Issue Type: Bug Comp

[jira] [Updated] (SPARK-26381) Pickle Serialization Error Causing Crash

[ https://issues.apache.org/jira/browse/SPARK-26381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan updated SPARK-26381: - Environment: Tested on two environments: * Spark 2.4.0 - single machine only * Spark 2.3.1 - YARN installation

[jira] [Created] (SPARK-26381) Pickle Serialization Error Causing Crash

Ryan created SPARK-26381: Summary: Pickle Serialization Error Causing Crash Key: SPARK-26381 URL: https://issues.apache.org/jira/browse/SPARK-26381 Project: Spark Issue Type: Bug Components

[jira] [Updated] (SPARK-26380) ExternalShuffleBlockResolver should not block shuffle managers by name.

[ https://issues.apache.org/jira/browse/SPARK-26380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peiyu Zhuang updated SPARK-26380: - Description: We configure a shuffle manager that is compatible with the original Spark shuffle

[jira] [Commented] (SPARK-26352) join reordering should not change the order of output attributes

[ https://issues.apache.org/jira/browse/SPARK-26352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16722779#comment-16722779 ] ASF GitHub Bot commented on SPARK-26352: rednaxelafx opened a new pull request #

[jira] [Created] (SPARK-26380) ExternalShuffleBlockResolver should not block shuffle managers by name.

Peiyu Zhuang created SPARK-26380: Summary: ExternalShuffleBlockResolver should not block shuffle managers by name. Key: SPARK-26380 URL: https://issues.apache.org/jira/browse/SPARK-26380 Project: Spar

[jira] [Commented] (SPARK-20636) Eliminate unnecessary shuffle with adjacent Window expressions

[ https://issues.apache.org/jira/browse/SPARK-20636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16722775#comment-16722775 ] ASF GitHub Bot commented on SPARK-20636: asfgit closed pull request #23222: [SPA