[jira] [Created] (SPARK-26907) Does ShuffledRDD Replication Work With External Shuffle Service

Han Altae-Tran created SPARK-26907: -- Summary: Does ShuffledRDD Replication Work With External Shuffle Service Key: SPARK-26907 URL: https://issues.apache.org/jira/browse/SPARK-26907 Project: Spark

[jira] [Updated] (SPARK-26893) Allow partition pruning with subquery filters on file source

[ https://issues.apache.org/jira/browse/SPARK-26893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-26893: --- Summary: Allow partition pruning with subquery filters on file source (was: Allow pushdown of parti

[jira] [Commented] (SPARK-20286) dynamicAllocation.executorIdleTimeout is ignored after unpersist

[ https://issues.apache.org/jira/browse/SPARK-20286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770344#comment-16770344 ] t oo commented on SPARK-20286: -- gentle ping > dynamicAllocation.executorIdleTimeout is ign

[jira] [Commented] (SPARK-15544) Bouncing Zookeeper node causes Active spark master to exit

[ https://issues.apache.org/jira/browse/SPARK-15544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770361#comment-16770361 ] Moein Hosseini commented on SPARK-15544: I've faced with this issue on Spark 2.4

[jira] [Commented] (SPARK-22860) Spark workers log ssl passwords passed to the executors

[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770373#comment-16770373 ] t oo commented on SPARK-22860: -- Not just in worker log, but in 'ps -ef' process list > Spa

[jira] [Created] (SPARK-26908) Fix toMillis

Maxim Gekk created SPARK-26908: -- Summary: Fix toMillis Key: SPARK-26908 URL: https://issues.apache.org/jira/browse/SPARK-26908 Project: Spark Issue Type: Improvement Components: SQL

[jira] [Assigned] (SPARK-26908) Fix toMillis

[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26908: Assignee: (was: Apache Spark) > Fix toMillis > > > Key:

[jira] [Assigned] (SPARK-26908) Fix toMillis

[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26908: Assignee: Apache Spark > Fix toMillis > > > Key: SPARK-26908

[jira] [Commented] (SPARK-15544) Bouncing Zookeeper node causes Active spark master to exit

[ https://issues.apache.org/jira/browse/SPARK-15544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770444#comment-16770444 ] Sean Owen commented on SPARK-15544: --- [~moein7tl] can you propose a fix? this is pretty

[jira] [Resolved] (SPARK-26852) CrossValidator: support transforming metrics to absolute values prior to min/max test

[ https://issues.apache.org/jira/browse/SPARK-26852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26852. --- Resolution: Not A Problem > CrossValidator: support transforming metrics to absolute values prior to

[jira] [Commented] (SPARK-17556) Executor side broadcast for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770481#comment-16770481 ] t oo commented on SPARK-17556: -- please don't leave us [~scwf] > Executor side broadcast fo

[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770482#comment-16770482 ] t oo commented on SPARK-16859: -- please don't leave us [~Hauer] > History Server storage in

[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770559#comment-16770559 ] Andrei Ivanov commented on SPARK-16859: --- Well. It still doesn't work. It's just th

[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770679#comment-16770679 ] t oo commented on SPARK-16859: -- I know how you feel, I submitted a PR to fix a security fla

[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770688#comment-16770688 ] Jungtaek Lim commented on SPARK-16859: -- It's just a matter of "what is more importa

[jira] [Commented] (SPARK-22860) Spark workers log ssl passwords passed to the executors

[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770712#comment-16770712 ] Jungtaek Lim commented on SPARK-22860: -- If we concern only about logging them into

[jira] [Comment Edited] (SPARK-22860) Spark workers log ssl passwords passed to the executors

[ https://issues.apache.org/jira/browse/SPARK-22860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770712#comment-16770712 ] Jungtaek Lim edited comment on SPARK-22860 at 2/18/19 12:52 AM: --

[jira] [Resolved] (SPARK-26878) QueryTest.compare does not handle maps with array keys correctly

[ https://issues.apache.org/jira/browse/SPARK-26878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26878. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23789 [https://gith

[jira] [Assigned] (SPARK-26878) QueryTest.compare does not handle maps with array keys correctly

[ https://issues.apache.org/jira/browse/SPARK-26878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-26878: --- Assignee: Ala Luszczak > QueryTest.compare does not handle maps with array keys correctly >

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: Issue Type: Story (was: New JIRA Project) > Proper termination of external processes launched by

[jira] [Resolved] (SPARK-26897) Update Spark 2.3.x testing from HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-26897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26897. -- Resolution: Fixed Fix Version/s: 2.3.4 2.4.1 3.0.0

[jira] [Resolved] (SPARK-26887) Create datetime.date directly instead of creating datetime64[ns] as intermediate data.

[ https://issues.apache.org/jira/browse/SPARK-26887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26887. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23795 [https://gi

[jira] [Assigned] (SPARK-26887) Create datetime.date directly instead of creating datetime64[ns] as intermediate data.

[ https://issues.apache.org/jira/browse/SPARK-26887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26887: Assignee: Takuya Ueshin > Create datetime.date directly instead of creating datetime64[ns

[jira] [Resolved] (SPARK-26666) DataSourceV2: Add overwrite and dynamic overwrite.

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-2. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23606 [https://gith

[jira] [Assigned] (SPARK-26666) DataSourceV2: Add overwrite and dynamic overwrite.

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-2: --- Assignee: Ryan Blue > DataSourceV2: Add overwrite and dynamic overwrite. >

[jira] [Resolved] (SPARK-26599) BroardCast hint can not work with PruneFileSourcePartitions

[ https://issues.apache.org/jira/browse/SPARK-26599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-26599. - Resolution: Duplicate > BroardCast hint can not work with PruneFileSourcePartitions > --

[jira] [Commented] (SPARK-26533) Support query auto cancel on thriftserver

[ https://issues.apache.org/jira/browse/SPARK-26533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770808#comment-16770808 ] Yuming Wang commented on SPARK-26533: - +1 Hive support this feature: https://issues

[jira] [Updated] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

[ https://issues.apache.org/jira/browse/SPARK-24570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24570: Issue Type: Improvement (was: New Feature) > SparkSQL - show schemas/tables in dropdowns of SQL client to

[jira] [Resolved] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

[ https://issues.apache.org/jira/browse/SPARK-24570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24570. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > SparkSQL - show schemas/t

[jira] [Commented] (SPARK-21733) ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM

[ https://issues.apache.org/jira/browse/SPARK-21733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770841#comment-16770841 ] Xinming Wang commented on SPARK-21733: -- The problem occurs to me too. In my case, I