[jira] [Commented] (SPARK-31769) Add support of MDC in spark driver logs.

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115040#comment-17115040 ] Apache Spark commented on SPARK-31769: -- User 'igreenfield' has created a pull reque

[jira] [Assigned] (SPARK-31769) Add support of MDC in spark driver logs.

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31769: Assignee: (was: Apache Spark) > Add support of MDC in spark driver logs. > --

[jira] [Assigned] (SPARK-31769) Add support of MDC in spark driver logs.

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31769: Assignee: Apache Spark > Add support of MDC in spark driver logs. > -

[jira] [Commented] (SPARK-31761) Sql Div operator can result in incorrect output for int_min

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115037#comment-17115037 ] Apache Spark commented on SPARK-31761: -- User 'sandeep-katta' has created a pull req

[jira] [Resolved] (SPARK-31761) Sql Div operator can result in incorrect output for int_min

2020-05-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31761. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in https://github.com/apache/spark/pull/28

[jira] [Commented] (SPARK-31756) Add real headless browser support for UI test

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115030#comment-17115030 ] Apache Spark commented on SPARK-31756: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-28481) More expressions should extend NullIntolerant

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115029#comment-17115029 ] Apache Spark commented on SPARK-28481: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-28481) More expressions should extend NullIntolerant

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28481: Assignee: (was: Apache Spark) > More expressions should extend NullIntolerant > -

[jira] [Assigned] (SPARK-28481) More expressions should extend NullIntolerant

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28481: Assignee: Apache Spark > More expressions should extend NullIntolerant >

[jira] [Commented] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

2020-05-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115028#comment-17115028 ] Dongjoon Hyun commented on SPARK-31786: --- As a workaround for 2.4.6, users can set

[jira] [Commented] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

2020-05-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115024#comment-17115024 ] Dongjoon Hyun commented on SPARK-31786: --- We are hitting jackson-core 2.10.0 incomp

[jira] [Updated] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

2020-05-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31786: -- Target Version/s: 3.0.0 (was: 2.4.6, 3.0.0) > Exception on submitting Spark-Pi to Kubernetes

[jira] [Commented] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115008#comment-17115008 ] Apache Spark commented on SPARK-31786: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115009#comment-17115009 ] Apache Spark commented on SPARK-31786: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-30715) Upgrade fabric8 to 4.7.1 to support K8s 1.17

2020-05-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30715: -- Affects Version/s: (was: 3.1.0) 3.0.0 > Upgrade fabric8 to 4.7.1 to

[jira] [Updated] (SPARK-30715) Upgrade fabric8 to 4.7.1 to support K8s 1.17

2020-05-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30715: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Upgrade fabric8 to 4.7.1 to support

[jira] [Updated] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

2020-05-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31786: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Exception on submitting Spark-Pi to

[jira] [Commented] (SPARK-31756) Add real headless browser support for UI test

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114996#comment-17114996 ] Apache Spark commented on SPARK-31756: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-31805) Spark Structured Streaming with "assign" KafkaConsumer mode still uses group.id

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31805: Assignee: (was: Apache Spark) > Spark Structured Streaming with "assign" KafkaConsume

[jira] [Commented] (SPARK-31805) Spark Structured Streaming with "assign" KafkaConsumer mode still uses group.id

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114991#comment-17114991 ] Apache Spark commented on SPARK-31805: -- User 'tashoyan' has created a pull request

[jira] [Assigned] (SPARK-31805) Spark Structured Streaming with "assign" KafkaConsumer mode still uses group.id

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31805: Assignee: Apache Spark > Spark Structured Streaming with "assign" KafkaConsumer mode stil

[jira] [Assigned] (SPARK-31805) Spark Structured Streaming with "assign" KafkaConsumer mode still uses group.id

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31805: Assignee: (was: Apache Spark) > Spark Structured Streaming with "assign" KafkaConsume

[jira] [Updated] (SPARK-31805) Spark Structured Streaming with "assign" KafkaConsumer mode still uses group.id

2020-05-23 Thread Arseniy Tashoyan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arseniy Tashoyan updated SPARK-31805: - Description: [Spark Structured Streaming - Kafka integration|https://spark.apache.org/d

[jira] [Resolved] (SPARK-31793) Reduce the memory usage in file scan location metadata

2020-05-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-31793. Resolution: Fixed > Reduce the memory usage in file scan location metadata > -

[jira] [Commented] (SPARK-31793) Reduce the memory usage in file scan location metadata

2020-05-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114964#comment-17114964 ] Gengliang Wang commented on SPARK-31793: The issue is resolved in https://github

[jira] [Updated] (SPARK-31805) Spark Structured Streaming with "assign" KafkaConsumer mode still uses group.id

2020-05-23 Thread Arseniy Tashoyan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arseniy Tashoyan updated SPARK-31805: - Description: [Spark Structured Streaming - Kafka integration|https://spark.apache.org/d

[jira] [Created] (SPARK-31805) Spark Structured Streaming with "assign" KafkaConsumer mode still uses group.id

2020-05-23 Thread Arseniy Tashoyan (Jira)
Arseniy Tashoyan created SPARK-31805: Summary: Spark Structured Streaming with "assign" KafkaConsumer mode still uses group.id Key: SPARK-31805 URL: https://issues.apache.org/jira/browse/SPARK-31805

[jira] [Resolved] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

2020-05-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31786. --- Fix Version/s: 3.1.0 Assignee: Dongjoon Hyun Resolution: Fixed I'm working o

[jira] [Commented] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-23 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114866#comment-17114866 ] Pablo Langa Blanco commented on SPARK-31779: Hi [~jeff.w.evans] I think th

[jira] [Updated] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-05-23 Thread James Boylan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Boylan updated SPARK-31800: - Description: When you attempt to submit a process to Kubernetes using spark-submit through --ma

[jira] [Updated] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-05-23 Thread James Boylan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Boylan updated SPARK-31800: - Description: When you attempt to submit a process to Kubernetes using spark-submit through --ma

[jira] [Resolved] (SPARK-31642) Support pagination for spark structured streaming tab

2020-05-23 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-31642. Fix Version/s: 3.1.0 Assignee: Rakesh Raushan Resolution: Fixed > Support

[jira] [Assigned] (SPARK-31804) Add real headless browser support for HistoryServer tests

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31804: Assignee: Kousuke Saruta (was: Apache Spark) > Add real headless browser support for His

[jira] [Assigned] (SPARK-31804) Add real headless browser support for HistoryServer tests

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31804: Assignee: Apache Spark (was: Kousuke Saruta) > Add real headless browser support for His

[jira] [Commented] (SPARK-31804) Add real headless browser support for HistoryServer tests

2020-05-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114600#comment-17114600 ] Apache Spark commented on SPARK-31804: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-31804) Add real headless browser support for HistoryServer tests

2020-05-23 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31804: -- Summary: Add real headless browser support for HistoryServer tests Key: SPARK-31804 URL: https://issues.apache.org/jira/browse/SPARK-31804 Project: Spark