[jira] [Created] (SPARK-34326) "SPARK-31793: FileSourceScanExec metadata should contain limited file paths" fails in some edge-case

Jungtaek Lim created SPARK-34326: Summary: "SPARK-31793: FileSourceScanExec metadata should contain limited file paths" fails in some edge-case Key: SPARK-34326 URL:

[jira] [Commented] (SPARK-34326) "SPARK-31793: FileSourceScanExec metadata should contain limited file paths" fails in some edge-case

[ https://issues.apache.org/jira/browse/SPARK-34326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276918#comment-17276918 ] Jungtaek Lim commented on SPARK-34326: -- Will provide a PR shortly. > "SPARK-31793:

[jira] [Commented] (SPARK-34293) kubernetes executor pod unable to access secure hdfs

[ https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276913#comment-17276913 ] Manohar Chamaraju commented on SPARK-34293: --- Update: # In client mode by adding fs.defaultFS

[jira] [Resolved] (SPARK-34199) Block `count(table.*)` to follow ANSI standard and other SQL engines

[ https://issues.apache.org/jira/browse/SPARK-34199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34199. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31286

[jira] [Assigned] (SPARK-34199) Block `count(table.*)` to follow ANSI standard and other SQL engines

[ https://issues.apache.org/jira/browse/SPARK-34199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34199: --- Assignee: Linhong Liu > Block `count(table.*)` to follow ANSI standard and other SQL

[jira] [Commented] (SPARK-33591) NULL is recognized as the "null" string in partition specs

[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276908#comment-17276908 ] Apache Spark commented on SPARK-33591: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-33591) NULL is recognized as the "null" string in partition specs

[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276907#comment-17276907 ] Apache Spark commented on SPARK-33591: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

[ https://issues.apache.org/jira/browse/SPARK-34319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34319: Assignee: wuyi > Self-join after cogroup applyInPandas fails due to unresolved

[jira] [Resolved] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

[ https://issues.apache.org/jira/browse/SPARK-34319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34319. -- Fix Version/s: 3.1.2 3.0.2 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276893#comment-17276893 ] L. C. Hsieh commented on SPARK-34198: - Thanks [~kabhwan] for your point. Besides the maintenance

[jira] [Closed] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29220. - > Flaky test: > org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large > number

[jira] [Comment Edited] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276874#comment-17276874 ] Attila Zsolt Piros edited comment on SPARK-34194 at 2/2/21, 6:59 AM: -

[jira] [Resolved] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29220. --- Resolution: Duplicate > Flaky test: >

[jira] [Commented] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276891#comment-17276891 ] Dongjoon Hyun commented on SPARK-29220: --- I agree with you, [~attilapiros].  > Flaky test: >

[jira] [Commented] (SPARK-33734) Spark Core ::Spark core versions upto 3.0.1 using interdependency on Jackson-core-asl version 1.9.13, which is having security issues reported.

[ https://issues.apache.org/jira/browse/SPARK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276890#comment-17276890 ] Aparna commented on SPARK-33734: Hi, Please provide an updates on this, the spark-core 3.1.0 version is

[jira] [Commented] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-34325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276887#comment-17276887 ] Apache Spark commented on SPARK-34325: -- User 'offthewall123' has created a pull request for this

[jira] [Assigned] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-34325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34325: Assignee: Apache Spark > remove_shuffleBlockResolver_in_SortShuffleWriter >

[jira] [Commented] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-34325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276886#comment-17276886 ] Apache Spark commented on SPARK-34325: -- User 'offthewall123' has created a pull request for this

[jira] [Assigned] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-34325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34325: Assignee: (was: Apache Spark) > remove_shuffleBlockResolver_in_SortShuffleWriter >

[jira] [Assigned] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-34325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34325: Assignee: Apache Spark > remove_shuffleBlockResolver_in_SortShuffleWriter >

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276885#comment-17276885 ] Dongjoon Hyun commented on SPARK-34309: --- Oh my. :( > Use Caffeine instead of Guava Cache >

[jira] [Updated] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-34325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-34325: - Description: shuffleBlockResolver in SortShuffleWriter is not used, can remove it. (was:

[jira] [Updated] (SPARK-34322) When refreshing a non-temporary view, also refresh its underlying tables

[ https://issues.apache.org/jira/browse/SPARK-34322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-34322: Description: For a view, there might be several underlying tables. In long-running spark server use

[jira] [Updated] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-34325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-34325: - Description: shuffleBlockResolver in SortShuffleWriter is not used. >

[jira] [Created] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

Xudingyu created SPARK-34325: Summary: remove_shuffleBlockResolver_in_SortShuffleWriter Key: SPARK-34325 URL: https://issues.apache.org/jira/browse/SPARK-34325 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276883#comment-17276883 ] Jungtaek Lim commented on SPARK-34198: -- The external modules means modules in external directory.

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276882#comment-17276882 ] L. C. Hsieh commented on SPARK-34198: - For external module here, I mean to put the related code

[jira] [Assigned] (SPARK-34324) FileTable should not list TRUNCATE in capabilities by default

[ https://issues.apache.org/jira/browse/SPARK-34324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34324: Assignee: Apache Spark (was: L. C. Hsieh) > FileTable should not list TRUNCATE in

[jira] [Assigned] (SPARK-34324) FileTable should not list TRUNCATE in capabilities by default

[ https://issues.apache.org/jira/browse/SPARK-34324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34324: Assignee: L. C. Hsieh (was: Apache Spark) > FileTable should not list TRUNCATE in

[jira] [Commented] (SPARK-34324) FileTable should not list TRUNCATE in capabilities by default

[ https://issues.apache.org/jira/browse/SPARK-34324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276880#comment-17276880 ] Apache Spark commented on SPARK-34324: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-34324) FileTable should not list TRUNCATE in capabilities by default

L. C. Hsieh created SPARK-34324: --- Summary: FileTable should not list TRUNCATE in capabilities by default Key: SPARK-34324 URL: https://issues.apache.org/jira/browse/SPARK-34324 Project: Spark

[jira] [Commented] (SPARK-34322) When refreshing a non-temporary view, also refresh its underlying tables

[ https://issues.apache.org/jira/browse/SPARK-34322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276878#comment-17276878 ] Apache Spark commented on SPARK-34322: -- User 'turboFei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34322) When refreshing a non-temporary view, also refresh its underlying tables

[ https://issues.apache.org/jira/browse/SPARK-34322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34322: Assignee: (was: Apache Spark) > When refreshing a non-temporary view, also refresh

[jira] [Commented] (SPARK-34322) When refreshing a non-temporary view, also refresh its underlying tables

[ https://issues.apache.org/jira/browse/SPARK-34322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276877#comment-17276877 ] Apache Spark commented on SPARK-34322: -- User 'turboFei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34322) When refreshing a non-temporary view, also refresh its underlying tables

[ https://issues.apache.org/jira/browse/SPARK-34322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34322: Assignee: Apache Spark > When refreshing a non-temporary view, also refresh its

[jira] [Updated] (SPARK-34316) Support spark.kubernetes.executor.disableConfigMap

[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34316: -- Summary: Support spark.kubernetes.executor.disableConfigMap (was: Optional Propagation of

[jira] [Assigned] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34316: - Assignee: Dongjoon Hyun > Optional Propagation of SPARK_CONF_DIR in K8s >

[jira] [Resolved] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34316. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31428

[jira] [Updated] (SPARK-34314) Wrong discovered partition value

[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34314: --- Affects Version/s: 3.1.0 3.0.2 2.4.8 > Wrong

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276875#comment-17276875 ] Cheng Su commented on SPARK-34198: -- Sorry I think my question is not very clear. I am aware of

[jira] [Commented] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276874#comment-17276874 ] Attila Zsolt Piros commented on SPARK-34194: Yes. > Queries that only touch partition

[jira] [Assigned] (SPARK-34323) Upgrade zstd-jni to 1.4.8-3

[ https://issues.apache.org/jira/browse/SPARK-34323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34323: Assignee: (was: Apache Spark) > Upgrade zstd-jni to 1.4.8-3 >

[jira] [Commented] (SPARK-34323) Upgrade zstd-jni to 1.4.8-3

[ https://issues.apache.org/jira/browse/SPARK-34323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276873#comment-17276873 ] Apache Spark commented on SPARK-34323: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-34323) Upgrade zstd-jni to 1.4.8-3

[ https://issues.apache.org/jira/browse/SPARK-34323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34323: Assignee: Apache Spark > Upgrade zstd-jni to 1.4.8-3 > --- > >

[jira] [Created] (SPARK-34323) Upgrade zstd-jni to 1.4.8-3

William Hyun created SPARK-34323: Summary: Upgrade zstd-jni to 1.4.8-3 Key: SPARK-34323 URL: https://issues.apache.org/jira/browse/SPARK-34323 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-34322) When refreshing a non-temporary view, also refresh its underlying tables

feiwang created SPARK-34322: --- Summary: When refreshing a non-temporary view, also refresh its underlying tables Key: SPARK-34322 URL: https://issues.apache.org/jira/browse/SPARK-34322 Project: Spark

[jira] [Comment Edited] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276869#comment-17276869 ] Nicholas Chammas edited comment on SPARK-34194 at 2/2/21, 5:56 AM: ---

[jira] [Assigned] (SPARK-34295) Allow option similar to mapreduce.job.hdfs-servers.token-renewal.exclude

[ https://issues.apache.org/jira/browse/SPARK-34295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34295: --- Assignee: L. C. Hsieh > Allow option similar to

[jira] [Commented] (SPARK-34194) Queries that only touch partition columns shouldn't scan through all files

[ https://issues.apache.org/jira/browse/SPARK-34194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276869#comment-17276869 ] Nicholas Chammas commented on SPARK-34194: -- Interesting reference, [~attilapiros]. It looks

[jira] [Commented] (SPARK-34321) Fix the guarantee of foreachBatch

[ https://issues.apache.org/jira/browse/SPARK-34321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276865#comment-17276865 ] L. C. Hsieh commented on SPARK-34321: - Err...I made a mistake when reading the document and code.

[jira] [Comment Edited] (SPARK-12497) thriftServer does not support semicolon in sql

[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276864#comment-17276864 ] xinzhang edited comment on SPARK-12497 at 2/2/21, 5:44 AM: --- [~kabhwan] Sorry

[jira] [Resolved] (SPARK-34321) Fix the guarantee of foreachBatch

[ https://issues.apache.org/jira/browse/SPARK-34321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34321. - Resolution: Invalid > Fix the guarantee of foreachBatch > - > >

[jira] [Created] (SPARK-34321) Fix the guarantee of foreachBatch

L. C. Hsieh created SPARK-34321: --- Summary: Fix the guarantee of foreachBatch Key: SPARK-34321 URL: https://issues.apache.org/jira/browse/SPARK-34321 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql

[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276864#comment-17276864 ] xinzhang commented on SPARK-12497: -- [~kabhwan] Sorry for the mixed up Tests. Please recheck the new

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276863#comment-17276863 ] L. C. Hsieh commented on SPARK-34198: - If you are asking why adding it as an external module instead

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276857#comment-17276857 ] Cheng Su commented on SPARK-34198: -- [~viirya] - could you help elaborate what's the benefit of adding

[jira] [Created] (SPARK-34320) Migrate ALTER TABLE drop columns command to the new resolution framework

Terry Kim created SPARK-34320: - Summary: Migrate ALTER TABLE drop columns command to the new resolution framework Key: SPARK-34320 URL: https://issues.apache.org/jira/browse/SPARK-34320 Project: Spark

[jira] [Commented] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

[ https://issues.apache.org/jira/browse/SPARK-34319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276818#comment-17276818 ] Apache Spark commented on SPARK-34319: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

[ https://issues.apache.org/jira/browse/SPARK-34319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34319: Assignee: Apache Spark > Self-join after cogroup applyInPandas fails due to unresolved

[jira] [Assigned] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

[ https://issues.apache.org/jira/browse/SPARK-34319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34319: Assignee: (was: Apache Spark) > Self-join after cogroup applyInPandas fails due to

[jira] [Created] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

wuyi created SPARK-34319: Summary: Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes Key: SPARK-34319 URL: https://issues.apache.org/jira/browse/SPARK-34319 Project: Spark

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276806#comment-17276806 ] Yang Jie commented on SPARK-34309: -- There has been a patch to replace all the places. However, when

[jira] [Assigned] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34316: Assignee: (was: Apache Spark) > Optional Propagation of SPARK_CONF_DIR in K8s >

[jira] [Updated] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34316: -- Affects Version/s: (was: 3.0.1) 3.2.0 > Optional Propagation of

[jira] [Commented] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276782#comment-17276782 ] Dongjoon Hyun commented on SPARK-34316: --- Thank you for filing a Jira issue, [~zhou_jiang]. >

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276766#comment-17276766 ] Dongjoon Hyun commented on SPARK-34309: --- Thank you for pinging me, [~LuciferYang]. The benchmark

[jira] [Assigned] (SPARK-34300) Fix of typos in documentation of pyspark.sql.functions and output of lint-python

[ https://issues.apache.org/jira/browse/SPARK-34300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34300: Assignee: David Toneian > Fix of typos in documentation of pyspark.sql.functions and

[jira] [Resolved] (SPARK-34300) Fix of typos in documentation of pyspark.sql.functions and output of lint-python

[ https://issues.apache.org/jira/browse/SPARK-34300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34300. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31401

[jira] [Resolved] (SPARK-34306) Use Snake naming rule across the function APIs

[ https://issues.apache.org/jira/browse/SPARK-34306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34306. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31408

[jira] [Updated] (SPARK-34310) Replaces map and flatten with flatMap

[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34310: - Fix Version/s: 3.1.2 3.0.2 > Replaces map and flatten with flatMap >

[jira] [Updated] (SPARK-34310) Replaces map and flatten with flatMap

[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34310: - Fix Version/s: 2.4.8 > Replaces map and flatten with flatMap >

[jira] [Commented] (SPARK-34209) Allow multiple namespaces with session catalog

[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276728#comment-17276728 ] Apache Spark commented on SPARK-34209: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34209) Allow multiple namespaces with session catalog

[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276727#comment-17276727 ] Apache Spark commented on SPARK-34209: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34209) Allow multiple namespaces with session catalog

[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34209: Assignee: Apache Spark > Allow multiple namespaces with session catalog >

[jira] [Assigned] (SPARK-34209) Allow multiple namespaces with session catalog

[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34209: Assignee: (was: Apache Spark) > Allow multiple namespaces with session catalog >

[jira] [Comment Edited] (SPARK-26325) Interpret timestamp fields in Spark while reading json (timestampFormat)

[ https://issues.apache.org/jira/browse/SPARK-26325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276711#comment-17276711 ] Daniel Himmelstein edited comment on SPARK-26325 at 2/1/21, 10:53 PM:

[jira] [Commented] (SPARK-26325) Interpret timestamp fields in Spark while reading json (timestampFormat)

[ https://issues.apache.org/jira/browse/SPARK-26325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276711#comment-17276711 ] Daniel Himmelstein commented on SPARK-26325: Here's the code from the original post, but

[jira] [Assigned] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

[ https://issues.apache.org/jira/browse/SPARK-34318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34318: Assignee: Kousuke Saruta (was: Apache Spark) > Dataset.colRegex should work with column

[jira] [Commented] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

[ https://issues.apache.org/jira/browse/SPARK-34318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276708#comment-17276708 ] Apache Spark commented on SPARK-34318: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

[ https://issues.apache.org/jira/browse/SPARK-34318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34318: Assignee: Apache Spark (was: Kousuke Saruta) > Dataset.colRegex should work with column

[jira] [Created] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

Kousuke Saruta created SPARK-34318: -- Summary: Dataset.colRegex should work with column names and qualifiers which contain newlines Key: SPARK-34318 URL: https://issues.apache.org/jira/browse/SPARK-34318

[jira] [Commented] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276682#comment-17276682 ] Apache Spark commented on SPARK-34315: -- User 'timhughes' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34315: Assignee: Apache Spark > docker-image-tool.sh debconf trying to configure kerberos >

[jira] [Assigned] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34315: Assignee: (was: Apache Spark) > docker-image-tool.sh debconf trying to configure

[jira] [Commented] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276681#comment-17276681 ] Tim Hughes commented on SPARK-34315: Created a pull request

[jira] [Commented] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276680#comment-17276680 ] Tim Hughes commented on SPARK-34315:

[jira] [Commented] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

[ https://issues.apache.org/jira/browse/SPARK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276655#comment-17276655 ] Apache Spark commented on SPARK-34317: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

[ https://issues.apache.org/jira/browse/SPARK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34317: Assignee: (was: Apache Spark) > Introduce relationTypeMismatchHint to

[jira] [Assigned] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

[ https://issues.apache.org/jira/browse/SPARK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34317: Assignee: Apache Spark > Introduce relationTypeMismatchHint to UnresolvedTable for a

[jira] [Commented] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

[ https://issues.apache.org/jira/browse/SPARK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276654#comment-17276654 ] Apache Spark commented on SPARK-34317: -- User 'imback82' has created a pull request for this issue:

[jira] [Updated] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Hughes updated SPARK-34315: --- Environment: (was: # ## Full logs   {{}}{{}}) > docker-image-tool.sh debconf trying to

[jira] [Created] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

Terry Kim created SPARK-34317: - Summary: Introduce relationTypeMismatchHint to UnresolvedTable for a better error message Key: SPARK-34317 URL: https://issues.apache.org/jira/browse/SPARK-34317 Project:

[jira] [Created] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

Zhou JIANG created SPARK-34316: -- Summary: Optional Propagation of SPARK_CONF_DIR in K8s Key: SPARK-34316 URL: https://issues.apache.org/jira/browse/SPARK-34316 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Hughes updated SPARK-34315: --- Attachment: full-logs.txt > docker-image-tool.sh debconf trying to configure kerberos >

[jira] [Updated] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Hughes updated SPARK-34315: --- Environment: # ## Full logs   {{}}{{}} was: ## Full logs   {{}}{{$

[jira] [Created] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

Tim Hughes created SPARK-34315: -- Summary: docker-image-tool.sh debconf trying to configure kerberos Key: SPARK-34315 URL: https://issues.apache.org/jira/browse/SPARK-34315 Project: Spark Issue

[jira] [Commented] (SPARK-34314) Wrong discovered partition value

[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276612#comment-17276612 ] Apache Spark commented on SPARK-34314: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34314) Wrong discovered partition value

[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34314: Assignee: Apache Spark > Wrong discovered partition value >

[jira] [Assigned] (SPARK-34314) Wrong discovered partition value

[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34314: Assignee: (was: Apache Spark) > Wrong discovered partition value >

[jira] [Commented] (SPARK-34314) Wrong discovered partition value

[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276610#comment-17276610 ] Apache Spark commented on SPARK-34314: -- User 'MaxGekk' has created a pull request for this issue:

  1   2   >