[jira] [Commented] (SPARK-33616) Join queries across different datasources (hive and hive)

[ https://issues.apache.org/jira/browse/SPARK-33616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241323#comment-17241323 ] Hyukjin Kwon commented on SPARK-33616: -- Currently there's no plan for that. You could try to use

[jira] [Commented] (SPARK-19256) Hive bucketing write support

[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241309#comment-17241309 ] Cheng Su commented on SPARK-19256: -- Sorry for delaying, just an update for progress. We identified a

[jira] [Updated] (SPARK-33298) FileCommitProtocol V2

[ https://issues.apache.org/jira/browse/SPARK-33298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-33298: - Parent: SPARK-19256 Issue Type: Sub-task (was: New Feature) > FileCommitProtocol V2 >

[jira] [Updated] (SPARK-33598) Support Java Class with circular references

[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacklzg updated SPARK-33598: Description: If the target Java data class has a circular reference, Spark will fail fast from creating

[jira] [Updated] (SPARK-33598) Support Java Class with circular references

[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacklzg updated SPARK-33598: Description: If the target Java data class has a circular reference, Spark will fail fast from creating

[jira] [Updated] (SPARK-33598) Support Java Class with circular references

[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacklzg updated SPARK-33598: Description: If the target Java data class has a circular reference, Spark will fail fast from creating

[jira] [Updated] (SPARK-33598) Support Java Class with circular references

[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacklzg updated SPARK-33598: Description: If the target Java data class has a circular reference, Spark will fail fast from creating

[jira] [Created] (SPARK-33616) Join queries across different datasources (hive and hive)

Fang Wen created SPARK-33616: Summary: Join queries across different datasources (hive and hive) Key: SPARK-33616 URL: https://issues.apache.org/jira/browse/SPARK-33616 Project: Spark Issue

[jira] [Updated] (SPARK-33598) Support Java Class with circular references

[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacklzg updated SPARK-33598: Description: If the target Java data class has a circular reference, Spark will fail fast from creating

[jira] [Updated] (SPARK-33598) Support Java Class with circular references

[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jacklzg updated SPARK-33598: Description: If the target Java data class has a circular reference, Spark will fail fast from creating

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, there are three major

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, there are three major

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, there are three major

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, there are three major

[jira] [Commented] (SPARK-33615) Add an integration test of K8S for archive feature

[ https://issues.apache.org/jira/browse/SPARK-33615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241256#comment-17241256 ] Dongjoon Hyun commented on SPARK-33615: --- Thank you, [~hyukjin.kwon]. I collected this into

[jira] [Updated] (SPARK-33615) Add an integration test of K8S for archive feature

[ https://issues.apache.org/jira/browse/SPARK-33615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33615: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Test) > Add an integration test of

[jira] [Resolved] (SPARK-27188) FileStreamSink: provide a new option to have retention on output files

[ https://issues.apache.org/jira/browse/SPARK-27188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-27188. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28363

[jira] [Assigned] (SPARK-27188) FileStreamSink: provide a new option to have retention on output files

[ https://issues.apache.org/jira/browse/SPARK-27188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-27188: Assignee: Jungtaek Lim > FileStreamSink: provide a new option to have retention on

[jira] [Updated] (SPARK-33615) Add an integration test of K8S for archive feature

[ https://issues.apache.org/jira/browse/SPARK-33615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33615: - Description: {{--archive}} submit option and {{spark.archives}} configuration were added at

[jira] [Created] (SPARK-33615) Add an integration test of K8S for archive feature

Hyukjin Kwon created SPARK-33615: Summary: Add an integration test of K8S for archive feature Key: SPARK-33615 URL: https://issues.apache.org/jira/browse/SPARK-33615 Project: Spark Issue

[jira] [Assigned] (SPARK-33530) Support --archives option natively

[ https://issues.apache.org/jira/browse/SPARK-33530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33530: Assignee: Hyukjin Kwon > Support --archives option natively >

[jira] [Resolved] (SPARK-33530) Support --archives option natively

[ https://issues.apache.org/jira/browse/SPARK-33530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33530. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30486

[jira] [Resolved] (SPARK-33380) Incorrect output from example script pi.py

[ https://issues.apache.org/jira/browse/SPARK-33380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33380. -- Resolution: Won't Fix > Incorrect output from example script pi.py >

[jira] [Resolved] (SPARK-30900) FileStreamSource: Avoid reading compact metadata log twice if the query stops from compact batch and restarts

[ https://issues.apache.org/jira/browse/SPARK-30900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-30900. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27649

[jira] [Assigned] (SPARK-30900) FileStreamSource: Avoid reading compact metadata log twice if the query stops from compact batch and restarts

[ https://issues.apache.org/jira/browse/SPARK-30900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-30900: Assignee: Jungtaek Lim > FileStreamSource: Avoid reading compact metadata log twice if

[jira] [Created] (SPARK-33614) Fix the constant folding rule to skip it if the expression fails to execute

Lu Lu created SPARK-33614: - Summary: Fix the constant folding rule to skip it if the expression fails to execute Key: SPARK-33614 URL: https://issues.apache.org/jira/browse/SPARK-33614 Project: Spark

[jira] [Resolved] (SPARK-33607) Input Rate timeline/histogram aren't rendered if built with Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33607. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30546

[jira] [Resolved] (SPARK-33596) NPE when there is no watermark metrics

[ https://issues.apache.org/jira/browse/SPARK-33596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu resolved SPARK-33596. --- Resolution: Won't Fix > NPE when there is no watermark metrics >

[jira] [Resolved] (SPARK-33613) [Python][Tests] Replace calls to deprecated test APIs

[ https://issues.apache.org/jira/browse/SPARK-33613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33613. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30557

[jira] [Assigned] (SPARK-33613) [Python][Tests] Replace calls to deprecated test APIs

[ https://issues.apache.org/jira/browse/SPARK-33613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33613: Assignee: Bryan Cutler > [Python][Tests] Replace calls to deprecated test APIs >

[jira] [Resolved] (SPARK-33556) Add array_to_vector function for dataframe column

[ https://issues.apache.org/jira/browse/SPARK-33556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33556. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30498

[jira] [Assigned] (SPARK-33556) Add array_to_vector function for dataframe column

[ https://issues.apache.org/jira/browse/SPARK-33556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33556: Assignee: Weichen Xu > Add array_to_vector function for dataframe column >

[jira] [Resolved] (SPARK-32410) Support the BATCH_WRITE capability by JDBCTable

[ https://issues.apache.org/jira/browse/SPARK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-32410. Resolution: Duplicate > Support the BATCH_WRITE capability by JDBCTable >

[jira] [Commented] (SPARK-32410) Support the BATCH_WRITE capability by JDBCTable

[ https://issues.apache.org/jira/browse/SPARK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241160#comment-17241160 ] Huaxin Gao commented on SPARK-32410: The problem was resolved in

[jira] [Resolved] (SPARK-32396) Support the BATCH_READ capability by JDBCTable

[ https://issues.apache.org/jira/browse/SPARK-32396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-32396. Resolution: Duplicate > Support the BATCH_READ capability by JDBCTable >

[jira] [Commented] (SPARK-32396) Support the BATCH_READ capability by JDBCTable

[ https://issues.apache.org/jira/browse/SPARK-32396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241158#comment-17241158 ] Huaxin Gao commented on SPARK-32396: The problem was resolved in

[jira] [Resolved] (SPARK-32523) Override alter table in JDBC dialects

[ https://issues.apache.org/jira/browse/SPARK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-32523. Resolution: Duplicate > Override alter table in JDBC dialects >

[jira] [Commented] (SPARK-32523) Override alter table in JDBC dialects

[ https://issues.apache.org/jira/browse/SPARK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241155#comment-17241155 ] Huaxin Gao commented on SPARK-32523: This is fixed by smaller PRs. I will close this ticket. >

[jira] [Commented] (SPARK-32427) Omit USING in CREATE TABLE via JDBC Table Catalog

[ https://issues.apache.org/jira/browse/SPARK-32427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241154#comment-17241154 ] Huaxin Gao commented on SPARK-32427: Problem was fixed in the CREATE TABLE unification PR and tests

[jira] [Resolved] (SPARK-32427) Omit USING in CREATE TABLE via JDBC Table Catalog

[ https://issues.apache.org/jira/browse/SPARK-32427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-32427. Resolution: Duplicate > Omit USING in CREATE TABLE via JDBC Table Catalog >

[jira] [Resolved] (SPARK-32603) CREATE/REPLACE TABLE AS SELECT not support multi-part identifiers

[ https://issues.apache.org/jira/browse/SPARK-32603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-32603. Resolution: Duplicate > CREATE/REPLACE TABLE AS SELECT not support multi-part identifiers >

[jira] [Commented] (SPARK-32603) CREATE/REPLACE TABLE AS SELECT not support multi-part identifiers

[ https://issues.apache.org/jira/browse/SPARK-32603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241153#comment-17241153 ] Huaxin Gao commented on SPARK-32603: Tests have been updated in

[jira] [Resolved] (SPARK-33072) Remove two Hive 1.2-related Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-33072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-33072. - Assignee: Shane Knapp Resolution: Fixed > Remove two Hive 1.2-related Jenkins jobs >

[jira] [Commented] (SPARK-33072) Remove two Hive 1.2-related Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-33072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241149#comment-17241149 ] Shane Knapp commented on SPARK-33072: - done! > Remove two Hive 1.2-related Jenkins jobs >

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241092#comment-17241092 ] Bryan Cutler commented on SPARK-33489: -- Great, thanks [~cactice] ! Please feel free to ping me if

[jira] [Assigned] (SPARK-33440) Spark schedules on updating delegation token with 0 interval under some token provider implementation

[ https://issues.apache.org/jira/browse/SPARK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-33440: Assignee: Jungtaek Lim > Spark schedules on updating delegation token with 0 interval

[jira] [Resolved] (SPARK-33440) Spark schedules on updating delegation token with 0 interval under some token provider implementation

[ https://issues.apache.org/jira/browse/SPARK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33440. -- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-33545) Support Fallback Storage during Worker decommission

[ https://issues.apache.org/jira/browse/SPARK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33545. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30492

[jira] [Commented] (SPARK-33612) Add v2SourceRewriteRules batch to Optimizer

[ https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241038#comment-17241038 ] Apache Spark commented on SPARK-33612: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-33612) Add v2SourceRewriteRules batch to Optimizer

[ https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33612: Assignee: Apache Spark > Add v2SourceRewriteRules batch to Optimizer >

[jira] [Assigned] (SPARK-33612) Add v2SourceRewriteRules batch to Optimizer

[ https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33612: Assignee: (was: Apache Spark) > Add v2SourceRewriteRules batch to Optimizer >

[jira] [Commented] (SPARK-33612) Add v2SourceRewriteRules batch to Optimizer

[ https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241036#comment-17241036 ] Apache Spark commented on SPARK-33612: -- User 'aokolnychyi' has created a pull request for this

[jira] [Commented] (SPARK-33613) [Python][Tests] Replace calls to deprecated test APIs

[ https://issues.apache.org/jira/browse/SPARK-33613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241029#comment-17241029 ] Apache Spark commented on SPARK-33613: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-33613) [Python][Tests] Replace calls to deprecated test APIs

[ https://issues.apache.org/jira/browse/SPARK-33613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33613: Assignee: (was: Apache Spark) > [Python][Tests] Replace calls to deprecated test

[jira] [Assigned] (SPARK-33613) [Python][Tests] Replace calls to deprecated test APIs

[ https://issues.apache.org/jira/browse/SPARK-33613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33613: Assignee: Apache Spark > [Python][Tests] Replace calls to deprecated test APIs >

[jira] [Commented] (SPARK-33613) [Python][Tests] Replace calls to deprecated test APIs

[ https://issues.apache.org/jira/browse/SPARK-33613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241027#comment-17241027 ] Apache Spark commented on SPARK-33613: -- User 'BryanCutler' has created a pull request for this

[jira] [Resolved] (SPARK-33185) YARN: Print direct links to driver logs alongside application report in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-33185. - Resolution: Fixed Issue resolved by pull request 30450

[jira] [Updated] (SPARK-33612) Add v2SourceRewriteRules batch to Optimizer

[ https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-33612: - Description: Right now, we have a special place in the optimizer where we run rules for

[jira] [Updated] (SPARK-33612) Add v2SourceRewriteRules batch to Optimizer

[ https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-33612: - Description: Right now, we have a special place in the optimizer where we run rules for

[jira] [Created] (SPARK-33613) [Python][Tests] Replace calls to deprecated test APIs

Bryan Cutler created SPARK-33613: Summary: [Python][Tests] Replace calls to deprecated test APIs Key: SPARK-33613 URL: https://issues.apache.org/jira/browse/SPARK-33613 Project: Spark Issue

[jira] [Updated] (SPARK-33612) Add v2SourceRewriteRules batch to Optimizer

[ https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-33612: - Summary: Add v2SourceRewriteRules batch to Optimizer (was: Rename

[jira] [Commented] (SPARK-33212) Move to shaded clients for Hadoop 3.x profile

[ https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240983#comment-17240983 ] Apache Spark commented on SPARK-33212: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-33212) Move to shaded clients for Hadoop 3.x profile

[ https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240982#comment-17240982 ] Apache Spark commented on SPARK-33212: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-33608) Handle DELETE/UPDATE/MERGE in PullupCorrelatedPredicates rule

[ https://issues.apache.org/jira/browse/SPARK-33608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240967#comment-17240967 ] Apache Spark commented on SPARK-33608: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-33608) Handle DELETE/UPDATE/MERGE in PullupCorrelatedPredicates rule

[ https://issues.apache.org/jira/browse/SPARK-33608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33608: Assignee: (was: Apache Spark) > Handle DELETE/UPDATE/MERGE in

[jira] [Commented] (SPARK-33608) Handle DELETE/UPDATE/MERGE in PullupCorrelatedPredicates rule

[ https://issues.apache.org/jira/browse/SPARK-33608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240966#comment-17240966 ] Apache Spark commented on SPARK-33608: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-33608) Handle DELETE/UPDATE/MERGE in PullupCorrelatedPredicates rule

[ https://issues.apache.org/jira/browse/SPARK-33608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33608: Assignee: Apache Spark > Handle DELETE/UPDATE/MERGE in PullupCorrelatedPredicates rule >

[jira] [Created] (SPARK-33612) Rename earlyScanPushDownRules to be more generic

Anton Okolnychyi created SPARK-33612: Summary: Rename earlyScanPushDownRules to be more generic Key: SPARK-33612 URL: https://issues.apache.org/jira/browse/SPARK-33612 Project: Spark

[jira] [Commented] (SPARK-33612) Rename earlyScanPushDownRules to be more generic

[ https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240937#comment-17240937 ] Anton Okolnychyi commented on SPARK-33612: -- I am going to submit a PR soon. > Rename

[jira] [Comment Edited] (SPARK-33605) Add GCS FS/connector to the dependencies akin to S3

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240863#comment-17240863 ] Rafal Wojdyla edited comment on SPARK-33605 at 11/30/20, 5:33 PM: --

[jira] [Updated] (SPARK-33605) Add GCS FS/connector to the dependencies akin to S3

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated SPARK-33605: -- Description: Spark comes with some S3 batteries included, which makes it easier to use with

[jira] [Assigned] (SPARK-30098) Use default datasource as provider for CREATE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30098: Assignee: Apache Spark > Use default datasource as provider for CREATE TABLE command >

[jira] [Commented] (SPARK-30098) Use default datasource as provider for CREATE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240897#comment-17240897 ] Apache Spark commented on SPARK-30098: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-30098) Use default datasource as provider for CREATE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240899#comment-17240899 ] Apache Spark commented on SPARK-30098: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-30098) Use default datasource as provider for CREATE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30098: Assignee: (was: Apache Spark) > Use default datasource as provider for CREATE TABLE

[jira] [Commented] (SPARK-33576) PythonException: An exception was thrown from a UDF: 'OSError: Invalid IPC message: negative bodyLength'.

[ https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240896#comment-17240896 ] Darshat commented on SPARK-33576: - Hi Hyukjin, Thanks for your reply.  I cannot repro on a smaller

[jira] [Updated] (SPARK-33545) Support Fallback Storage during Worker decommission

[ https://issues.apache.org/jira/browse/SPARK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33545: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Support Fallback

[jira] [Assigned] (SPARK-33545) Support Fallback Storage during Worker decommission

[ https://issues.apache.org/jira/browse/SPARK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33545: - Assignee: Dongjoon Hyun > Support Fallback Storage during Worker decommission >

[jira] [Reopened] (SPARK-30098) Use default datasource as provider for CREATE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-30098: - > Use default datasource as provider for CREATE TABLE command >

[jira] [Updated] (SPARK-30098) Use default datasource as provider for CREATE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30098: Description: Changing the default provider from `hive` to the value of

[jira] [Updated] (SPARK-30098) Use default datasource as provider for CREATE TABLE command

[ https://issues.apache.org/jira/browse/SPARK-30098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30098: Summary: Use default datasource as provider for CREATE TABLE command (was: Use default

[jira] [Commented] (SPARK-32603) CREATE/REPLACE TABLE AS SELECT not support multi-part identifiers

[ https://issues.apache.org/jira/browse/SPARK-32603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240871#comment-17240871 ] Wenchen Fan commented on SPARK-32603: - CREATE TABLE unification PR is merged. [~huaxingao] can you

[jira] [Comment Edited] (SPARK-33605) Add GCS FS/connector to the dependencies akin to S3

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240863#comment-17240863 ] Rafal Wojdyla edited comment on SPARK-33605 at 11/30/20, 4:45 PM: --

[jira] [Comment Edited] (SPARK-33605) Add GCS FS/connector to the dependencies akin to S3

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240863#comment-17240863 ] Rafal Wojdyla edited comment on SPARK-33605 at 11/30/20, 4:45 PM: --

[jira] [Updated] (SPARK-33605) Add GCS FS/connector to the dependencies akin to S3

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated SPARK-33605: -- Description: Spark comes with some S3 batteries included, which makes it easier to use with

[jira] [Updated] (SPARK-33588) Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive`

[ https://issues.apache.org/jira/browse/SPARK-33588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33588: -- Fix Version/s: 2.4.8 > Partition spec in SHOW TABLE EXTENDED doesn't respect >

[jira] [Commented] (SPARK-33605) Add GCS FS/connector to the dependencies akin to S3

[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240863#comment-17240863 ] Rafal Wojdyla commented on SPARK-33605: --- Actually, the pyspark package includes the config for S3

[jira] [Updated] (SPARK-33588) Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive`

[ https://issues.apache.org/jira/browse/SPARK-33588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33588: -- Fix Version/s: 3.0.2 > Partition spec in SHOW TABLE EXTENDED doesn't respect >

[jira] [Commented] (SPARK-33452) Create a V2 SHOW PARTITIONS execution node

[ https://issues.apache.org/jira/browse/SPARK-33452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240859#comment-17240859 ] Apache Spark commented on SPARK-33452: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33452) Create a V2 SHOW PARTITIONS execution node

[ https://issues.apache.org/jira/browse/SPARK-33452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240858#comment-17240858 ] Apache Spark commented on SPARK-33452: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33569) Remove getting partitions by only ident

[ https://issues.apache.org/jira/browse/SPARK-33569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240857#comment-17240857 ] Apache Spark commented on SPARK-33569: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32763) DiskStore can remove block from blockSizes even if block is not removed from disk

[ https://issues.apache.org/jira/browse/SPARK-32763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32763. -- Resolution: Not A Problem > DiskStore can remove block from blockSizes even if block is not

[jira] [Resolved] (SPARK-32534) Cannot load a Pipeline Model on a stopped Spark Context

[ https://issues.apache.org/jira/browse/SPARK-32534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32534. -- Resolution: Not A Problem > Cannot load a Pipeline Model on a stopped Spark Context >

[jira] [Resolved] (SPARK-32569) Gaussian can not handle data close to MaxDouble

[ https://issues.apache.org/jira/browse/SPARK-32569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32569. -- Resolution: Won't Fix > Gaussian can not handle data close to MaxDouble >

[jira] [Commented] (SPARK-33611) Decode Query parameters of the redirect URL for reverse proxy

[ https://issues.apache.org/jira/browse/SPARK-33611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240816#comment-17240816 ] Apache Spark commented on SPARK-33611: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-33611) Decode Query parameters of the redirect URL for reverse proxy

[ https://issues.apache.org/jira/browse/SPARK-33611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33611: Assignee: Gengliang Wang (was: Apache Spark) > Decode Query parameters of the redirect

[jira] [Commented] (SPARK-33611) Decode Query parameters of the redirect URL for reverse proxy

[ https://issues.apache.org/jira/browse/SPARK-33611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240815#comment-17240815 ] Apache Spark commented on SPARK-33611: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-33611) Decode Query parameters of the redirect URL for reverse proxy

[ https://issues.apache.org/jira/browse/SPARK-33611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33611: Assignee: Apache Spark (was: Gengliang Wang) > Decode Query parameters of the redirect

[jira] [Created] (SPARK-33611) Decode Query parameters of the redirect URL for reverse proxy

Gengliang Wang created SPARK-33611: -- Summary: Decode Query parameters of the redirect URL for reverse proxy Key: SPARK-33611 URL: https://issues.apache.org/jira/browse/SPARK-33611 Project: Spark

[jira] [Commented] (SPARK-19256) Hive bucketing write support

[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240797#comment-17240797 ] Pankaj Sharma commented on SPARK-19256: --- Thanks [~tejasp] [~chengsu]. - Thanks for all your work

  1   2   >