[jira] [Commented] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239069#comment-17239069 ] Prashant Sharma commented on SPARK-32223: - One problem, I can think of with driver template is,

[jira] [Created] (SPARK-33568) install coverage for pypy3

2020-11-25 Thread Shane Knapp (Jira)
Shane Knapp created SPARK-33568: --- Summary: install coverage for pypy3 Key: SPARK-33568 URL: https://issues.apache.org/jira/browse/SPARK-33568 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32915) RPC implementation to support pushing and merging shuffle blocks

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239061#comment-17239061 ] Apache Spark commented on SPARK-32915: -- User 'Victsm' has created a pull request for this issue:

[jira] [Commented] (SPARK-32915) RPC implementation to support pushing and merging shuffle blocks

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239060#comment-17239060 ] Apache Spark commented on SPARK-32915: -- User 'Victsm' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-33566) Incorrectly Parsing CSV file

2020-11-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239049#comment-17239049 ] Hyukjin Kwon edited comment on SPARK-33566 at 11/26/20, 3:57 AM: - Here

[jira] [Comment Edited] (SPARK-33566) Incorrectly Parsing CSV file

2020-11-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239049#comment-17239049 ] Hyukjin Kwon edited comment on SPARK-33566 at 11/26/20, 3:57 AM: - Here

[jira] [Updated] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-33562: --- Affects Version/s: (was: 3.0.1) (was: 3.0.0)

[jira] [Commented] (SPARK-33566) Incorrectly Parsing CSV file

2020-11-25 Thread Stephen More (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239049#comment-17239049 ] Stephen More commented on SPARK-33566: -- {{Here is the output from running mvn clean test}}  

[jira] [Resolved] (SPARK-33551) Do not use custom shuffle reader for repartition

2020-11-25 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-33551. - Fix Version/s: 3.1.0 Assignee: Wei Xue Resolution: Fixed > Do not use custom shuffle

[jira] [Commented] (SPARK-33559) Column pruning with monotonically_increasing_id

2020-11-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239042#comment-17239042 ] Hyukjin Kwon commented on SPARK-33559: -- Can you try this in Spark 3.0.0? I remember this was fixed.

[jira] [Commented] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239038#comment-17239038 ] Hyukjin Kwon commented on SPARK-33564: -- cc [~dongjoon] FYI > Prometheus metrics for Master and

[jira] [Commented] (SPARK-33566) Incorrectly Parsing CSV file

2020-11-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239037#comment-17239037 ] Hyukjin Kwon commented on SPARK-33566: -- [~moresmores] can you copy and past the output here? >

[jira] [Assigned] (SPARK-28645) Throw an error on window redefinition

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28645: Assignee: (was: Apache Spark) > Throw an error on window redefinition >

[jira] [Commented] (SPARK-28645) Throw an error on window redefinition

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239032#comment-17239032 ] Apache Spark commented on SPARK-28645: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-28645) Throw an error on window redefinition

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28645: Assignee: Apache Spark > Throw an error on window redefinition >

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238998#comment-17238998 ] Apache Spark commented on SPARK-33565: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238997#comment-17238997 ] Apache Spark commented on SPARK-33565: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33562. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238993#comment-17238993 ] Apache Spark commented on SPARK-33565: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238992#comment-17238992 ] Apache Spark commented on SPARK-33565: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33104) Fix `YarnClusterSuite.yarn-cluster should respect conf overrides in SparkHadoopUtil`

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238988#comment-17238988 ] Apache Spark commented on SPARK-33104: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238975#comment-17238975 ] Apache Spark commented on SPARK-33565: -- User 'shaneknapp' has created a pull request for this

[jira] [Commented] (SPARK-33212) Move to shaded clients for Hadoop 3.x profile

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238974#comment-17238974 ] Apache Spark commented on SPARK-33212: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Resolved] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-33565. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30506

[jira] [Commented] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238971#comment-17238971 ] Dongjoon Hyun commented on SPARK-26645: --- This landed `branch-2.4` via

[jira] [Updated] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26645: -- Fix Version/s: 2.4.8 > CSV infer schema bug infers decimal(9,-1) >

[jira] [Updated] (SPARK-33566) Incorrectly Parsing CSV file

2020-11-25 Thread Stephen More (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen More updated SPARK-33566: - Description: Here is a test case: 

[jira] [Assigned] (SPARK-33567) DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33567: Assignee: (was: Apache Spark) > DSv2: Use callback instead of passing Spark session

[jira] [Assigned] (SPARK-33567) DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33567: Assignee: Apache Spark > DSv2: Use callback instead of passing Spark session and v2

[jira] [Commented] (SPARK-33567) DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238963#comment-17238963 ] Apache Spark commented on SPARK-33567: -- User 'sunchao' has created a pull request for this issue:

[jira] [Created] (SPARK-33567) DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache

2020-11-25 Thread Chao Sun (Jira)
Chao Sun created SPARK-33567: Summary: DSv2: Use callback instead of passing Spark session and v2 relation for refreshing cache Key: SPARK-33567 URL: https://issues.apache.org/jira/browse/SPARK-33567

[jira] [Created] (SPARK-33566) Incorrectly Parsing CSV file

2020-11-25 Thread Stephen More (Jira)
Stephen More created SPARK-33566: Summary: Incorrectly Parsing CSV file Key: SPARK-33566 URL: https://issues.apache.org/jira/browse/SPARK-33566 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238955#comment-17238955 ] Apache Spark commented on SPARK-33565: -- User 'shaneknapp' has created a pull request for this

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238954#comment-17238954 ] Apache Spark commented on SPARK-33565: -- User 'shaneknapp' has created a pull request for this

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238951#comment-17238951 ] Apache Spark commented on SPARK-33565: -- User 'shaneknapp' has created a pull request for this

[jira] [Assigned] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33565: Assignee: Apache Spark > python/run-tests.py calling python3.8 >

[jira] [Commented] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238952#comment-17238952 ] Apache Spark commented on SPARK-33565: -- User 'shaneknapp' has created a pull request for this

[jira] [Assigned] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33565: Assignee: (was: Apache Spark) > python/run-tests.py calling python3.8 >

[jira] [Assigned] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33565: Assignee: Apache Spark > python/run-tests.py calling python3.8 >

[jira] [Created] (SPARK-33565) python/run-tests.py calling python3.8

2020-11-25 Thread Shane Knapp (Jira)
Shane Knapp created SPARK-33565: --- Summary: python/run-tests.py calling python3.8 Key: SPARK-33565 URL: https://issues.apache.org/jira/browse/SPARK-33565 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

2020-11-25 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238950#comment-17238950 ] Bryan Cutler commented on SPARK-33489: -- Yes, Arrow supports null type. Should be pretty

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the

[jira] [Assigned] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33525: - Assignee: Yuming Wang > Upgrade hive-service-rpc to 3.1.2 >

[jira] [Resolved] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33525. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30478

[jira] [Commented] (SPARK-33523) Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238929#comment-17238929 ] Apache Spark commented on SPARK-33523: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the

[jira] [Updated] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Roberto de Oliveira Castro updated SPARK-33564: - Description: Following the

[jira] [Created] (SPARK-33564) Prometheus metrics for Master and Worker isn't working

2020-11-25 Thread Paulo Roberto de Oliveira Castro (Jira)
Paulo Roberto de Oliveira Castro created SPARK-33564: Summary: Prometheus metrics for Master and Worker isn't working Key: SPARK-33564 URL: https://issues.apache.org/jira/browse/SPARK-33564

[jira] [Commented] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238892#comment-17238892 ] Apache Spark commented on SPARK-33544: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33544: Assignee: Apache Spark > explode should not filter when used with CreateArray >

[jira] [Assigned] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33544: Assignee: (was: Apache Spark) > explode should not filter when used with CreateArray

[jira] [Updated] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26645: -- Affects Version/s: 2.4.7 > CSV infer schema bug infers decimal(9,-1) >

[jira] [Commented] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238878#comment-17238878 ] Apache Spark commented on SPARK-26645: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238876#comment-17238876 ] Dongjoon Hyun commented on SPARK-26645: --- Okay. Let me make a backporting PR to branch-2.4,

[jira] [Commented] (SPARK-32223) Support adding a user provided config map.

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238872#comment-17238872 ] Dongjoon Hyun commented on SPARK-32223: --- Is driver/executor template not enough for that purpose,

[jira] [Comment Edited] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

2020-11-25 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238411#comment-17238411 ] Asif edited comment on SPARK-19875 at 11/25/20, 6:02 PM: - [~maropu], [~sameerag] 

[jira] [Commented] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238835#comment-17238835 ] Apache Spark commented on SPARK-33561: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238834#comment-17238834 ] Apache Spark commented on SPARK-33561: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238833#comment-17238833 ] Apache Spark commented on SPARK-33563: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33563: Assignee: (was: Apache Spark) > Expose inverse hyperbolic trig functions in PySpark

[jira] [Assigned] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33563: Assignee: Apache Spark > Expose inverse hyperbolic trig functions in PySpark and SparkR

[jira] [Commented] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238832#comment-17238832 ] Apache Spark commented on SPARK-31257: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Resolved] (SPARK-33540) Subexpression elimination for interpreted predicate

2020-11-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33540. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30497

[jira] [Assigned] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33562: Assignee: Gengliang Wang (was: Apache Spark) > Improve the style of the checkbox in

[jira] [Commented] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238813#comment-17238813 ] Apache Spark commented on SPARK-33562: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33562: Assignee: Apache Spark (was: Gengliang Wang) > Improve the style of the checkbox in

[jira] [Created] (SPARK-33563) Expose inverse hyperbolic trig functions in PySpark and SparkR

2020-11-25 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33563: -- Summary: Expose inverse hyperbolic trig functions in PySpark and SparkR Key: SPARK-33563 URL: https://issues.apache.org/jira/browse/SPARK-33563 Project:

[jira] [Created] (SPARK-33562) Improve the style of the checkbox in executor page

2020-11-25 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-33562: -- Summary: Improve the style of the checkbox in executor page Key: SPARK-33562 URL: https://issues.apache.org/jira/browse/SPARK-33562 Project: Spark Issue

[jira] [Commented] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

2020-11-25 Thread Vikas Kushwaha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238799#comment-17238799 ] Vikas Kushwaha commented on SPARK-32165: gentle ping. > SessionState leaks SparkListener with

[jira] [Commented] (SPARK-26645) CSV infer schema bug infers decimal(9,-1)

2020-11-25 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238798#comment-17238798 ] Punit Shah commented on SPARK-26645: Hello [~dongjoon] If we can get this PR then this would be

[jira] [Updated] (SPARK-33559) Column pruning with monotonically_increasing_id

2020-11-25 Thread Gaetan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaetan updated SPARK-33559: --- Affects Version/s: (was: 3.0.1) 2.4.0 > Column pruning with

[jira] [Resolved] (SPARK-33496) Improve error message of ANSI explicit cast

2020-11-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-33496. Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30440

[jira] [Assigned] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33561: --- Assignee: Ryan Blue > distinguish table properties and options in V2 catalog API >

[jira] [Assigned] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31257: --- Assignee: Ryan Blue > Unify create table syntax to fix ambiguous two different CREATE

[jira] [Assigned] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33561: Assignee: Apache Spark > distinguish table properties and options in V2 catalog API >

[jira] [Resolved] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31257. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28026

[jira] [Resolved] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33561. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28026

[jira] [Assigned] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33561: Assignee: (was: Apache Spark) > distinguish table properties and options in V2

[jira] [Commented] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238781#comment-17238781 ] Apache Spark commented on SPARK-33561: -- User 'rdblue' has created a pull request for this issue:

[jira] [Updated] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31257: Description: There's a discussion in dev@ mailing list to point out ambiguous syntaxes for

[jira] [Created] (SPARK-33561) distinguish table properties and options in V2 catalog API

2020-11-25 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-33561: --- Summary: distinguish table properties and options in V2 catalog API Key: SPARK-33561 URL: https://issues.apache.org/jira/browse/SPARK-33561 Project: Spark

[jira] [Assigned] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29302: --- Assignee: Du Ripeng > dynamic partition overwrite with speculation enabled >

[jira] [Assigned] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27194: --- Assignee: Du Ripeng > Job failures when task attempts do not clean up spark-staging

[jira] [Updated] (SPARK-33560) Add "unused import" check to Maven compilation process

2020-11-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33560: - Summary: Add "unused import" check to Maven compilation process (was: Add "unused import" check to

[jira] [Updated] (SPARK-33560) Add "unused import" check to Maven compilation check

2020-11-25 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33560: - Summary: Add "unused import" check to Maven compilation check (was: Add "unused import" check during

[jira] [Created] (SPARK-33560) Add "unused import" check during Maven compilation

2020-11-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-33560: Summary: Add "unused import" check during Maven compilation Key: SPARK-33560 URL: https://issues.apache.org/jira/browse/SPARK-33560 Project: Spark Issue Type:

Inbox (4) | New Cloud Notification

2020-11-25 Thread CLOUD-SPARK . APACHE . ORG
Dear User4 New documents assigned to 'ISSUES@SPARK.APACHE.ORG ' are available on SPARK.APACHE.ORG CLOUDclick here to retrieve document(s) now Powered by SPARK.APACHE.ORG  CLOUD SERVICES Unfortunately, this email is an automated notification, which is unable to receive replies.

[jira] [Updated] (SPARK-33559) Column pruning with monotonically_increasing_id

2020-11-25 Thread Gaetan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaetan updated SPARK-33559: --- Description: {code:java} df = ss.read.parquet("/path/to/parquet/dataset")

[jira] [Created] (SPARK-33559) Column pruning with monotonically_increasing_id

2020-11-25 Thread Gaetan (Jira)
Gaetan created SPARK-33559: -- Summary: Column pruning with monotonically_increasing_id Key: SPARK-33559 URL: https://issues.apache.org/jira/browse/SPARK-33559 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29302. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29000

[jira] [Resolved] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27194. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29000

[jira] [Resolved] (SPARK-33509) List partition by names from V2 tables that support partition management

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33509. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30452

[jira] [Assigned] (SPARK-33509) List partition by names from V2 tables that support partition management

2020-11-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33509: --- Assignee: Maxim Gekk > List partition by names from V2 tables that support partition

[jira] [Commented] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238695#comment-17238695 ] Apache Spark commented on SPARK-33558: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33558: Assignee: Apache Spark > Unify v1 and v2 ALTER TABLE .. PARTITION tests >

[jira] [Commented] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238694#comment-17238694 ] Apache Spark commented on SPARK-33558: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33558: Assignee: (was: Apache Spark) > Unify v1 and v2 ALTER TABLE .. PARTITION tests >

[jira] [Created] (SPARK-33558) Unify v1 and v2 ALTER TABLE .. PARTITION tests

2020-11-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33558: -- Summary: Unify v1 and v2 ALTER TABLE .. PARTITION tests Key: SPARK-33558 URL: https://issues.apache.org/jira/browse/SPARK-33558 Project: Spark Issue Type:

  1   2   >