[jira] [Resolved] (SPARK-29622) do not allow leading 'interval' in the interval string format

[ https://issues.apache.org/jira/browse/SPARK-29622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29622. - Resolution: Won't Fix > do not allow leading 'interval' in the interval string format >

[jira] [Created] (SPARK-29752) make AdaptiveQueryExecSuite more robust

Wenchen Fan created SPARK-29752: --- Summary: make AdaptiveQueryExecSuite more robust Key: SPARK-29752 URL: https://issues.apache.org/jira/browse/SPARK-29752 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-29714) Add insert.sql

[ https://issues.apache.org/jira/browse/SPARK-29714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967300#comment-16967300 ] Dongjoon Hyun commented on SPARK-29714: --- :) > Add insert.sql > -- > >

[jira] [Commented] (SPARK-27986) Support Aggregate Expressions with filter

[ https://issues.apache.org/jira/browse/SPARK-27986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967282#comment-16967282 ] jiaan.geng commented on SPARK-27986: I'm working. > Support Aggregate Expressions with filter >

[jira] [Commented] (SPARK-29616) Bankers' rounding for double types

[ https://issues.apache.org/jira/browse/SPARK-29616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967273#comment-16967273 ] Aman Omer commented on SPARK-29616: --- cc [~yumwang] > Bankers' rounding for double types >

[jira] [Created] (SPARK-29751) Scalers use Summarizer instead of MultivariateOnlineSummarizer

zhengruifeng created SPARK-29751: Summary: Scalers use Summarizer instead of MultivariateOnlineSummarizer Key: SPARK-29751 URL: https://issues.apache.org/jira/browse/SPARK-29751 Project: Spark

[jira] [Comment Edited] (SPARK-29650) Discard a NULL constant in LIMIT

[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967254#comment-16967254 ] Aman Omer edited comment on SPARK-29650 at 11/5/19 6:21 AM: cc [~maropu]

[jira] [Commented] (SPARK-29616) Bankers' rounding for double types

[ https://issues.apache.org/jira/browse/SPARK-29616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967272#comment-16967272 ] Aman Omer commented on SPARK-29616: --- Gentle ping [~maropu] > Bankers' rounding for double types >

[jira] [Commented] (SPARK-29636) Can't parse '11:00 BST' or '2000-10-19 10:23:54+01' signatures to timestamp

[ https://issues.apache.org/jira/browse/SPARK-29636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967271#comment-16967271 ] Aman Omer commented on SPARK-29636: --- cc [~yumwang] > Can't parse '11:00 BST' or '2000-10-19

[jira] [Assigned] (SPARK-29648) Add limit.sql

[ https://issues.apache.org/jira/browse/SPARK-29648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29648: - Assignee: Takeshi Yamamuro > Add limit.sql > - > > Key:

[jira] [Resolved] (SPARK-29648) Add limit.sql

[ https://issues.apache.org/jira/browse/SPARK-29648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29648. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26311

[jira] [Created] (SPARK-29750) Avoid dependency from joda-time

Maxim Gekk created SPARK-29750: -- Summary: Avoid dependency from joda-time Key: SPARK-29750 URL: https://issues.apache.org/jira/browse/SPARK-29750 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-23798) The CreateArray and ConcatArray should return the default array type when no children provided

[ https://issues.apache.org/jira/browse/SPARK-23798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23798. -- Resolution: Invalid This is obsolete after it was merged with regular {{concat}}. Now it

[jira] [Resolved] (SPARK-24148) Adding Ability to Specify SQL Type of Empty Arrays

[ https://issues.apache.org/jira/browse/SPARK-24148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24148. -- Resolution: Won't Fix > Adding Ability to Specify SQL Type of Empty Arrays >

[jira] [Resolved] (SPARK-29695) ALTER TABLE (SerDe properties) should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29695. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26374

[jira] [Commented] (SPARK-29650) Discard a NULL constant in LIMIT

[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967254#comment-16967254 ] Aman Omer commented on SPARK-29650: --- cc [~maropu]  > Discard a NULL constant in LIMIT >

[jira] [Assigned] (SPARK-29695) ALTER TABLE (SerDe properties) should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29695: - Assignee: Huaxin Gao > ALTER TABLE (SerDe properties) should look up catalog/table

[jira] [Resolved] (SPARK-29630) Not allowed to create a permanent view by referencing a temporary view in EXISTS

[ https://issues.apache.org/jira/browse/SPARK-29630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29630. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26361

[jira] [Assigned] (SPARK-29630) Not allowed to create a permanent view by referencing a temporary view in EXISTS

[ https://issues.apache.org/jira/browse/SPARK-29630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29630: --- Assignee: Terry Kim > Not allowed to create a permanent view by referencing a temporary

[jira] [Commented] (SPARK-29714) Add insert.sql

[ https://issues.apache.org/jira/browse/SPARK-29714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967218#comment-16967218 ] Takeshi Yamamuro commented on SPARK-29714: -- Ah, I see. I forgot to add Tests in component.

[jira] [Commented] (SPARK-27652) Caught Hive MetaException when query by partition (partition col start with underscore)

[ https://issues.apache.org/jira/browse/SPARK-27652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967213#comment-16967213 ] Yu-Jhe Li commented on SPARK-27652: --- Hi [~tongqqiu], I have issued this problem too. How did you solve

[jira] [Updated] (SPARK-23160) Port window.sql

[ https://issues.apache.org/jira/browse/SPARK-23160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23160: -- Parent: (was: SPARK-27763) Issue Type: Improvement (was: Sub-task) > Port

[jira] [Closed] (SPARK-23160) Port window.sql

[ https://issues.apache.org/jira/browse/SPARK-23160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-23160. - > Port window.sql > --- > > Key: SPARK-23160 > URL:

[jira] [Updated] (SPARK-28343) PostgreSQL test should change some default config

[ https://issues.apache.org/jira/browse/SPARK-28343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28343: -- Component/s: SQL > PostgreSQL test should change some default config >

[jira] [Updated] (SPARK-28660) Add aggregates.sql - Part4

[ https://issues.apache.org/jira/browse/SPARK-28660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28660: -- Component/s: Tests > Add aggregates.sql - Part4 > -- > >

[jira] [Updated] (SPARK-28388) Port select_implicit.sql

[ https://issues.apache.org/jira/browse/SPARK-28388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28388: -- Component/s: Tests > Port select_implicit.sql > > >

[jira] [Updated] (SPARK-29696) Add groupingsets.sql

[ https://issues.apache.org/jira/browse/SPARK-29696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29696: -- Component/s: Tests > Add groupingsets.sql > > > Key:

[jira] [Updated] (SPARK-29714) Add insert.sql

[ https://issues.apache.org/jira/browse/SPARK-29714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29714: -- Component/s: Tests > Add insert.sql > -- > > Key: SPARK-29714 >

[jira] [Updated] (SPARK-29648) Add limit.sql

[ https://issues.apache.org/jira/browse/SPARK-29648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29648: -- Component/s: Tests > Add limit.sql > - > > Key: SPARK-29648 >

[jira] [Commented] (SPARK-29683) Job failed due to executor failures all available nodes are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-29683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967188#comment-16967188 ] Steven Rand commented on SPARK-29683: - We're experiencing this as well during HA YARN failover. >

[jira] [Assigned] (SPARK-29696) Add groupingsets.sql

[ https://issues.apache.org/jira/browse/SPARK-29696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29696: - Assignee: Takeshi Yamamuro > Add groupingsets.sql > > >

[jira] [Resolved] (SPARK-29696) Add groupingsets.sql

[ https://issues.apache.org/jira/browse/SPARK-29696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29696. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26352

[jira] [Comment Edited] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967174#comment-16967174 ] Terry Kim edited comment on SPARK-29682 at 11/5/19 2:58 AM:

[jira] [Commented] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967174#comment-16967174 ] Terry Kim commented on SPARK-29682: --- [~sandeshyapuram] Glad that you found the workaround. I am still

[jira] [Resolved] (SPARK-29734) DataSourceV2: Support SHOW CURRENT NAMESPACE

[ https://issues.apache.org/jira/browse/SPARK-29734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29734. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26379

[jira] [Assigned] (SPARK-29734) DataSourceV2: Support SHOW CURRENT NAMESPACE

[ https://issues.apache.org/jira/browse/SPARK-29734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29734: - Assignee: Terry Kim > DataSourceV2: Support SHOW CURRENT NAMESPACE >

[jira] [Created] (SPARK-29749) Add parquet scan Statistics

ulysses you created SPARK-29749: --- Summary: Add parquet scan Statistics Key: SPARK-29749 URL: https://issues.apache.org/jira/browse/SPARK-29749 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-29747) Upgrade Joda-Time library from 2.9.3 to 2.10.5

[ https://issues.apache.org/jira/browse/SPARK-29747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29747. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26389

[jira] [Commented] (SPARK-21548) Support insert into serial columns of table

[ https://issues.apache.org/jira/browse/SPARK-21548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967098#comment-16967098 ] Takeshi Yamamuro commented on SPARK-21548: -- I'll close this as duplicate, then we'll move

[jira] [Resolved] (SPARK-21548) Support insert into serial columns of table

[ https://issues.apache.org/jira/browse/SPARK-21548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-21548. -- Resolution: Duplicate > Support insert into serial columns of table >

[jira] [Resolved] (SPARK-28552) The URL prefix lowercase of MySQL is not necessary, but it is necessary in spark

[ https://issues.apache.org/jira/browse/SPARK-28552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-28552. -- Fix Version/s: 3.0.0 Assignee: teeyog Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-20568) Delete files after processing in structured streaming

[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-20568. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-20568) Delete files after processing in structured streaming

[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-20568: -- Assignee: Jungtaek Lim > Delete files after processing in structured

[jira] [Resolved] (SPARK-29397) Create new plugin interface for driver and executor plugins

[ https://issues.apache.org/jira/browse/SPARK-29397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29397. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-29397) Create new plugin interface for driver and executor plugins

[ https://issues.apache.org/jira/browse/SPARK-29397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-29397: -- Assignee: Marcelo Masiero Vanzin > Create new plugin interface for

[jira] [Updated] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-29748: - Description: Currently, when a PySpark Row is created with keyword arguments, the fields are

[jira] [Created] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

Bryan Cutler created SPARK-29748: Summary: Remove sorting of fields in PySpark SQL Row creation Key: SPARK-29748 URL: https://issues.apache.org/jira/browse/SPARK-29748 Project: Spark Issue

[jira] [Created] (SPARK-29747) Upgrade Joda-Time library from 2.9.3 to 2.10.5

L. C. Hsieh created SPARK-29747: --- Summary: Upgrade Joda-Time library from 2.9.3 to 2.10.5 Key: SPARK-29747 URL: https://issues.apache.org/jira/browse/SPARK-29747 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966941#comment-16966941 ] John Bauer commented on SPARK-29691: OK that works. I worked with fit doing a grid search some time

[jira] [Commented] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966929#comment-16966929 ] Huaxin Gao commented on SPARK-29691: Could you please change this line  {code:java} lrModel1 =

[jira] [Resolved] (SPARK-29723) Get date and time parts of an interval as java classes

[ https://issues.apache.org/jira/browse/SPARK-29723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29723. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26368

[jira] [Assigned] (SPARK-29723) Get date and time parts of an interval as java classes

[ https://issues.apache.org/jira/browse/SPARK-29723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29723: - Assignee: Maxim Gekk > Get date and time parts of an interval as java classes >

[jira] [Resolved] (SPARK-29743) sample should set needCopyResult to true if its child is

[ https://issues.apache.org/jira/browse/SPARK-29743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29743. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-28809) Document SHOW TABLE in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-28809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28809: - Priority: Minor (was: Major) > Document SHOW TABLE in SQL Reference >

[jira] [Resolved] (SPARK-28809) Document SHOW TABLE in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-28809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28809. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25632

[jira] [Assigned] (SPARK-28809) Document SHOW TABLE in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-28809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28809: Assignee: Shivu Sondur > Document SHOW TABLE in SQL Reference >

[jira] [Created] (SPARK-29746) implement validateInputType in Normalizer

Huaxin Gao created SPARK-29746: -- Summary: implement validateInputType in Normalizer Key: SPARK-29746 URL: https://issues.apache.org/jira/browse/SPARK-29746 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28798) Document DROP TABLE/VIEW statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28798: - Priority: Minor (was: Major) > Document DROP TABLE/VIEW statement in SQL Reference. >

[jira] [Resolved] (SPARK-28798) Document DROP TABLE/VIEW statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28798. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25533

[jira] [Assigned] (SPARK-28798) Document DROP TABLE/VIEW statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28798: Assignee: Shivu Sondur > Document DROP TABLE/VIEW statement in SQL Reference. >

[jira] [Updated] (SPARK-29743) sample should set needCopyResult to true if its child is

[ https://issues.apache.org/jira/browse/SPARK-29743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29743: -- Affects Version/s: 3.0.0 > sample should set needCopyResult to true if its child is >

[jira] [Commented] (SPARK-29744) Add graph coloring algorithm

[ https://issues.apache.org/jira/browse/SPARK-29744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966859#comment-16966859 ] Michał Podstawski commented on SPARK-29744: --- I'm starting work on it (please assign me to this

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966856#comment-16966856 ] Dongjoon Hyun commented on SPARK-28921: --- Thank you for sharing, [~jrg]. > Spark jobs failing on

[jira] [Created] (SPARK-29745) Couldn't submit Spark application to Kubenetes in versions 1.15.3/1.15.4/1.15.5

nouha bergaoui created SPARK-29745: -- Summary: Couldn't submit Spark application to Kubenetes in versions 1.15.3/1.15.4/1.15.5 Key: SPARK-29745 URL: https://issues.apache.org/jira/browse/SPARK-29745

[jira] [Created] (SPARK-29744) Add graph coloring algorithm

Michał Podstawski created SPARK-29744: - Summary: Add graph coloring algorithm Key: SPARK-29744 URL: https://issues.apache.org/jira/browse/SPARK-29744 Project: Spark Issue Type: Task

[jira] [Comment Edited] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966768#comment-16966768 ] John Bauer edited comment on SPARK-29691 at 11/4/19 5:20 PM: - I was using

[jira] [Assigned] (SPARK-29663) Support sum with interval type values

[ https://issues.apache.org/jira/browse/SPARK-29663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29663: --- Assignee: Kent Yao > Support sum with interval type values >

[jira] [Resolved] (SPARK-29663) Support sum with interval type values

[ https://issues.apache.org/jira/browse/SPARK-29663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29663. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26325

[jira] [Resolved] (SPARK-29742) dev/lint-java cann't check all code we will use

[ https://issues.apache.org/jira/browse/SPARK-29742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29742. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26385

[jira] [Assigned] (SPARK-29742) dev/lint-java cann't check all code we will use

[ https://issues.apache.org/jira/browse/SPARK-29742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29742: - Assignee: angerszhu > dev/lint-java cann't check all code we will use >

[jira] [Comment Edited] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966768#comment-16966768 ] John Bauer edited comment on SPARK-29691 at 11/4/19 4:59 PM: - I was using

[jira] [Comment Edited] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966768#comment-16966768 ] John Bauer edited comment on SPARK-29691 at 11/4/19 4:57 PM: - I was using

[jira] [Updated] (SPARK-29743) sample should set needCopyResult to true if its child is

[ https://issues.apache.org/jira/browse/SPARK-29743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29743: Priority: Blocker (was: Major) > sample should set needCopyResult to true if its child is >

[jira] [Comment Edited] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966768#comment-16966768 ] John Bauer edited comment on SPARK-29691 at 11/4/19 4:57 PM: - I was using

[jira] [Updated] (SPARK-29743) sample should set needCopyResult to true if its child is

[ https://issues.apache.org/jira/browse/SPARK-29743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29743: Affects Version/s: (was: 2.4.0) 2.3.4 2.4.4 > sample

[jira] [Comment Edited] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966768#comment-16966768 ] John Bauer edited comment on SPARK-29691 at 11/4/19 4:56 PM: - I was using

[jira] [Comment Edited] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966768#comment-16966768 ] John Bauer edited comment on SPARK-29691 at 11/4/19 4:55 PM: - I was using

[jira] [Resolved] (SPARK-29678) ALTER TABLE (add table partition) should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29678. - Fix Version/s: 3.0.0 Assignee: Terry Kim Resolution: Fixed > ALTER TABLE (add

[jira] [Updated] (SPARK-29734) DataSourceV2: Support SHOW CURRENT NAMESPACE

[ https://issues.apache.org/jira/browse/SPARK-29734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-29734: -- Summary: DataSourceV2: Support SHOW CURRENT NAMESPACE (was: DataSourceV2: Support SHOW CURRENT

[jira] [Updated] (SPARK-29734) DataSourceV2: Support SHOW CURRENT NAMESPACE

[ https://issues.apache.org/jira/browse/SPARK-29734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-29734: -- Description: Datasource V2 can support multiple catalogs/namespaces. Having "SHOW CURRENT NAMESPACE"

[jira] [Commented] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966768#comment-16966768 ] John Bauer commented on SPARK-29691: I will update the example shortly - I was using this in the

[jira] [Resolved] (SPARK-29590) Support hiding table in JDBC/ODBC server page in WebUI

[ https://issues.apache.org/jira/browse/SPARK-29590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29590. -- Fix Version/s: 3.0.0 Assignee: shahid Resolution: Fixed Resolved by

[jira] [Created] (SPARK-29743) sample should set needCopyResult to true if its child is

Wenchen Fan created SPARK-29743: --- Summary: sample should set needCopyResult to true if its child is Key: SPARK-29743 URL: https://issues.apache.org/jira/browse/SPARK-29743 Project: Spark Issue

[jira] [Resolved] (SPARK-21074) Parquet files are read fully even though only count() is requested

[ https://issues.apache.org/jira/browse/SPARK-21074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-21074. Resolution: Cannot Reproduce this goes away on Hadoop 2.8+, and for EMR FS, amazon's

[jira] [Commented] (SPARK-29710) Seeing offsets not resetting even when reset policy is configured explicitly

[ https://issues.apache.org/jira/browse/SPARK-29710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966659#comment-16966659 ] Gabor Somogyi commented on SPARK-29710: --- Just to double check the most obvious thing. Have you

[jira] [Commented] (SPARK-29710) Seeing offsets not resetting even when reset policy is configured explicitly

[ https://issues.apache.org/jira/browse/SPARK-29710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966655#comment-16966655 ] Gabor Somogyi commented on SPARK-29710: --- Just seen this issue by luck because the personal tag

[jira] [Comment Edited] (SPARK-29710) Seeing offsets not resetting even when reset policy is configured explicitly

[ https://issues.apache.org/jira/browse/SPARK-29710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966655#comment-16966655 ] Gabor Somogyi edited comment on SPARK-29710 at 11/4/19 1:28 PM: Just

[jira] [Created] (SPARK-29742) dev/lint-java cann't check all code we will use

angerszhu created SPARK-29742: - Summary: dev/lint-java cann't check all code we will use Key: SPARK-29742 URL: https://issues.apache.org/jira/browse/SPARK-29742 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-29709) structured streaming The offset in the checkpoint is suddenly reset to the earliest

[ https://issues.apache.org/jira/browse/SPARK-29709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966645#comment-16966645 ] Gabor Somogyi commented on SPARK-29709: --- Not much shared about the exact problem so all I can do

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966571#comment-16966571 ] James Grinter commented on SPARK-28921: --- For anyone who lands here today, note that Google GKE

[jira] [Resolved] (SPARK-29285) Temporary shuffle and local block should be able to handle disk failures

[ https://issues.apache.org/jira/browse/SPARK-29285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29285. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25962

[jira] [Assigned] (SPARK-29285) Temporary shuffle and local block should be able to handle disk failures

[ https://issues.apache.org/jira/browse/SPARK-29285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29285: --- Assignee: Kent Yao > Temporary shuffle and local block should be able to handle disk

[jira] [Commented] (SPARK-29741) Spark Application UI- In Environment tab add "Search" option

[ https://issues.apache.org/jira/browse/SPARK-29741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966535#comment-16966535 ] Rakesh Raushan commented on SPARK-29741: working on this. > Spark Application UI- In

[jira] [Created] (SPARK-29741) Spark Application UI- In Environment tab add "Search" option

jobit mathew created SPARK-29741: Summary: Spark Application UI- In Environment tab add "Search" option Key: SPARK-29741 URL: https://issues.apache.org/jira/browse/SPARK-29741 Project: Spark

[jira] [Resolved] (SPARK-29736) Improve stability of tests for special datetime values

[ https://issues.apache.org/jira/browse/SPARK-29736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29736. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26380

[jira] [Assigned] (SPARK-29736) Improve stability of tests for special datetime values

[ https://issues.apache.org/jira/browse/SPARK-29736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29736: --- Assignee: Maxim Gekk > Improve stability of tests for special datetime values >

[jira] [Commented] (SPARK-29740) Filter On DataFrame Will return Tuple of 2 dataframes

[ https://issues.apache.org/jira/browse/SPARK-29740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966461#comment-16966461 ] sanket sahu commented on SPARK-29740: - [~viirya] Yes, it's about a API to return 2 dataframe. But