[jira] [Commented] (SPARK-26154) Stream-stream joins - left outer join gives inconsistent output

[ https://issues.apache.org/jira/browse/SPARK-26154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816110#comment-16816110 ] Binit commented on SPARK-26154: --- Thanks [~kabhwan] for taking up this issue. I too feel it is a blocker as

[jira] [Commented] (SPARK-26218) Throw exception on overflow for integers

[ https://issues.apache.org/jira/browse/SPARK-26218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816087#comment-16816087 ] Marco Gaido commented on SPARK-26218: - [~rxin] I see that. But the reason for this are: - the

[jira] [Commented] (SPARK-27433) Spark Structured Streaming left outer joins returns outer nulls for already matched rows

[ https://issues.apache.org/jira/browse/SPARK-27433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816105#comment-16816105 ] Binit commented on SPARK-27433: --- This is a blocker for us as the basic functionality of the left_outer

[jira] [Created] (SPARK-27449) Clean-up checks in CodegenSupport.limitNotReachedCond

Herman van Hovell created SPARK-27449: - Summary: Clean-up checks in CodegenSupport.limitNotReachedCond Key: SPARK-27449 URL: https://issues.apache.org/jira/browse/SPARK-27449 Project: Spark

[jira] [Created] (SPARK-27448) File source V2 table provider should be compatible with V1 provider

Gengliang Wang created SPARK-27448: -- Summary: File source V2 table provider should be compatible with V1 provider Key: SPARK-27448 URL: https://issues.apache.org/jira/browse/SPARK-27448 Project:

[jira] [Comment Edited] (SPARK-27434) memory leak in spark driver

[ https://issues.apache.org/jira/browse/SPARK-27434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816432#comment-16816432 ] Ryne Yang edited comment on SPARK-27434 at 4/12/19 4:32 PM: [~shahid] yup:

[jira] [Updated] (SPARK-27450) Timestamp cast fails when ISO8601 string omits minutes or seconds

[ https://issues.apache.org/jira/browse/SPARK-27450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leandro Rosa updated SPARK-27450: - Description: ISO8601 allows to omit minutes, seconds and milliseconds. {quote}

[jira] [Updated] (SPARK-27450) Timestamp cast fails when ISO8601 string omits minutes, seconds or milliseconds

[ https://issues.apache.org/jira/browse/SPARK-27450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leandro Rosa updated SPARK-27450: - Summary: Timestamp cast fails when ISO8601 string omits minutes, seconds or milliseconds (was:

[jira] [Commented] (SPARK-23801) Consistent SIGSEGV after upgrading to Spark v2.3.0

[ https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816384#comment-16816384 ] Waleed Fateem commented on SPARK-23801: --- I just wanted to add a comment here in case it's useful. 

[jira] [Commented] (SPARK-27434) memory leak in spark driver

[ https://issues.apache.org/jira/browse/SPARK-27434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816432#comment-16816432 ] Ryne Yang commented on SPARK-27434: --- [~shahid] yup: # start spark context with

[jira] [Resolved] (SPARK-27444) multi-select can be used in subquery

[ https://issues.apache.org/jira/browse/SPARK-27444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27444. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24348

[jira] [Created] (SPARK-27450) Timestamp cast fails when ISO8601 string omits zero minutes or seconds

Leandro Rosa created SPARK-27450: Summary: Timestamp cast fails when ISO8601 string omits zero minutes or seconds Key: SPARK-27450 URL: https://issues.apache.org/jira/browse/SPARK-27450 Project:

[jira] [Updated] (SPARK-27450) Timestamp cast fails when ISO8601 string omits zero minutes or seconds

[ https://issues.apache.org/jira/browse/SPARK-27450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leandro Rosa updated SPARK-27450: - Description: ISO8601 allows to omit zero minutes, seconds and milliseconds. {quote}

[jira] [Updated] (SPARK-27450) Timestamp cast fails when the ISO8601 string omits minutes, seconds or milliseconds

[ https://issues.apache.org/jira/browse/SPARK-27450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leandro Rosa updated SPARK-27450: - Summary: Timestamp cast fails when the ISO8601 string omits minutes, seconds or milliseconds

[jira] [Assigned] (SPARK-27443) Support UDF input_file_name in file source V2

[ https://issues.apache.org/jira/browse/SPARK-27443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27443: --- Assignee: Gengliang Wang > Support UDF input_file_name in file source V2 >

[jira] [Resolved] (SPARK-27443) Support UDF input_file_name in file source V2

[ https://issues.apache.org/jira/browse/SPARK-27443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27443. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24347

[jira] [Assigned] (SPARK-27455) spark-submit and friends should allow main artifact to be specified as a package

[ https://issues.apache.org/jira/browse/SPARK-27455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-27455: --- Assignee: Brian Lindblom > spark-submit and friends should allow main artifact to be specified as

[jira] [Created] (SPARK-27456) Support commitSync for offsets in DirectKafkaInputDStream

Jackson Westeen created SPARK-27456: --- Summary: Support commitSync for offsets in DirectKafkaInputDStream Key: SPARK-27456 URL: https://issues.apache.org/jira/browse/SPARK-27456 Project: Spark

[jira] [Resolved] (SPARK-27451) Upgrade lz4-java to 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-27451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27451. --- Resolution: Fixed Fix Version/s: 3.0.0 This is resolved via

[jira] [Commented] (SPARK-10388) Public dataset loader interface

[ https://issues.apache.org/jira/browse/SPARK-10388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816789#comment-16816789 ] Konrad Tendera commented on SPARK-10388: [~mengxr] is anyone currently working on this feature?

[jira] [Created] (SPARK-27452) Update zstd-jni to 1.3.8-7

Dongjoon Hyun created SPARK-27452: - Summary: Update zstd-jni to 1.3.8-7 Key: SPARK-27452 URL: https://issues.apache.org/jira/browse/SPARK-27452 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-22486) Support synchronous offset commits for Kafka

[ https://issues.apache.org/jira/browse/SPARK-22486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816771#comment-16816771 ] Jackson Westeen commented on SPARK-22486: - I have a use case for this, [~c...@koeninger.org] if

[jira] [Created] (SPARK-27451) Upgrade lz4-java to 1.5.1

Dongjoon Hyun created SPARK-27451: - Summary: Upgrade lz4-java to 1.5.1 Key: SPARK-27451 URL: https://issues.apache.org/jira/browse/SPARK-27451 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-27453) DataFrameWriter.partitionBy is Silently Dropped by DSV1

Michael Armbrust created SPARK-27453: Summary: DataFrameWriter.partitionBy is Silently Dropped by DSV1 Key: SPARK-27453 URL: https://issues.apache.org/jira/browse/SPARK-27453 Project: Spark

[jira] [Created] (SPARK-27455) spark-submit and friends should allow main artifact to be specified as a package

Brian Lindblom created SPARK-27455: -- Summary: spark-submit and friends should allow main artifact to be specified as a package Key: SPARK-27455 URL: https://issues.apache.org/jira/browse/SPARK-27455

[jira] [Assigned] (SPARK-27451) Upgrade lz4-java to 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-27451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27451: - Assignee: Dongjoon Hyun > Upgrade lz4-java to 1.5.1 > - > >

[jira] [Created] (SPARK-27454) Spark image datasource fail when encounter some illegal images

Weichen Xu created SPARK-27454: -- Summary: Spark image datasource fail when encounter some illegal images Key: SPARK-27454 URL: https://issues.apache.org/jira/browse/SPARK-27454 Project: Spark

[jira] [Updated] (SPARK-27453) DataFrameWriter.partitionBy is Silently Dropped by DSV1

[ https://issues.apache.org/jira/browse/SPARK-27453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27453: Target Version/s: 2.4.2, 3.0.0 (was: 2.4.2, 2.5.0) > DataFrameWriter.partitionBy is Silently Dropped by

[jira] [Assigned] (SPARK-27453) DataFrameWriter.partitionBy is Silently Dropped by DSV1

[ https://issues.apache.org/jira/browse/SPARK-27453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-27453: Assignee: Liwen Sun > DataFrameWriter.partitionBy is Silently Dropped by DSV1 >

[jira] [Updated] (SPARK-27454) Spark image datasource fail when encounter some illegal images

[ https://issues.apache.org/jira/browse/SPARK-27454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-27454: --- Description: Spark image datasource fail when encounter some illegal images. Such as exception