[jira] [Created] (SPARK-48177) Bump Parquet to 1.14.0

2024-05-07 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-48177: Summary: Bump Parquet to 1.14.0 Key: SPARK-48177 URL: https://issues.apache.org/jira/browse/SPARK-48177 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-43594) Add LocalDateTime to anyToMicros

2023-05-19 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-43594: Summary: Add LocalDateTime to anyToMicros Key: SPARK-43594 URL: https://issues.apache.org/jira/browse/SPARK-43594 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43425) Add TimestampNTZType to ColumnarBatchRow

2023-05-10 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-43425: - Issue Type: Bug (was: Improvement) > Add TimestampNTZType to ColumnarBatchRow >

[jira] [Created] (SPARK-43425) Add TimestampNTZType to ColumnarBatchRow

2023-05-09 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-43425: Summary: Add TimestampNTZType to ColumnarBatchRow Key: SPARK-43425 URL: https://issues.apache.org/jira/browse/SPARK-43425 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32797) Install mypy on the Jenkins CI workers

2020-10-18 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-32797: - Affects Version/s: (was: 3.0.0) 3.1.0 > Install mypy on the

[jira] [Updated] (SPARK-32797) Install mypy on the Jenkins CI workers

2020-09-04 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-32797: - Description: We want to check the types of the PySpark code. This requires mypy to be

[jira] [Created] (SPARK-32797) Install mypy on the Jenkins CI workers

2020-09-04 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32797: Summary: Install mypy on the Jenkins CI workers Key: SPARK-32797 URL: https://issues.apache.org/jira/browse/SPARK-32797 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-32770) Add missing imports

2020-09-02 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved SPARK-32770. -- Resolution: Won't Fix > Add missing imports > --- > >

[jira] [Created] (SPARK-32770) Add missing imports

2020-09-01 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32770: Summary: Add missing imports Key: SPARK-32770 URL: https://issues.apache.org/jira/browse/SPARK-32770 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32719) Add Flake8 check for missing imports

2020-08-27 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32719: Summary: Add Flake8 check for missing imports Key: SPARK-32719 URL: https://issues.apache.org/jira/browse/SPARK-32719 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10520) Dates cannot be summarised

2020-08-22 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182266#comment-17182266 ] Fokko Driesprong commented on SPARK-10520: -- Can this issue be assigned to my name? Normally

[jira] [Updated] (SPARK-32572) Run all the tests at once, instead of having separate entrypoints.

2020-08-08 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-32572: - Description: Started with this comment thread: 

[jira] [Created] (SPARK-32572) Run all the tests at once, instead of having separate entrypoints.

2020-08-08 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32572: Summary: Run all the tests at once, instead of having separate entrypoints. Key: SPARK-32572 URL: https://issues.apache.org/jira/browse/SPARK-32572 Project:

[jira] [Updated] (SPARK-32319) Disallow the use of unused imports

2020-08-03 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-32319: - Summary: Disallow the use of unused imports (was: Remove unused imports) > Disallow

[jira] [Resolved] (SPARK-32313) Remove Python 2 artifacts

2020-07-22 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved SPARK-32313. -- Resolution: Won't Fix > Remove Python 2 artifacts > - > >

[jira] [Created] (SPARK-32320) Remove mutable default arguments

2020-07-15 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32320: Summary: Remove mutable default arguments Key: SPARK-32320 URL: https://issues.apache.org/jira/browse/SPARK-32320 Project: Spark Issue Type:

[jira] [Created] (SPARK-32319) Remove unused imports

2020-07-15 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32319: Summary: Remove unused imports Key: SPARK-32319 URL: https://issues.apache.org/jira/browse/SPARK-32319 Project: Spark Issue Type: Improvement

[jira] [Closed] (SPARK-27757) Bump Jackson to 2.9.9

2020-07-14 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong closed SPARK-27757. Master is on Jackson 2.10 now :) > Bump Jackson to 2.9.9 > - > >

[jira] [Updated] (SPARK-17333) Make pyspark interface friendly with mypy static analysis

2020-07-14 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-17333: - Summary: Make pyspark interface friendly with mypy static analysis (was: Make pyspark

[jira] [Created] (SPARK-32313) Remove Python 2 artifacts

2020-07-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32313: Summary: Remove Python 2 artifacts Key: SPARK-32313 URL: https://issues.apache.org/jira/browse/SPARK-32313 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32311) Remove duplicate import

2020-07-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32311: Summary: Remove duplicate import Key: SPARK-32311 URL: https://issues.apache.org/jira/browse/SPARK-32311 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32309) Fix missing import

2020-07-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32309: Summary: Fix missing import Key: SPARK-32309 URL: https://issues.apache.org/jira/browse/SPARK-32309 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-31981) Keep TimestampType when taking an average of a Timestamp

2020-06-13 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-31981: Summary: Keep TimestampType when taking an average of a Timestamp Key: SPARK-31981 URL: https://issues.apache.org/jira/browse/SPARK-31981 Project: Spark

[jira] [Reopened] (SPARK-10520) Dates cannot be summarised

2020-06-07 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong reopened SPARK-10520: -- This is the underlying issue of [https://github.com/apache/spark/pull/28554] Let me

[jira] [Created] (SPARK-31735) Include all columns in the summary report

2020-05-16 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-31735: Summary: Include all columns in the summary report Key: SPARK-31735 URL: https://issues.apache.org/jira/browse/SPARK-31735 Project: Spark Issue

[jira] [Commented] (SPARK-29245) CCE during creating HiveMetaStoreClient

2020-04-10 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081174#comment-17081174 ] Fokko Driesprong commented on SPARK-29245: -- Thanks, on Iceberg we have a similar issue: 

[jira] [Resolved] (SPARK-30103) Remove duplicate schema merge logic

2020-03-17 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved SPARK-30103. -- Resolution: Won't Fix > Remove duplicate schema merge logic >

[jira] [Updated] (SPARK-27506) Function `from_avro` doesn't allow deserialization of data using other compatible schemas

2019-12-11 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-27506: - Fix Version/s: 3.0.0 > Function `from_avro` doesn't allow deserialization of data using

[jira] [Created] (SPARK-30103) Remove duplicate schema merge logic

2019-12-02 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-30103: Summary: Remove duplicate schema merge logic Key: SPARK-30103 URL: https://issues.apache.org/jira/browse/SPARK-30103 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30004) Allow UserDefinedType to be merged into a standard DateType

2019-11-23 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-30004: - Component/s: (was: Spark Core) SQL > Allow UserDefinedType to be

[jira] [Created] (SPARK-30004) Allow UserDefinedType to be merged into a standard DateType

2019-11-23 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-30004: Summary: Allow UserDefinedType to be merged into a standard DateType Key: SPARK-30004 URL: https://issues.apache.org/jira/browse/SPARK-30004 Project: Spark

[jira] [Created] (SPARK-29483) Bump Jackson to 2.10.0

2019-10-15 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-29483: Summary: Bump Jackson to 2.10.0 Key: SPARK-29483 URL: https://issues.apache.org/jira/browse/SPARK-29483 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29445) Bump netty-all from 4.1.39.Final to 4.1.42.Final

2019-10-11 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-29445: Summary: Bump netty-all from 4.1.39.Final to 4.1.42.Final Key: SPARK-29445 URL: https://issues.apache.org/jira/browse/SPARK-29445 Project: Spark

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

2019-09-09 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926122#comment-16926122 ] Fokko Driesprong commented on SPARK-28921: -- I can confirm that we're running into the same

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.9.x

2019-09-02 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920685#comment-16920685 ] Fokko Driesprong commented on SPARK-27733: -- The regression issue has been resolved with the

[jira] [Updated] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-28728: - Description: (was: Due to CVE's:

[jira] [Updated] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-28728: - Description: Needs to be upgraded due to issues. > Bump Jackson Databind to 2.9.9.3 >

[jira] [Created] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-28728: Summary: Bump Jackson Databind to 2.9.9.3 Key: SPARK-28728 URL: https://issues.apache.org/jira/browse/SPARK-28728 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-28713) Bump checkstyle from 8.14 to 8.18

2019-08-13 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-28713: Summary: Bump checkstyle from 8.14 to 8.18 Key: SPARK-28713 URL: https://issues.apache.org/jira/browse/SPARK-28713 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-27757) Bump Jackson to 2.9.9

2019-05-17 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-27757: Summary: Bump Jackson to 2.9.9 Key: SPARK-27757 URL: https://issues.apache.org/jira/browse/SPARK-27757 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-25408) Move to idiomatic Java 8

2018-09-11 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-25408: Summary: Move to idiomatic Java 8 Key: SPARK-25408 URL: https://issues.apache.org/jira/browse/SPARK-25408 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-25033) Bump Apache commons.{httpclient, httpcore}

2018-08-06 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-25033: Summary: Bump Apache commons.{httpclient, httpcore} Key: SPARK-25033 URL: https://issues.apache.org/jira/browse/SPARK-25033 Project: Spark Issue

[jira] [Created] (SPARK-24603) Typo in comments

2018-06-20 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-24603: Summary: Typo in comments Key: SPARK-24603 URL: https://issues.apache.org/jira/browse/SPARK-24603 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-24601) Bump Jackson version to 2.9.6

2018-06-20 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-24601: Summary: Bump Jackson version to 2.9.6 Key: SPARK-24601 URL: https://issues.apache.org/jira/browse/SPARK-24601 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-24520) Double braces in link

2018-06-11 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-24520: Summary: Double braces in link Key: SPARK-24520 URL: https://issues.apache.org/jira/browse/SPARK-24520 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-23854) Update Guava to 16.0.1

2018-04-03 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-23854: Summary: Update Guava to 16.0.1 Key: SPARK-23854 URL: https://issues.apache.org/jira/browse/SPARK-23854 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-22919) Bump Apache httpclient versions

2017-12-28 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-22919: Summary: Bump Apache httpclient versions Key: SPARK-22919 URL: https://issues.apache.org/jira/browse/SPARK-22919 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-16481) Spark does not update statistics when making use of Hive partitions

2016-07-11 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-16481: Summary: Spark does not update statistics when making use of Hive partitions Key: SPARK-16481 URL: https://issues.apache.org/jira/browse/SPARK-16481 Project:

[jira] [Updated] (SPARK-12869) Optimize conversion from BlockMatrix to IndexedRowMatrix

2016-02-14 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-12869: - Flags: Patch Affects Version/s: 1.6.0 Target Version/s: 1.6.1

[jira] [Commented] (SPARK-12869) Optimize conversion from BlockMatrix to IndexedRowMatrix

2016-01-19 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107533#comment-15107533 ] Fokko Driesprong commented on SPARK-12869: -- Hi guys, I've implemented an improved version of

[jira] [Created] (SPARK-12869) Optimize conversion from BlockMatrix to IndexedRowMatrix

2016-01-17 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-12869: Summary: Optimize conversion from BlockMatrix to IndexedRowMatrix Key: SPARK-12869 URL: https://issues.apache.org/jira/browse/SPARK-12869 Project: Spark