[jira] [Created] (SPARK-28468) `do-release-docker.sh` fails at `sphinx` installation to `Python 2.7`

Dongjoon Hyun created SPARK-28468: - Summary: `do-release-docker.sh` fails at `sphinx` installation to `Python 2.7` Key: SPARK-28468 URL: https://issues.apache.org/jira/browse/SPARK-28468 Project:

[jira] [Commented] (SPARK-27416) UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two machines have different Oops size

[ https://issues.apache.org/jira/browse/SPARK-27416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889926#comment-16889926 ] Dongjoon Hyun commented on SPARK-27416: --- This is backported to `branch-2.4` via

[jira] [Updated] (SPARK-27416) UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two machines have different Oops size

[ https://issues.apache.org/jira/browse/SPARK-27416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27416: -- Fix Version/s: 2.4.4 > UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two

[jira] [Resolved] (SPARK-28456) Add a public API `Encoder.makeCopy` to allow creating Encoder without touching Scala reflections

[ https://issues.apache.org/jira/browse/SPARK-28456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28456. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25209

[jira] [Assigned] (SPARK-27724) DataSourceV2: Add RTAS logical operation

[ https://issues.apache.org/jira/browse/SPARK-27724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27724: --- Assignee: Matt Cheah > DataSourceV2: Add RTAS logical operation >

[jira] [Resolved] (SPARK-27724) DataSourceV2: Add RTAS logical operation

[ https://issues.apache.org/jira/browse/SPARK-27724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27724. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24798

[jira] [Created] (SPARK-28467) Tests failed if there are not enough executors up before running

huangtianhua created SPARK-28467: Summary: Tests failed if there are not enough executors up before running Key: SPARK-28467 URL: https://issues.apache.org/jira/browse/SPARK-28467 Project: Spark

[jira] [Assigned] (SPARK-28369) Check overflow in decimal UDF

[ https://issues.apache.org/jira/browse/SPARK-28369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28369: --- Assignee: Marco Gaido > Check overflow in decimal UDF > - > >

[jira] [Resolved] (SPARK-28369) Check overflow in decimal UDF

[ https://issues.apache.org/jira/browse/SPARK-28369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28369. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25144

[jira] [Updated] (SPARK-28466) FileSystem closed error when to call Hive.moveFile

[ https://issues.apache.org/jira/browse/SPARK-28466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28466: -- Description: When we close a session of STS, if this session has done some SQL about insert, then

[jira] [Updated] (SPARK-28466) FileSystem closed error when to call Hive.moveFile

[ https://issues.apache.org/jira/browse/SPARK-28466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28466: -- Attachment: image-2019-07-22-09-58-55-107.png > FileSystem closed error when to call Hive.moveFile >

[jira] [Updated] (SPARK-28466) FileSystem closed error when to call Hive.moveFile

[ https://issues.apache.org/jira/browse/SPARK-28466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28466: -- Attachment: image-2019-07-22-09-58-19-023.png > FileSystem closed error when to call Hive.moveFile >

[jira] [Updated] (SPARK-28466) FileSystem closed error when to call Hive.moveFile

[ https://issues.apache.org/jira/browse/SPARK-28466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28466: -- Description: When we close a session of STS, if this session has done some SQL about insert, then

[jira] [Created] (SPARK-28466) FileSystem closed error when to call Hive.moveFile

angerszhu created SPARK-28466: - Summary: FileSystem closed error when to call Hive.moveFile Key: SPARK-28466 URL: https://issues.apache.org/jira/browse/SPARK-28466 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28465) K8s integration tests fail due to missing ceph-nano image

[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28465: Summary: K8s integration tests fail due to missing ceph-nano image (was: K8s

[jira] [Updated] (SPARK-28456) Add a public API `Encoder.makeCopy` to allow creating Encoder without touching Scala reflections

[ https://issues.apache.org/jira/browse/SPARK-28456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-28456: - Description: Because `Encoder` is not thread safe, the user cannot reuse an `Encoder` in

[jira] [Comment Edited] (SPARK-28155) do not leak SaveMode to file source v2

[ https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889404#comment-16889404 ] Dongjoon Hyun edited comment on SPARK-28155 at 7/21/19 9:18 PM:

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889823#comment-16889823 ] Dongjoon Hyun commented on SPARK-24152: --- Thank you again, [~viirya]! > SparkR CRAN feasibility

[jira] [Assigned] (SPARK-28462) Add a prefix '*' to non-nullable attribute names in PlanTestBase.comparePlans failures

[ https://issues.apache.org/jira/browse/SPARK-28462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28462: - Assignee: Takeshi Yamamuro > Add a prefix '*' to non-nullable attribute names in

[jira] [Resolved] (SPARK-28462) Add a prefix '*' to non-nullable attribute names in PlanTestBase.comparePlans failures

[ https://issues.apache.org/jira/browse/SPARK-28462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28462. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25213

[jira] [Assigned] (SPARK-28464) Document kafka minPartitions option in "Structured Streaming + Kafka Integration Guide"

[ https://issues.apache.org/jira/browse/SPARK-28464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28464: - Assignee: Arun Pandian > Document kafka minPartitions option in "Structured Streaming

[jira] [Resolved] (SPARK-28464) Document kafka minPartitions option in "Structured Streaming + Kafka Integration Guide"

[ https://issues.apache.org/jira/browse/SPARK-28464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28464. --- Resolution: Fixed Fix Version/s: 3.0.0 2.4.4 This is resolved via

[jira] [Updated] (SPARK-28464) Document kafka minPartitions option in "Structured Streaming + Kafka Integration Guide"

[ https://issues.apache.org/jira/browse/SPARK-28464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28464: -- Affects Version/s: 3.0.0 > Document kafka minPartitions option in "Structured Streaming +

[jira] [Updated] (SPARK-28465) K8s integration tests fail due to non existent image

[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28465: Description: Image added here: 

[jira] [Commented] (SPARK-28459) Date/Time Functions: make_timestamp

[ https://issues.apache.org/jira/browse/SPARK-28459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889779#comment-16889779 ] Shivu Sondur commented on SPARK-28459: -- [~maxgekk] Oh ok, I was also analyzing it. You can

[jira] [Updated] (SPARK-28465) K8s integration tests fail due to non existent image

[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28465: Description: Image added here: 

[jira] [Created] (SPARK-28465) K8s integration tests fail due to non existent image

Stavros Kontopoulos created SPARK-28465: --- Summary: K8s integration tests fail due to non existent image Key: SPARK-28465 URL: https://issues.apache.org/jira/browse/SPARK-28465 Project: Spark

[jira] [Updated] (SPARK-28463) Thriftserver throws java.math.BigDecimal incompatible with org.apache.hadoop.hive.common.type.HiveDecimal

[ https://issues.apache.org/jira/browse/SPARK-28463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28463: Description: How to reproduce this issue: {code:sh} build/sbt clean package -Phive

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889742#comment-16889742 ] Liang-Chi Hsieh commented on SPARK-24152: - Ok. I think it was fixed. > SparkR CRAN feasibility

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889672#comment-16889672 ] Hyukjin Kwon commented on SPARK-24152: -- Thanks. Let's target do drop lower R versions than 3.4 in

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889671#comment-16889671 ] Liang-Chi Hsieh commented on SPARK-24152: - This CRAN issue is happening now, again. Emailed to

[jira] [Commented] (SPARK-27441) Add read/write tests to Hive serde tables

[ https://issues.apache.org/jira/browse/SPARK-27441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889662#comment-16889662 ] Dongjoon Hyun commented on SPARK-27441: --- Thank you for pinging me, [~yumwang]. This was missed due

[jira] [Resolved] (SPARK-27441) Add read/write tests to Hive serde tables

[ https://issues.apache.org/jira/browse/SPARK-27441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27441. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0