[jira] [Commented] (SPARK-26907) Does ShuffledRDD Replication Work With External Shuffle Service

[ https://issues.apache.org/jira/browse/SPARK-26907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776150#comment-16776150 ] Han Altae-Tran commented on SPARK-26907: Ok, thank you I will try the mailing li

[jira] [Updated] (SPARK-26932) Orc compatibility between hive and spark

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Hai updated SPARK-26932: --- Description: As of Spark 2.3 and Hive 2.3, both supports using apache/orc as orc writer and reader. In olde

[jira] [Commented] (SPARK-26932) Orc compatibility between hive and spark

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776181#comment-16776181 ] Bo Hai commented on SPARK-26932: To reproduce this issue, please create ORC table by Spa

[jira] [Comment Edited] (SPARK-26932) Orc compatibility between hive and spark

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776181#comment-16776181 ] Bo Hai edited comment on SPARK-26932 at 2/24/19 9:22 AM: - To rep

[jira] [Comment Edited] (SPARK-26932) Orc compatibility between hive and spark

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776181#comment-16776181 ] Bo Hai edited comment on SPARK-26932 at 2/24/19 9:25 AM: - To rep

[jira] [Commented] (SPARK-26932) Orc compatibility between hive and spark

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776188#comment-16776188 ] Bo Hai commented on SPARK-26932: We discuss this issue in dev mail list before, refer to

[jira] [Commented] (SPARK-26972) Issue with CSV import and inferSchema set to true

[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776193#comment-16776193 ] Hyukjin Kwon commented on SPARK-26972: -- Your books.csv contains {{\r\n}}, and I gue

[jira] [Commented] (SPARK-26932) Orc compatibility between hive and spark

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776192#comment-16776192 ] Bo Hai commented on SPARK-26932: Relevant hive jiras: * https://jira.apache.org/jira/bro

[jira] [Resolved] (SPARK-26971) How to read delimiter (Cedilla) in spark RDD and Dataframes

[ https://issues.apache.org/jira/browse/SPARK-26971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26971. -- Resolution: Invalid > How to read delimiter (Cedilla) in spark RDD and Dataframes > --

[jira] [Commented] (SPARK-26971) How to read delimiter (Cedilla) in spark RDD and Dataframes

[ https://issues.apache.org/jira/browse/SPARK-26971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776194#comment-16776194 ] Hyukjin Kwon commented on SPARK-26971: -- Questions should go to mailing list rather

[jira] [Comment Edited] (SPARK-26932) Orc compatibility between hive and spark

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776192#comment-16776192 ] Bo Hai edited comment on SPARK-26932 at 2/24/19 9:47 AM: - Releva

[jira] [Comment Edited] (SPARK-26932) Orc compatibility between hive and spark

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776192#comment-16776192 ] Bo Hai edited comment on SPARK-26932 at 2/24/19 9:48 AM: - Releva

[jira] [Updated] (SPARK-26969) [Spark] Using ODBC not able to see the data in table when datatype is decimal

[ https://issues.apache.org/jira/browse/SPARK-26969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26969: - Description: {code} # Using odbc rpm file install odbc  # connect to odbc using isql -v spark2

[jira] [Resolved] (SPARK-26968) option("quoteMode", "NON_NUMERIC") have no effect on a CSV generation

[ https://issues.apache.org/jira/browse/SPARK-26968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26968. -- Resolution: Not A Problem > option("quoteMode", "NON_NUMERIC") have no effect on a CSV generat

[jira] [Commented] (SPARK-26968) option("quoteMode", "NON_NUMERIC") have no effect on a CSV generation

[ https://issues.apache.org/jira/browse/SPARK-26968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776210#comment-16776210 ] Hyukjin Kwon commented on SPARK-26968: -- {{quoteMode}} does not exist in Spark anymo

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776211#comment-16776211 ] Hyukjin Kwon commented on SPARK-26961: -- How did this happen? Would you be able to p

[jira] [Updated] (SPARK-26979) [PySpark] Some SQL functions do not take column names

[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andre Sa de Mello updated SPARK-26979: -- Summary: [PySpark] Some SQL functions do not take column names (was: Some SQL functio

[jira] [Updated] (SPARK-26979) Some SQL functions do not take column names

[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andre Sa de Mello updated SPARK-26979: -- Description: Most SQL functions defined in _org.apache.spark.sql.functions_ have two

[jira] [Updated] (SPARK-26979) [PySpark] Some SQL functions do not take column names

[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andre Sa de Mello updated SPARK-26979: -- Component/s: (was: SQL) PySpark > [PySpark] Some SQL functions do

[jira] [Updated] (SPARK-26979) [PySpark] Some SQL functions do not take column names

[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andre Sa de Mello updated SPARK-26979: -- Description: Most SQL functions defined in _org.apache.spark.sql.functions_ have two

[jira] [Updated] (SPARK-26979) [PySpark] Some SQL functions do not take column names

[ https://issues.apache.org/jira/browse/SPARK-26979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andre Sa de Mello updated SPARK-26979: -- Description: Most SQL functions defined in _org.apache.spark.sql.functions_ have two

[jira] [Commented] (SPARK-26959) Join of two tables, bucketed the same way, on bucket columns and one or more other coulmns should not need a shuffle

[ https://issues.apache.org/jira/browse/SPARK-26959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776247#comment-16776247 ] Yuming Wang commented on SPARK-26959: - Duplicate with [SPARK-24087|https://issues.ap

[jira] [Commented] (SPARK-26927) Race condition may cause dynamic allocation not working

[ https://issues.apache.org/jira/browse/SPARK-26927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776309#comment-16776309 ] wuyi commented on SPARK-26927: -- [~liupengcheng] I can not understand the issue clearly by y

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776400#comment-16776400 ] Mani M commented on SPARK-26918: Let me know to raise the PR. > All .md should have ASF

[jira] [Assigned] (SPARK-26953) Test TimSort for ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-26953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26953: - Assignee: Maxim Gekk > Test TimSort for ArrayIndexOutOfBoundsException > --

[jira] [Resolved] (SPARK-26953) Test TimSort for ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-26953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26953. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23856 [https://github.c

[jira] [Created] (SPARK-26982) Enhance describe frame work to describe the output of a query

Dilip Biswal created SPARK-26982: Summary: Enhance describe frame work to describe the output of a query Key: SPARK-26982 URL: https://issues.apache.org/jira/browse/SPARK-26982 Project: Spark

[jira] [Assigned] (SPARK-26982) Enhance describe frame work to describe the output of a query

[ https://issues.apache.org/jira/browse/SPARK-26982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26982: Assignee: (was: Apache Spark) > Enhance describe frame work to describe the output of

[jira] [Assigned] (SPARK-26982) Enhance describe frame work to describe the output of a query

[ https://issues.apache.org/jira/browse/SPARK-26982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26982: Assignee: Apache Spark > Enhance describe frame work to describe the output of a query >

[jira] [Updated] (SPARK-26982) Enhance describe framework to describe the output of a query

[ https://issues.apache.org/jira/browse/SPARK-26982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-26982: - Summary: Enhance describe framework to describe the output of a query (was: Enhance describe fr

[jira] [Commented] (SPARK-26411) Streaming: _spark_metadata and checkpoints out of sync cause checkpoint packing failure

[ https://issues.apache.org/jira/browse/SPARK-26411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776565#comment-16776565 ] Jungtaek Lim commented on SPARK-26411: -- I tend to agree this concern: the metadata

[jira] [Commented] (SPARK-19019) PySpark does not work with Python 3.6.0

[ https://issues.apache.org/jira/browse/SPARK-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776567#comment-16776567 ] Parixit Odedara commented on SPARK-19019: - I am facing the same issue 1.6.0? Was

[jira] [Comment Edited] (SPARK-19019) PySpark does not work with Python 3.6.0

[ https://issues.apache.org/jira/browse/SPARK-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776567#comment-16776567 ] Parixit Odedara edited comment on SPARK-19019 at 2/25/19 6:41 AM:

[jira] [Commented] (SPARK-19019) PySpark does not work with Python 3.6.0

[ https://issues.apache.org/jira/browse/SPARK-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776582#comment-16776582 ] Jungtaek Lim commented on SPARK-19019: -- According to fix versions, fixed version of

[jira] [Created] (SPARK-26983) Spark PassThroughSuite failure on bigendian

salamani created SPARK-26983: Summary: Spark PassThroughSuite failure on bigendian Key: SPARK-26983 URL: https://issues.apache.org/jira/browse/SPARK-26983 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26983) Spark PassThroughSuite failure on bigendian

[ https://issues.apache.org/jira/browse/SPARK-26983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] salamani updated SPARK-26983: - Description: Following failures are observed for PassThroughSuite in Spark Project SQL  on big endian s