[jira] [Commented] (SPARK-20782) Dataset's isCached operator

[ https://issues.apache.org/jira/browse/SPARK-20782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482195#comment-16482195 ] Soham Aurangabadkar commented on SPARK-20782: - Hello, I was looking at this issue. A

[jira] [Assigned] (SPARK-24328) Fix scala.MatchError in literals.sql.out

[ https://issues.apache.org/jira/browse/SPARK-24328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24328: Assignee: Apache Spark > Fix scala.MatchError in literals.sql.out >

[jira] [Assigned] (SPARK-24328) Fix scala.MatchError in literals.sql.out

[ https://issues.apache.org/jira/browse/SPARK-24328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24328: Assignee: (was: Apache Spark) > Fix scala.MatchError in literals.sql.out >

[jira] [Commented] (SPARK-24328) Fix scala.MatchError in literals.sql.out

[ https://issues.apache.org/jira/browse/SPARK-24328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482172#comment-16482172 ] Apache Spark commented on SPARK-24328: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-24328) Fix scala.MatchError in literals.sql.out

[ https://issues.apache.org/jira/browse/SPARK-24328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482171#comment-16482171 ] Takeshi Yamamuro commented on SPARK-24328: -- I fixed in 

[jira] [Created] (SPARK-24328) Fix scala.MatchError in literals.sql.out

Takeshi Yamamuro created SPARK-24328: Summary: Fix scala.MatchError in literals.sql.out Key: SPARK-24328 URL: https://issues.apache.org/jira/browse/SPARK-24328 Project: Spark Issue

[jira] [Commented] (SPARK-23266) Matrix Inversion on BlockMatrix

[ https://issues.apache.org/jira/browse/SPARK-23266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482159#comment-16482159 ] renfangming commented on SPARK-23266: - [~chandan-misra] Hello,Do you add this feature in spark 2.3.0

[jira] [Commented] (SPARK-24327) Add an option to quote a partition column name in JDBCRelation

[ https://issues.apache.org/jira/browse/SPARK-24327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482158#comment-16482158 ] Apache Spark commented on SPARK-24327: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24327) Add an option to quote a partition column name in JDBCRelation

[ https://issues.apache.org/jira/browse/SPARK-24327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24327: Assignee: Apache Spark > Add an option to quote a partition column name in JDBCRelation >

[jira] [Assigned] (SPARK-24327) Add an option to quote a partition column name in JDBCRelation

[ https://issues.apache.org/jira/browse/SPARK-24327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24327: Assignee: (was: Apache Spark) > Add an option to quote a partition column name in

[jira] [Created] (SPARK-24327) Add an option to quote a partition column name in JDBCRelation

Takeshi Yamamuro created SPARK-24327: Summary: Add an option to quote a partition column name in JDBCRelation Key: SPARK-24327 URL: https://issues.apache.org/jira/browse/SPARK-24327 Project:

[jira] [Commented] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482156#comment-16482156 ] Teng Peng commented on SPARK-24269: --- Yes, I understand this rationale too. However, I am inclined to a

[jira] [Commented] (SPARK-24269) Infer nullability rather than declaring all columns as nullable

[ https://issues.apache.org/jira/browse/SPARK-24269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482148#comment-16482148 ] Hyukjin Kwon commented on SPARK-24269: -- I can at least see the reason. If data doesn't contain null,

[jira] [Commented] (SPARK-24324) UserDefinedFunction mixes column labels

[ https://issues.apache.org/jira/browse/SPARK-24324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482145#comment-16482145 ] Hyukjin Kwon commented on SPARK-24324: -- Can you narrow down the problem? It roughly sounds like

[jira] [Resolved] (SPARK-24320) Cannot read file names with spaces

[ https://issues.apache.org/jira/browse/SPARK-24320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24320. -- Resolution: Duplicate > Cannot read file names with spaces >

[jira] [Commented] (SPARK-24320) Cannot read file names with spaces

[ https://issues.apache.org/jira/browse/SPARK-24320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482143#comment-16482143 ] Hyukjin Kwon commented on SPARK-24320: -- It's a duplicate of SPARK-23148. > Cannot read file names

[jira] [Resolved] (SPARK-24302) when using spark persist(),"KryoException:IndexOutOfBoundsException" happens

[ https://issues.apache.org/jira/browse/SPARK-24302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24302. -- Resolution: Invalid Sounds like a question and not clear if it's a Spark issue. Let's ask this

[jira] [Comment Edited] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482099#comment-16482099 ] Stavros Kontopoulos edited comment on SPARK-2620 at 5/21/18 12:55 AM: --

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482099#comment-16482099 ] Stavros Kontopoulos commented on SPARK-2620: I can reproduce this with 2.4 snapshot.

[jira] [Resolved] (SPARK-23857) In mesos cluster mode spark submit requires the keytab to be available on the local file system.

[ https://issues.apache.org/jira/browse/SPARK-23857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23857. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20967

[jira] [Assigned] (SPARK-23857) In mesos cluster mode spark submit requires the keytab to be available on the local file system.

[ https://issues.apache.org/jira/browse/SPARK-23857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23857: - Assignee: Stavros Kontopoulos > In mesos cluster mode spark submit requires the keytab to be

[jira] [Commented] (SPARK-24326) Add local:// scheme support for the app jar in mesos cluster mode

[ https://issues.apache.org/jira/browse/SPARK-24326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482021#comment-16482021 ] Apache Spark commented on SPARK-24326: -- User 'skonto' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24326) Add local:// scheme support for the app jar in mesos cluster mode

[ https://issues.apache.org/jira/browse/SPARK-24326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24326: Assignee: (was: Apache Spark) > Add local:// scheme support for the app jar in mesos

[jira] [Assigned] (SPARK-24326) Add local:// scheme support for the app jar in mesos cluster mode

[ https://issues.apache.org/jira/browse/SPARK-24326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24326: Assignee: Apache Spark > Add local:// scheme support for the app jar in mesos cluster

[jira] [Updated] (SPARK-24326) Add local:// scheme support for the app jar in mesos cluster mode

[ https://issues.apache.org/jira/browse/SPARK-24326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-24326: Description: It is often useful to reference an application jar within the image

[jira] [Updated] (SPARK-24326) Add local:// scheme support for the app jar in mesos cluster mode

[ https://issues.apache.org/jira/browse/SPARK-24326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-24326: Description: It is often useful to reference an application jar within the image

[jira] [Created] (SPARK-24326) Add local:// scheme support for the app jar in mesos cluster mode

Stavros Kontopoulos created SPARK-24326: --- Summary: Add local:// scheme support for the app jar in mesos cluster mode Key: SPARK-24326 URL: https://issues.apache.org/jira/browse/SPARK-24326

[jira] [Assigned] (SPARK-24325) Tests for Hadoop's LinesReader

[ https://issues.apache.org/jira/browse/SPARK-24325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24325: Assignee: Apache Spark > Tests for Hadoop's LinesReader > --

[jira] [Assigned] (SPARK-24325) Tests for Hadoop's LinesReader

[ https://issues.apache.org/jira/browse/SPARK-24325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24325: Assignee: (was: Apache Spark) > Tests for Hadoop's LinesReader >

[jira] [Commented] (SPARK-24325) Tests for Hadoop's LinesReader

[ https://issues.apache.org/jira/browse/SPARK-24325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481996#comment-16481996 ] Apache Spark commented on SPARK-24325: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-24325) Tests for Hadoop's LinesReader

[ https://issues.apache.org/jira/browse/SPARK-24325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-24325: --- Description: Currently, there are no tests for [Hadoop

[jira] [Created] (SPARK-24325) Tests for Hadoop's LinesReader

Maxim Gekk created SPARK-24325: -- Summary: Tests for Hadoop's LinesReader Key: SPARK-24325 URL: https://issues.apache.org/jira/browse/SPARK-24325 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-22286) OutOfMemoryError caused by memory leak and large serializer batch size in ExternalAppendOnlyMap

[ https://issues.apache.org/jira/browse/SPARK-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481961#comment-16481961 ] Eyal Farago commented on SPARK-22286: - [~jerrylead], don't you think actual root cause here is the

[jira] [Commented] (SPARK-24250) support accessing SQLConf inside tasks

[ https://issues.apache.org/jira/browse/SPARK-24250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481937#comment-16481937 ] Apache Spark commented on SPARK-24250: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-19228) inferSchema function processed csv date column as string and "dateFormat" DataSource option is ignored

[ https://issues.apache.org/jira/browse/SPARK-19228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Rubtsov updated SPARK-19228: --- Description: Current FastDateFormat parser can't properly parse date and timestamp and does

[jira] [Commented] (SPARK-22713) OOM caused by the memory contention and memory leak in TaskMemoryManager

[ https://issues.apache.org/jira/browse/SPARK-22713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481881#comment-16481881 ] Eyal Farago commented on SPARK-22713: - [~jerrylead], what's the relation to SPARK-22286? does solving