[jira] [Updated] (SPARK-32969) Spark Submit process not exiting after session.stop()

[ https://issues.apache.org/jira/browse/SPARK-32969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] El R updated SPARK-32969: - Affects Version/s: (was: 3.0.1) > Spark Submit process not exiting after session.stop() > --

[jira] [Created] (SPARK-32969) Spark Submit process not exiting after session.stop()

El R created SPARK-32969: Summary: Spark Submit process not exiting after session.stop() Key: SPARK-32969 URL: https://issues.apache.org/jira/browse/SPARK-32969 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-27295) Provision to provide initial values for each source node in personalised page rank - Graphx

[ https://issues.apache.org/jira/browse/SPARK-27295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshwar S R updated SPARK-27295: --- Priority: Major (was: Minor) > Provision to provide initial values for each source node in personal

[jira] [Created] (SPARK-27295) Provision to provide initial values for each source node in personalised page rank - Graphx

Eshwar S R created SPARK-27295: -- Summary: Provision to provide initial values for each source node in personalised page rank - Graphx Key: SPARK-27295 URL: https://issues.apache.org/jira/browse/SPARK-27295

[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16731349#comment-16731349 ] Samik R commented on SPARK-19217: - Any update on this? Still seems useful: I am trying t

[jira] [Commented] (SPARK-26206) Spark structured streaming with kafka integration fails in update mode

[ https://issues.apache.org/jira/browse/SPARK-26206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708245#comment-16708245 ] indraneel r commented on SPARK-26206: - [~kabhwan]  Here are some of my observations

[jira] [Commented] (SPARK-26206) Spark structured streaming with kafka integration fails in update mode

[ https://issues.apache.org/jira/browse/SPARK-26206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16704277#comment-16704277 ] indraneel r commented on SPARK-26206: - Will check on spark-shell but not sure if it

[jira] [Updated] (SPARK-26206) Spark structured streaming with kafka integration fails in update mode

[ https://issues.apache.org/jira/browse/SPARK-26206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] indraneel r updated SPARK-26206: Description: Spark structured streaming with kafka integration fails in update mode with compilat

[jira] [Updated] (SPARK-26206) Spark structured streaming with kafka integration fails in update mode

[ https://issues.apache.org/jira/browse/SPARK-26206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] indraneel r updated SPARK-26206: Description: Spark structured streaming with kafka integration fails in update mode with compilat

[jira] [Updated] (SPARK-26206) Spark structured streaming with kafka integration fails in update mode

[ https://issues.apache.org/jira/browse/SPARK-26206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] indraneel r updated SPARK-26206: Description: Spark structured streaming with kafka integration fails in update mode with compilat

[jira] [Commented] (SPARK-26206) Spark structured streaming with kafka integration fails in update mode

[ https://issues.apache.org/jira/browse/SPARK-26206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702757#comment-16702757 ] indraneel r commented on SPARK-26206: - [~kabhwan]  Have added the details in the des

[jira] [Updated] (SPARK-26206) Spark structured streaming with kafka integration fails in update mode

[ https://issues.apache.org/jira/browse/SPARK-26206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] indraneel r updated SPARK-26206: Environment: Operating system : MacOS Mojave spark version : 2.4.0 spark-sql-kafka-0-10 : 2.4.0

[jira] [Updated] (SPARK-26206) Spark structured streaming with kafka integration fails in update mode

[ https://issues.apache.org/jira/browse/SPARK-26206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] indraneel r updated SPARK-26206: Environment: Operating system : MacOS Mojave spark version : 2.4.0 spark-streaming-kafka-0-10 :

[jira] [Created] (SPARK-26206) Spark structured streaming with kafka integration fails in update mode

indraneel r created SPARK-26206: --- Summary: Spark structured streaming with kafka integration fails in update mode Key: SPARK-26206 URL: https://issues.apache.org/jira/browse/SPARK-26206 Project: Spark

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584732#comment-16584732 ] Chakradhar N R commented on SPARK-24432: What are the changes related to shuffle

[jira] [Commented] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16566708#comment-16566708 ] Samik R commented on SPARK-22600: - Interestingly, the exception doesn't get caught in a

[jira] [Created] (SPARK-24608) report number of iteration/progress for ML training

R created SPARK-24608: - Summary: report number of iteration/progress for ML training Key: SPARK-24608 URL: https://issues.apache.org/jira/browse/SPARK-24608 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-23510) Support read data from Hive 2.2 and Hive 2.3 metastore

[ https://issues.apache.org/jira/browse/SPARK-23510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16394117#comment-16394117 ] R commented on SPARK-23510: --- [~q79969786] - can you add fix version of 2.3.1 to this? Would lik

[jira] [Created] (SPARK-23576) SparkSQL - Decimal data missing decimal point

R created SPARK-23576: - Summary: SparkSQL - Decimal data missing decimal point Key: SPARK-23576 URL: https://issues.apache.org/jira/browse/SPARK-23576 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291805#comment-16291805 ] Anvesh R commented on SPARK-22036: -- +1 Issue reproduced on spark-2.2.0 : Data at s3 lo

[jira] [Updated] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumaresh C R updated SPARK-22516: - Attachment: test_file_without_eof_char.csv > CSV Read breaks: When "multiLine" = "true", if "comm

[jira] [Commented] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259157#comment-16259157 ] Kumaresh C R commented on SPARK-22516: -- [~mgaido]: Even after I replaced all 'CR LF'

[jira] [Updated] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumaresh C R updated SPARK-22516: - Labels: csvparser (was: ) > CSV Read breaks: When "multiLine" = "true", if "comment" option is s

[jira] [Commented] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16251110#comment-16251110 ] Kumaresh C R commented on SPARK-22516: -- [~hyukjin.kwon]: Need your help here :) > C

[jira] [Updated] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumaresh C R updated SPARK-22516: - Attachment: testCommentChar.csv > CSV Read breaks: When "multiLine" = "true", if "comment" option

[jira] [Updated] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumaresh C R updated SPARK-22516: - Description: Try to read attached CSV file with following parse properties, scala> *val csvFile

[jira] [Updated] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumaresh C R updated SPARK-22516: - Description: Try to read attached CSV file with following parse properties, scala> *val csvFile

[jira] [Updated] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumaresh C R updated SPARK-22516: - Description: Try to read attached CSV file with following parse properties, scala> *val csvFile

[jira] [Updated] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

[ https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumaresh C R updated SPARK-22516: - Description: Try to read attached CSV file with following parse properties, scala> *val csvFile

[jira] [Created] (SPARK-22516) CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character

Kumaresh C R created SPARK-22516: Summary: CSV Read breaks: When "multiLine" = "true", if "comment" option is set as last line's first character Key: SPARK-22516 URL: https://issues.apache.org/jira/browse/SPARK-22

[jira] [Comment Edited] (SPARK-21820) csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly

[ https://issues.apache.org/jira/browse/SPARK-21820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138405#comment-16138405 ] Kumaresh C R edited comment on SPARK-21820 at 8/23/17 2:24 PM:

[jira] [Commented] (SPARK-21820) csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly

[ https://issues.apache.org/jira/browse/SPARK-21820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138405#comment-16138405 ] Kumaresh C R commented on SPARK-21820: -- [~hyukjin.kwon]: Sound great.. We will wait

[jira] [Comment Edited] (SPARK-21820) csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly

[ https://issues.apache.org/jira/browse/SPARK-21820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138405#comment-16138405 ] Kumaresh C R edited comment on SPARK-21820 at 8/23/17 2:13 PM:

[jira] [Comment Edited] (SPARK-21820) csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly

[ https://issues.apache.org/jira/browse/SPARK-21820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138324#comment-16138324 ] Kumaresh C R edited comment on SPARK-21820 at 8/23/17 1:21 PM:

[jira] [Comment Edited] (SPARK-21820) csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly

[ https://issues.apache.org/jira/browse/SPARK-21820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138327#comment-16138327 ] Kumaresh C R edited comment on SPARK-21820 at 8/23/17 1:20 PM:

[jira] [Commented] (SPARK-21820) csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly

[ https://issues.apache.org/jira/browse/SPARK-21820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138327#comment-16138327 ] Kumaresh C R commented on SPARK-21820: -- @Sean Owen: This is an issue with spark data

[jira] [Commented] (SPARK-21820) csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly

[ https://issues.apache.org/jira/browse/SPARK-21820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138324#comment-16138324 ] Kumaresh C R commented on SPARK-21820: -- [~hyukjin.kwon]: Could you please help us he

[jira] [Updated] (SPARK-21820) csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly

[ https://issues.apache.org/jira/browse/SPARK-21820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumaresh C R updated SPARK-21820: - Attachment: windows_CRLF.csv > csv option "multiLine" as "true" not parsing windows line feed (CR

[jira] [Created] (SPARK-21820) csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly

Kumaresh C R created SPARK-21820: Summary: csv option "multiLine" as "true" not parsing windows line feed (CR LF) properly Key: SPARK-21820 URL: https://issues.apache.org/jira/browse/SPARK-21820 Proje

[jira] [Commented] (SPARK-20310) Dependency convergence error for scala-xml

[ https://issues.apache.org/jira/browse/SPARK-20310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967146#comment-15967146 ] Samik R commented on SPARK-20310: - Hi Sean, Thanks for your comments. You are probably t

[jira] [Created] (SPARK-20310) Dependency convergence error for scala-xml

Samik R created SPARK-20310: --- Summary: Dependency convergence error for scala-xml Key: SPARK-20310 URL: https://issues.apache.org/jira/browse/SPARK-20310 Project: Spark Issue Type: Bug Co

[jira] [Updated] (SPARK-19503) Execution Plan Optimizer: avoid sort or shuffle when it does not change end result such as df.sort(...).count()

[ https://issues.apache.org/jira/browse/SPARK-19503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] R updated SPARK-19503: -- Summary: Execution Plan Optimizer: avoid sort or shuffle when it does not change end result such as df.sort(...).count(

[jira] [Created] (SPARK-19504) clearCache fails to delete orphan RDDs, especially in pyspark

R created SPARK-19504: - Summary: clearCache fails to delete orphan RDDs, especially in pyspark Key: SPARK-19504 URL: https://issues.apache.org/jira/browse/SPARK-19504 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-19503) Dumb Execution Plan

R created SPARK-19503: - Summary: Dumb Execution Plan Key: SPARK-19503 URL: https://issues.apache.org/jira/browse/SPARK-19503 Project: Spark Issue Type: Bug Components: Optimizer Affects Ver

[jira] [Closed] (SPARK-17576) As LongType.simpleString in spark is "bigint", Carbon will convert Long to BigInt

[ https://issues.apache.org/jira/browse/SPARK-17576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R closed SPARK-17576. -- Resolution: Invalid > As LongType.simpleString in spark is "bigint", Carbon will convert Long to > Big

[jira] [Created] (SPARK-17576) As LongType.simpleString in spark is "bigint", Carbon will convert Long to BigInt

Naresh P R created SPARK-17576: -- Summary: As LongType.simpleString in spark is "bigint", Carbon will convert Long to BigInt Key: SPARK-17576 URL: https://issues.apache.org/jira/browse/SPARK-17576 Project

[jira] [Updated] (SPARK-14194) spark csv reader not working properly if CSV content contains CRLF character (newline) in the intermediate cell

[ https://issues.apache.org/jira/browse/SPARK-14194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumaresh C R updated SPARK-14194: - Description: We have CSV content like below, Sl.NO, Employee_Name, Company, Address, Country, ZI

[jira] [Created] (SPARK-14194) spark csv reader not working properly if CSV content contains CRLF character (newline) in the intermediate cell

Kumaresh C R created SPARK-14194: Summary: spark csv reader not working properly if CSV content contains CRLF character (newline) in the intermediate cell Key: SPARK-14194 URL: https://issues.apache.org/jira/brows