[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36277: - Description: I am writing the steps to reproduce the issue for "count" pyspark api while using

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Attachment: sample.csv > Issue with record count of data frame while reading in DropMalformed mode > ---

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Description: I am writing the steps to reproduce the issue for "count" pyspark api while using mode as dropmalf

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Description: I am writing the steps to reproduce the issue for "count" pyspark api while using mode as dropmalf

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Attachment: Inputfile.PNG > Issue with record count of data frame while reading in DropMalformed mode >

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Attachment: 111.PNG > Issue with record count of data frame while reading in DropMalformed mode > --

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Attachment: (was: 111.PNG) > Issue with record count of data frame while reading in DropMalformed mode > ---

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Description: I am writing the steps to reproduce the issue for "count" pyspark api while using mode as dropmalf

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Description: I am writing the steps to reproduce the issue for "count" pyspark api while using mode as dropmalf

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-26 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Description: I am writing the steps to reproduce the issue for "count" pyspark api while using mode as dropmalf

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36277: - Description: While reading the dataframe in malformed mode ,I am not getting right record count

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-23 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Description: While reading the dataframe in malformed mode ,I am not getting right record count. dataframe.coun

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-23 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Description: While reading the dataframe in malformed mode ,I am not getting right record count. dataframe.coun

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-23 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Description:  I am trying to read the two dataframes from one file using with/without predefined schema. Issue

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-23 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Description:  I am trying to read the two dataframes from one file using with/without predefined schema. Issue

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-23 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Attachment: 111.PNG > Issue with record count of data frame while reading in DropMalformed mode > --

[jira] [Updated] (SPARK-36277) Issue with record count of data frame while reading in DropMalformed mode

2021-07-23 Thread anju (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anju updated SPARK-36277: - Summary: Issue with record count of data frame while reading in DropMalformed mode (was: Issue record count of