[jira] [Commented] (SPARK-25538) incorrect row counts after distinct()

[ https://issues.apache.org/jira/browse/SPARK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633254#comment-16633254 ] Steven Rand commented on SPARK-25538: - [~kiszk] I've uploaded a tarball containing parquet files

[jira] [Updated] (SPARK-25538) incorrect row counts after distinct()

[ https://issues.apache.org/jira/browse/SPARK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated SPARK-25538: Attachment: SPARK-25538-repro.tgz > incorrect row counts after distinct() >

[jira] [Updated] (SPARK-25501) Kafka delegation token support

[ https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-25501: Labels: SPIP (was: ) > Kafka delegation token support > -- > >

[jira] [Created] (SPARK-25576) Fix lint failure in 2.2

Xiao Li created SPARK-25576: --- Summary: Fix lint failure in 2.2 Key: SPARK-25576 URL: https://issues.apache.org/jira/browse/SPARK-25576 Project: Spark Issue Type: Improvement Components:

[jira] [Resolved] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator

[ https://issues.apache.org/jira/browse/SPARK-25568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25568. - Resolution: Fixed Fix Version/s: 2.4.0 2.3.3 2.2.3 >

[jira] [Commented] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633145#comment-16633145 ] Marcelo Vanzin commented on SPARK-25380: We can provide ways to diminish the effect of large

[jira] [Updated] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25572: - Description: follow up to SPARK-24255 from 2.3.2 release we can see that CRAN doesn't seem to

[jira] [Commented] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633129#comment-16633129 ] Felix Cheung commented on SPARK-25572: -- [~cloud_fan] while not a blocker, it would be great to

[jira] [Commented] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633130#comment-16633130 ] Felix Cheung commented on SPARK-25572: -- [~shivaram] > SparkR tests failed on CRAN on Java 10 >

[jira] [Resolved] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-25572. -- Resolution: Fixed Fix Version/s: 2.5.0 2.4.1 Target

[jira] [Commented] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633096#comment-16633096 ] Apache Spark commented on SPARK-25575: -- User 'shahidki31' has created a pull request for this

[jira] [Assigned] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25575: Assignee: Apache Spark > SQL tab in the spark UI doesn't have option of hiding tables,

[jira] [Assigned] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25575: Assignee: (was: Apache Spark) > SQL tab in the spark UI doesn't have option of

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25575: --- Attachment: Screenshot from 2018-09-29 23-26-57.png > SQL tab in the spark UI doesn't have option of

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25575: --- Description: Test tests: 1) bin/spark-shell {code:java} sql("create table a (id int)") for(i <- 1 to 100)

[jira] [Updated] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25575: --- Attachment: Screenshot from 2018-09-29 23-26-45.png > SQL tab in the spark UI doesn't have option of

[jira] [Commented] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633082#comment-16633082 ] shahid commented on SPARK-25575: I will raise a PR > SQL tab in the spark UI doesn't have option of

[jira] [Created] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

shahid created SPARK-25575: -- Summary: SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has. Key: SPARK-25575 URL: https://issues.apache.org/jira/browse/SPARK-25575

[jira] [Resolved] (SPARK-25571) Add withColumnsRenamed method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-25571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25571. -- Resolution: Duplicate > Add withColumnsRenamed method to Dataset >

[jira] [Resolved] (SPARK-25508) Refactor OrcReadBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25508. --- Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22580

[jira] [Assigned] (SPARK-25508) Refactor OrcReadBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25508: - Assignee: yucai > Refactor OrcReadBenchmark to use main method >

[jira] [Updated] (SPARK-25571) Add withColumnsRenamed method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-25571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaerim Yeo updated SPARK-25571: External issue URL: (was: https://github.com/apache/spark/pull/) External issue ID: (was:

[jira] [Commented] (SPARK-25571) Add withColumnsRenamed method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-25571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633025#comment-16633025 ] Apache Spark commented on SPARK-25571: -- User 'cryeo' has created a pull request for this issue:

[jira] [Commented] (SPARK-25571) Add withColumnsRenamed method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-25571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633024#comment-16633024 ] Apache Spark commented on SPARK-25571: -- User 'cryeo' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25571) Add withColumnsRenamed method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-25571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25571: Assignee: Apache Spark > Add withColumnsRenamed method to Dataset >

[jira] [Assigned] (SPARK-25571) Add withColumnsRenamed method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-25571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25571: Assignee: (was: Apache Spark) > Add withColumnsRenamed method to Dataset >

[jira] [Updated] (SPARK-25571) Add withColumnsRenamed method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-25571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaerim Yeo updated SPARK-25571: External issue URL: https://github.com/apache/spark/pull/ External issue ID: 22591 > Add

[jira] [Resolved] (SPARK-25048) Pivoting by multiple columns in Scala/Java

[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25048. -- Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22316

[jira] [Assigned] (SPARK-25048) Pivoting by multiple columns in Scala/Java

[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25048: Assignee: Maxim Gekk > Pivoting by multiple columns in Scala/Java >

[jira] [Resolved] (SPARK-25447) Support JSON options by schema_of_json

[ https://issues.apache.org/jira/browse/SPARK-25447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25447. -- Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22442

[jira] [Assigned] (SPARK-25447) Support JSON options by schema_of_json

[ https://issues.apache.org/jira/browse/SPARK-25447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25447: Assignee: Maxim Gekk > Support JSON options by schema_of_json >

[jira] [Commented] (SPARK-25574) Add an option `keepQuotes` for parsing csv file

[ https://issues.apache.org/jira/browse/SPARK-25574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632873#comment-16632873 ] Apache Spark commented on SPARK-25574: -- User '10110346' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25574) Add an option `keepQuotes` for parsing csv file

[ https://issues.apache.org/jira/browse/SPARK-25574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25574: Assignee: Apache Spark > Add an option `keepQuotes` for parsing csv file >

[jira] [Assigned] (SPARK-25574) Add an option `keepQuotes` for parsing csv file

[ https://issues.apache.org/jira/browse/SPARK-25574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25574: Assignee: (was: Apache Spark) > Add an option `keepQuotes` for parsing csv file >

[jira] [Commented] (SPARK-25574) Add an option `keepQuotes` for parsing csv file

[ https://issues.apache.org/jira/browse/SPARK-25574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632874#comment-16632874 ] Apache Spark commented on SPARK-25574: -- User '10110346' has created a pull request for this issue:

[jira] [Updated] (SPARK-25574) Add an option `keepQuotes` for parsing csv file

[ https://issues.apache.org/jira/browse/SPARK-25574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25574: Description: In our project, when we read the CSV file, we hope to keep quotes. For example: We have

[jira] [Updated] (SPARK-25574) Add an option `keepQuotes` for parsing csv file

[ https://issues.apache.org/jira/browse/SPARK-25574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25574: Description: In our project, when we read the CSV file, we hope to keep quotes. For example: We have

[jira] [Created] (SPARK-25574) Add an option `keepQuotes` for parsing csv file

liuxian created SPARK-25574: --- Summary: Add an option `keepQuotes` for parsing csv file Key: SPARK-25574 URL: https://issues.apache.org/jira/browse/SPARK-25574 Project: Spark Issue Type:

[jira] [Created] (SPARK-25573) Combine resolveExpression and resolve in the rule ResolveReferences

Xiao Li created SPARK-25573: --- Summary: Combine resolveExpression and resolve in the rule ResolveReferences Key: SPARK-25573 URL: https://issues.apache.org/jira/browse/SPARK-25573 Project: Spark