[jira] [Created] (SPARK-20734) Structured Streaming spark.sql.streaming.schemaInference not handling schema changes

Ram created SPARK-20734: --- Summary: Structured Streaming spark.sql.streaming.schemaInference not handling schema changes Key: SPARK-20734 URL: https://issues.apache.org/jira/browse/SPARK-20734 Project: Spark

[jira] [Updated] (SPARK-20733) Permission Error: Access Denied

[ https://issues.apache.org/jira/browse/SPARK-20733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parker Xiao updated SPARK-20733: - Description: I am experiencing the following issue when I tried to launch pyspark.

[jira] [Created] (SPARK-20733) Permission Error: Access Denied

Parker Xiao created SPARK-20733: Summary: Permission Error: Access Denied Key: SPARK-20733 URL: https://issues.apache.org/jira/browse/SPARK-20733 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20725) partial aggregate should behave correctly for sameResult

[ https://issues.apache.org/jira/browse/SPARK-20725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009564#comment-16009564 ] Apache Spark commented on SPARK-20725: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-20725) partial aggregate should behave correctly for sameResult

[ https://issues.apache.org/jira/browse/SPARK-20725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-20725: -- Target Version/s: 2.1.2 > partial aggregate should behave correctly for sameResult >

[jira] [Resolved] (SPARK-20725) partial aggregate should behave correctly for sameResult

[ https://issues.apache.org/jira/browse/SPARK-20725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-20725. --- Resolution: Fixed Fix Version/s: 2.2.0 > partial aggregate should behave

[jira] [Commented] (SPARK-19840) Disallow creating permanent functions with invalid class names

[ https://issues.apache.org/jira/browse/SPARK-19840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009348#comment-16009348 ] Dongjoon Hyun commented on SPARK-19840: --- Hi, [~smilegator]. Is there any plan to fix this in 2.2.0?

[jira] [Commented] (SPARK-20684) expose createGlobalTempView and dropGlobalTempView in SparkR

[ https://issues.apache.org/jira/browse/SPARK-20684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009344#comment-16009344 ] Dongjoon Hyun commented on SPARK-20684: --- Hi, [~falaki]. According to the comments on PR, this issue

[jira] [Assigned] (SPARK-18772) Unnecessary conversion try for special floats in JSON

[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-18772: --- Assignee: Hyukjin Kwon > Unnecessary conversion try for special floats in JSON >

[jira] [Resolved] (SPARK-18772) Unnecessary conversion try for special floats in JSON

[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18772. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17956

[jira] [Commented] (SPARK-20628) Keep track of nodes which are going to be shut down & avoid scheduling new tasks

[ https://issues.apache.org/jira/browse/SPARK-20628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009261#comment-16009261 ] holdenk commented on SPARK-20628: - I'm going to take a crack at implementing this - I'm traveling a lot

[jira] [Updated] (SPARK-20629) Copy shuffle data when nodes are being shut down

[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-20629: Summary: Copy shuffle data when nodes are being shut down (was: Copy data when nodes are being shut down)

[jira] [Updated] (SPARK-18772) Unnecessary conversion try for special floats in JSON

[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-18772: - Affects Version/s: 2.2.0 Description: It looks we can avoid some cases for unnecessary

[jira] [Assigned] (SPARK-20731) Add ability to change or omit .csv file extension in CSV Data Source

[ https://issues.apache.org/jira/browse/SPARK-20731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20731: Assignee: Apache Spark > Add ability to change or omit .csv file extension in CSV Data

[jira] [Assigned] (SPARK-20731) Add ability to change or omit .csv file extension in CSV Data Source

[ https://issues.apache.org/jira/browse/SPARK-20731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20731: Assignee: (was: Apache Spark) > Add ability to change or omit .csv file extension in

[jira] [Commented] (SPARK-20731) Add ability to change or omit .csv file extension in CSV Data Source

[ https://issues.apache.org/jira/browse/SPARK-20731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009180#comment-16009180 ] Apache Spark commented on SPARK-20731: -- User 'mikkokupsu' has created a pull request for this issue:

[jira] [Created] (SPARK-20731) Add ability to change or omit .csv file extension in CSV Data Source

Mikko Kupsu created SPARK-20731: --- Summary: Add ability to change or omit .csv file extension in CSV Data Source Key: SPARK-20731 URL: https://issues.apache.org/jira/browse/SPARK-20731 Project: Spark

[jira] [Assigned] (SPARK-20723) Random Forest Classifier should expose intermediateRDDStorageLevel similar to ALS

[ https://issues.apache.org/jira/browse/SPARK-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20723: Assignee: Apache Spark > Random Forest Classifier should expose

[jira] [Assigned] (SPARK-20723) Random Forest Classifier should expose intermediateRDDStorageLevel similar to ALS

[ https://issues.apache.org/jira/browse/SPARK-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20723: Assignee: (was: Apache Spark) > Random Forest Classifier should expose

[jira] [Commented] (SPARK-20723) Random Forest Classifier should expose intermediateRDDStorageLevel similar to ALS

[ https://issues.apache.org/jira/browse/SPARK-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009171#comment-16009171 ] Apache Spark commented on SPARK-20723: -- User 'phatak-dev' has created a pull request for this issue:

[jira] [Updated] (SPARK-20723) Random Forest Classifier should expose intermediateRDDStorageLevel similar to ALS

[ https://issues.apache.org/jira/browse/SPARK-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] madhukara phatak updated SPARK-20723: - Description: Currently Random Forest implementation cache as the intermediatery data

[jira] [Commented] (SPARK-19122) Unnecessary shuffle+sort added if join predicates ordering differ from bucketing and sorting order

[ https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009165#comment-16009165 ] Tejas Patil commented on SPARK-19122: - Thanks for confirming. I have added it in the jira description

[jira] [Updated] (SPARK-19122) Unnecessary shuffle+sort added if join predicates ordering differ from bucketing and sorting order

[ https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-19122: Description: `table1` and `table2` are sorted and bucketed on columns `j` and `k` (in respective