[jira] [Commented] (SPARK-17048) ML model read for custom transformers in a pipeline does not work

[ https://issues.apache.org/jira/browse/SPARK-17048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15473009#comment-15473009 ] Yicheng Luo commented on SPARK-17048: - The reason this is failing is because in Java

[jira] [Commented] (SPARK-17428) SparkR executors/workers support virtualenv

[ https://issues.apache.org/jira/browse/SPARK-17428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472995#comment-15472995 ] Felix Cheung commented on SPARK-17428: -- PySpark in fact has a on-going PR on support

[jira] [Closed] (SPARK-17444) spark memory allocation makes workers non responsive

[ https://issues.apache.org/jira/browse/SPARK-17444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ofer Eliassaf closed SPARK-17444. - Resolution: Cannot Reproduce sorry - i can't reproduce properly. closing. > spark memory allocat

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is {{Processing

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is {{Processing

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is {{Processing

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is {{Processing

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Priority: Minor (was: Major) > Default polling and trigger intervals cause excessive RPC c

[jira] [Created] (SPARK-17445) Reference an ASF page as the main place to find third-party packages

Matei Zaharia created SPARK-17445: - Summary: Reference an ASF page as the main place to find third-party packages Key: SPARK-17445 URL: https://issues.apache.org/jira/browse/SPARK-17445 Project: Spark

[jira] [Commented] (SPARK-17429) spark sql length(1) return error

[ https://issues.apache.org/jira/browse/SPARK-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472801#comment-15472801 ] cen yuhai commented on SPARK-17429: --- ok, I wil make a PR later > spark sql length(1) r

[jira] [Created] (SPARK-17444) spark memory allocation makes workers non responsive

Ofer Eliassaf created SPARK-17444: - Summary: spark memory allocation makes workers non responsive Key: SPARK-17444 URL: https://issues.apache.org/jira/browse/SPARK-17444 Project: Spark Issue

[jira] [Updated] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17339: -- Fix Version/s: 2.0.1 > Fix SparkR tests on Windows > --

[jira] [Commented] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472704#comment-15472704 ] Apache Spark commented on SPARK-17442: -- User 'felixcheung' has created a pull reques

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472681#comment-15472681 ] Hadoop QA commented on SPARK-17339: --- [ https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472682#comment-15472682 ] Hadoop QA commented on SPARK-17339: --- [ https://issues.apache.org/jira/browse/SPAR

[jira] [Updated] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17442: - Target Version/s: 2.0.1, 2.1.0 (was: 2.0.1) > Additional arguments in write.df are not passed to data so

[jira] [Commented] (SPARK-17443) SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary

[ https://issues.apache.org/jira/browse/SPARK-17443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472616#comment-15472616 ] Apache Spark commented on SPARK-17443: -- User 'kishorvpatil' has created a pull reque

[jira] [Assigned] (SPARK-17443) SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary

[ https://issues.apache.org/jira/browse/SPARK-17443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17443: Assignee: (was: Apache Spark) > SparkLauncher should allow stoppingApplication and nee

[jira] [Assigned] (SPARK-17443) SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary

[ https://issues.apache.org/jira/browse/SPARK-17443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17443: Assignee: Apache Spark > SparkLauncher should allow stoppingApplication and need not rely

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472604#comment-15472604 ] Hadoop QA commented on SPARK-17339: --- [ https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472602#comment-15472602 ] Hadoop QA commented on SPARK-17339: --- [ https://issues.apache.org/jira/browse/SPAR

[jira] [Created] (SPARK-17443) SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary

Kishor Patil created SPARK-17443: Summary: SparkLauncher should allow stoppingApplication and need not rely on SparkSubmit binary Key: SPARK-17443 URL: https://issues.apache.org/jira/browse/SPARK-17443

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472549#comment-15472549 ] Hadoop QA commented on SPARK-17339: --- [ https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472551#comment-15472551 ] Hadoop QA commented on SPARK-17339: --- [ https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472523#comment-15472523 ] Hadoop QA commented on SPARK-17339: --- [ https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472522#comment-15472522 ] Hadoop QA commented on SPARK-17339: --- [ https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472413#comment-15472413 ] Hadoop QA commented on SPARK-17400: --- Frank Dai created SPARK-17400: ---

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472409#comment-15472409 ] Hadoop QA commented on SPARK-17400: --- Frank Dai created SPARK-17400: ---

[jira] [Commented] (SPARK-17423) Support IGNORE NULLS option in Window functions

[ https://issues.apache.org/jira/browse/SPARK-17423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472394#comment-15472394 ] Tim Chan commented on SPARK-17423: -- [~hvanhovell] I was able to rewrite this Redshift f

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472381#comment-15472381 ] Hadoop QA commented on SPARK-17400: --- [ https://issues.apache.org/jira/browse/SPA

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472382#comment-15472382 ] Hadoop QA commented on SPARK-17400: --- [ https://issues.apache.org/jira/browse/SPA

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472372#comment-15472372 ] Hadoop QA commented on SPARK-17400: --- [ https://issues.apache.org/jira/browse/SPA

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472371#comment-15472371 ] Hadoop QA commented on SPARK-17400: --- [ https://issues.apache.org/jira/browse/SPA

[jira] [Comment Edited] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472323#comment-15472323 ] Zhenhua Wang edited comment on SPARK-16026 at 9/8/16 1:06 AM: -

[jira] [Commented] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472323#comment-15472323 ] Zhenhua Wang commented on SPARK-16026: -- 1. It's a good point. I think it's worth a t

[jira] [Commented] (SPARK-17414) Set type is not supported for creating data frames

[ https://issues.apache.org/jira/browse/SPARK-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472302#comment-15472302 ] Shuai Lin commented on SPARK-17414: --- So what type should {{Set}} be mapped to? {{ArrayT

[jira] [Updated] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17442: --- Target Version/s: 2.0.1 > Additional arguments in write.df are not passed to data source > --

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472245#comment-15472245 ] Apache Spark commented on SPARK-17339: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472219#comment-15472219 ] Apache Spark commented on SPARK-17442: -- User 'falaki' has created a pull request for

[jira] [Assigned] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17442: Assignee: Apache Spark > Additional arguments in write.df are not passed to data source >

[jira] [Assigned] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17442: Assignee: (was: Apache Spark) > Additional arguments in write.df are not passed to dat

[jira] [Commented] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472189#comment-15472189 ] Sean Zhong commented on SPARK-17364: I have a trial fix at https://github.com/apache/

[jira] [Comment Edited] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472182#comment-15472182 ] Sean Zhong edited comment on SPARK-17364 at 9/7/16 11:56 PM: -

[jira] [Comment Edited] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472182#comment-15472182 ] Sean Zhong edited comment on SPARK-17364 at 9/7/16 11:55 PM: -

[jira] [Commented] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472182#comment-15472182 ] Sean Zhong commented on SPARK-17364: [~hvanhovell] That is because the antlr4 lexer b

[jira] [Commented] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472174#comment-15472174 ] Shivaram Venkataraman commented on SPARK-17442: --- I think we missed passing

[jira] [Assigned] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17364: Assignee: (was: Apache Spark) > Can not query hive table starting with number > --

[jira] [Commented] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472175#comment-15472175 ] Apache Spark commented on SPARK-17364: -- User 'clockfly' has created a pull request f

[jira] [Assigned] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17364: Assignee: Apache Spark > Can not query hive table starting with number > -

[jira] [Updated] (SPARK-16533) Spark application not handling preemption messages

[ https://issues.apache.org/jira/browse/SPARK-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-16533: --- Fix Version/s: 2.0.1 > Spark application not handling preemption messages > -

[jira] [Updated] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Summary: Default polling and trigger intervals cause excessive RPC calls (was: Default tri

[jira] [Updated] (SPARK-17386) Default trigger interval causes excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frederick Reiss updated SPARK-17386: Description: The default trigger interval for a Structured Streaming query is {{Processing

[jira] [Updated] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17442: --- Priority: Blocker (was: Critical) > Additional arguments in write.df are not passed to data

[jira] [Updated] (SPARK-17442) Additional arguments in write.df are not passed to data source

[ https://issues.apache.org/jira/browse/SPARK-17442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17442: --- Priority: Critical (was: Major) > Additional arguments in write.df are not passed to data so

[jira] [Created] (SPARK-17442) Additional arguments in write.df are not passed to data source

Hossein Falaki created SPARK-17442: -- Summary: Additional arguments in write.df are not passed to data source Key: SPARK-17442 URL: https://issues.apache.org/jira/browse/SPARK-17442 Project: Spark

[jira] [Commented] (SPARK-17421) Warnings about "MaxPermSize" parameter when building with Maven and Java 8

[ https://issues.apache.org/jira/browse/SPARK-17421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472045#comment-15472045 ] Apache Spark commented on SPARK-17421: -- User 'frreiss' has created a pull request fo

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472037#comment-15472037 ] Qifan Pu commented on SPARK-17405: -- [~joshrosen] Yes, running local[32] will reproduce t

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472009#comment-15472009 ] Qifan Pu commented on SPARK-17405: -- One quick fix is to set memory capacity in configura

[jira] [Commented] (SPARK-17441) Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table

[ https://issues.apache.org/jira/browse/SPARK-17441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472005#comment-15472005 ] Apache Spark commented on SPARK-17441: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-17441) Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table

[ https://issues.apache.org/jira/browse/SPARK-17441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17441: Assignee: (was: Apache Spark) > Issue Exceptions when ALTER TABLE RENAME PARTITION tri

[jira] [Assigned] (SPARK-17440) Issue Exception when ALTER TABLE commands try to alter a VIEW

[ https://issues.apache.org/jira/browse/SPARK-17440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17440: Assignee: (was: Apache Spark) > Issue Exception when ALTER TABLE commands try to alter

[jira] [Commented] (SPARK-17440) Issue Exception when ALTER TABLE commands try to alter a VIEW

[ https://issues.apache.org/jira/browse/SPARK-17440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472004#comment-15472004 ] Apache Spark commented on SPARK-17440: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-17441) Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table

[ https://issues.apache.org/jira/browse/SPARK-17441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17441: Assignee: Apache Spark > Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter

[jira] [Assigned] (SPARK-17440) Issue Exception when ALTER TABLE commands try to alter a VIEW

[ https://issues.apache.org/jira/browse/SPARK-17440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17440: Assignee: Apache Spark > Issue Exception when ALTER TABLE commands try to alter a VIEW > -

[jira] [Commented] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472000#comment-15472000 ] Ron Hu commented on SPARK-16026: Hi Srinath, Thank you for your comments. Let me answer t

[jira] [Issue Comment Deleted] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-16026: --- Comment: was deleted (was: Hi Srinath, Thank you for your comments. Let me answer them one by one. First

[jira] [Created] (SPARK-17441) Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table

Xiao Li created SPARK-17441: --- Summary: Issue Exceptions when ALTER TABLE RENAME PARTITION tries to alter a data source table Key: SPARK-17441 URL: https://issues.apache.org/jira/browse/SPARK-17441 Project:

[jira] [Created] (SPARK-17440) Issue Exception when ALTER TABLE commands try to alter a VIEW

Xiao Li created SPARK-17440: --- Summary: Issue Exception when ALTER TABLE commands try to alter a VIEW Key: SPARK-17440 URL: https://issues.apache.org/jira/browse/SPARK-17440 Project: Spark Issue Ty

[jira] [Commented] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471986#comment-15471986 ] Ron Hu commented on SPARK-16026: Hi Srinath, Thank you for your comments. Let me answer

[jira] [Updated] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17439: --- Labels: correctness (was: ) > QuantilesSummaries returns the wrong result after compression > --

[jira] [Commented] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471829#comment-15471829 ] Apache Spark commented on SPARK-17439: -- User 'thunterdb' has created a pull request

[jira] [Assigned] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17439: Assignee: Apache Spark > QuantilesSummaries returns the wrong result after compression > -

[jira] [Assigned] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17439: Assignee: (was: Apache Spark) > QuantilesSummaries returns the wrong result after comp

[jira] [Created] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

Tim Hunter created SPARK-17439: -- Summary: QuantilesSummaries returns the wrong result after compression Key: SPARK-17439 URL: https://issues.apache.org/jira/browse/SPARK-17439 Project: Spark Is

[jira] [Commented] (SPARK-17439) QuantilesSummaries returns the wrong result after compression

[ https://issues.apache.org/jira/browse/SPARK-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471801#comment-15471801 ] Tim Hunter commented on SPARK-17439: I have a patch for that. It should be merged aft

[jira] [Resolved] (SPARK-17052) Remove Duplicate Test Cases auto_join from HiveCompatibilitySuite.scala

[ https://issues.apache.org/jira/browse/SPARK-17052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17052. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14635 [https://github.

[jira] [Updated] (SPARK-17052) Remove Duplicate Test Cases auto_join from HiveCompatibilitySuite.scala

[ https://issues.apache.org/jira/browse/SPARK-17052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17052: --- Assignee: Xiao Li > Remove Duplicate Test Cases auto_join from HiveCompatibilitySuite.scala > ---

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471747#comment-15471747 ] Qifan Pu commented on SPARK-17405: -- [~joshrosen] Yes likely. The new hashmap asks for 64

[jira] [Commented] (SPARK-17438) Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set

[ https://issues.apache.org/jira/browse/SPARK-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471741#comment-15471741 ] Apache Spark commented on SPARK-17438: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-17438) Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set

[ https://issues.apache.org/jira/browse/SPARK-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17438: Assignee: Shixiong Zhu (was: Apache Spark) > Master UI should show the correct core limit

[jira] [Assigned] (SPARK-17438) Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set

[ https://issues.apache.org/jira/browse/SPARK-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17438: Assignee: Apache Spark (was: Shixiong Zhu) > Master UI should show the correct core limit

[jira] [Created] (SPARK-17438) Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set

Shixiong Zhu created SPARK-17438: Summary: Master UI should show the correct core limit when `ApplicationInfo.executorLimit` is set Key: SPARK-17438 URL: https://issues.apache.org/jira/browse/SPARK-17438

[jira] [Updated] (SPARK-17370) Shuffle service files not invalidated when a slave is lost

[ https://issues.apache.org/jira/browse/SPARK-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17370: --- Fix Version/s: 2.0.1 > Shuffle service files not invalidated when a slave is lost > -

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471690#comment-15471690 ] Josh Rosen commented on SPARK-17405: My hunch is that this is affected by the default

[jira] [Assigned] (SPARK-17437) uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext

[ https://issues.apache.org/jira/browse/SPARK-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17437: Assignee: Apache Spark > uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkCo

[jira] [Commented] (SPARK-17437) uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext

[ https://issues.apache.org/jira/browse/SPARK-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471667#comment-15471667 ] Apache Spark commented on SPARK-17437: -- User 'apetresc' has created a pull request f

[jira] [Assigned] (SPARK-17437) uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext

[ https://issues.apache.org/jira/browse/SPARK-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17437: Assignee: (was: Apache Spark) > uiWebUrl is not accessible to JavaSparkContext or pysp

[jira] [Commented] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

[ https://issues.apache.org/jira/browse/SPARK-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471640#comment-15471640 ] Qifan Pu commented on SPARK-17405: -- [~joshrosen][~jlaskowski]Thanks for the comments and

[jira] [Created] (SPARK-17437) uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext

Adrian Petrescu created SPARK-17437: --- Summary: uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext Key: SPARK-17437 URL: https://issues.apache.org/jira/browse/SPARK-17437 Project:

[jira] [Resolved] (SPARK-17370) Shuffle service files not invalidated when a slave is lost

[ https://issues.apache.org/jira/browse/SPARK-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17370. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14931 [https://github.

[jira] [Commented] (SPARK-17094) provide simplified API for ML pipeline

[ https://issues.apache.org/jira/browse/SPARK-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471563#comment-15471563 ] Nick Pentreath commented on SPARK-17094: It's true that constructor doesn't exist

[jira] [Assigned] (SPARK-17433) YarnShuffleService doesn't handle moving credentials levelDb

[ https://issues.apache.org/jira/browse/SPARK-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17433: Assignee: Apache Spark > YarnShuffleService doesn't handle moving credentials levelDb > --

[jira] [Assigned] (SPARK-17433) YarnShuffleService doesn't handle moving credentials levelDb

[ https://issues.apache.org/jira/browse/SPARK-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17433: Assignee: (was: Apache Spark) > YarnShuffleService doesn't handle moving credentials l

[jira] [Commented] (SPARK-17433) YarnShuffleService doesn't handle moving credentials levelDb

[ https://issues.apache.org/jira/browse/SPARK-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471503#comment-15471503 ] Apache Spark commented on SPARK-17433: -- User 'tgravescs' has created a pull request

[jira] [Closed] (SPARK-17431) How to get 2 years prior date from currentdate using Spark Sql

[ https://issues.apache.org/jira/browse/SPARK-17431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-17431. - Resolution: Not A Problem > How to get 2 years prior date from currentdate using Spark Sq

[jira] [Commented] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471450#comment-15471450 ] Sean Owen commented on SPARK-17368: --- This is beyond my knowledge I'm afraid. I'd help t

[jira] [Commented] (SPARK-17429) spark sql length(1) return error

[ https://issues.apache.org/jira/browse/SPARK-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471443#comment-15471443 ] Dongjoon Hyun commented on SPARK-17429: --- Ya. I agree with [~hvanhovell]. It seems t

[jira] [Commented] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471428#comment-15471428 ] Jakob Odersky commented on SPARK-17368: --- Hmm, you're right my assumption was of usi

[jira] [Commented] (SPARK-17431) How to get 2 years prior date from currentdate using Spark Sql

[ https://issues.apache.org/jira/browse/SPARK-17431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471414#comment-15471414 ] Dongjoon Hyun commented on SPARK-17431: --- Could you close this issue, [~farman.bsse1

[jira] [Updated] (SPARK-17094) provide simplified API for ML pipeline

[ https://issues.apache.org/jira/browse/SPARK-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-17094: --- Description: Many machine learning pipeline has the API for easily assembling transformers. One exam

  1   2   >