[jira] [Assigned] (SPARK-20532) SparkR should provide grouping and grouping_id

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20532: Assignee: Apache Spark > SparkR should provide grouping and grouping_id >

[jira] [Assigned] (SPARK-20532) SparkR should provide grouping and grouping_id

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20532: Assignee: (was: Apache Spark) > SparkR should provide grouping and grouping_id >

[jira] [Commented] (SPARK-20532) SparkR should provide grouping and grouping_id

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989767#comment-15989767 ] Apache Spark commented on SPARK-20532: -- User 'zero323' has created a pull request for this issue:

[jira] [Created] (SPARK-20532) SparkR should provide grouping and grouping_id

2017-04-28 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-20532: -- Summary: SparkR should provide grouping and grouping_id Key: SPARK-20532 URL: https://issues.apache.org/jira/browse/SPARK-20532 Project: Spark

[jira] [Created] (SPARK-20531) Spark master shouldn't send its address back to the workers over proxied connections

2017-04-28 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-20531: -- Summary: Spark master shouldn't send its address back to the workers over proxied connections Key: SPARK-20531 URL: https://issues.apache.org/jira/browse/SPARK-20531

[jira] [Updated] (SPARK-20530) "Cannot evaluate expression" when filtering on parquet partition column

2017-04-28 Thread James Maki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Maki updated SPARK-20530: --- Environment: spark-2.1.0-bin-hadoop2.7 Python2 (was: spark-2.1.0-bin-hadoop2.7.tgz Python2) >

[jira] [Commented] (SPARK-20526) Load doesn't work in PCAModel

2017-04-28 Thread Hayri Volkan Agun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989623#comment-15989623 ] Hayri Volkan Agun commented on SPARK-20526: --- I think the problem is about explainedVariance. It

[jira] [Commented] (SPARK-20530) "Cannot evaluate expression" when filtering on parquet partition column

2017-04-28 Thread James Maki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989619#comment-15989619 ] James Maki commented on SPARK-20530: As with SPARK-17100 calling {{cache()}} allows this filter to

[jira] [Created] (SPARK-20530) "Cannot evaluate expression" when filtering on parquet partition column

2017-04-28 Thread James Maki (JIRA)
James Maki created SPARK-20530: -- Summary: "Cannot evaluate expression" when filtering on parquet partition column Key: SPARK-20530 URL: https://issues.apache.org/jira/browse/SPARK-20530 Project: Spark

[jira] [Commented] (SPARK-20526) Load doesn't work in PCAModel

2017-04-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989591#comment-15989591 ] yuhao yang commented on SPARK-20526: Can you please provide more context? like which version of Spark

[jira] [Created] (SPARK-20529) Worker should not use the received Master address

2017-04-28 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-20529: Summary: Worker should not use the received Master address Key: SPARK-20529 URL: https://issues.apache.org/jira/browse/SPARK-20529 Project: Spark Issue

[jira] [Commented] (SPARK-19256) Hive bucketing support

2017-04-28 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989560#comment-15989560 ] Tejas Patil commented on SPARK-19256: - [~cloud_fan], [~sameerag] : I was looking at trunk and

[jira] [Resolved] (SPARK-19525) Enable Compression of RDD Checkpoints

2017-04-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-19525. -- Resolution: Fixed Assignee: Aaditya Ramesh > Enable Compression of RDD Checkpoints >

[jira] [Updated] (SPARK-19525) Enable Compression of RDD Checkpoints

2017-04-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-19525: - Fix Version/s: 2.2.0 > Enable Compression of RDD Checkpoints >

[jira] [Commented] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

2017-04-28 Thread Jeeyoung Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989526#comment-15989526 ] Jeeyoung Kim commented on SPARK-10878: -- Can't we fix the race condition, at least for the

[jira] [Comment Edited] (SPARK-10878) Race condition when resolving Maven coordinates via Ivy

2017-04-28 Thread Jeeyoung Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989526#comment-15989526 ] Jeeyoung Kim edited comment on SPARK-10878 at 4/28/17 10:10 PM: Can't we

[jira] [Updated] (SPARK-20528) Add BinaryFileReader and Writer for DataFrames

2017-04-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20528: -- Description: It would be very useful to have a binary data reader/writer for

[jira] [Created] (SPARK-20528) Add BinaryFileReader and Writer for DataFrames

2017-04-28 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20528: - Summary: Add BinaryFileReader and Writer for DataFrames Key: SPARK-20528 URL: https://issues.apache.org/jira/browse/SPARK-20528 Project: Spark

[jira] [Commented] (SPARK-20527) Schema issues when fields are queries in different order

2017-04-28 Thread John Berryman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989506#comment-15989506 ] John Berryman commented on SPARK-20527: --- If I sort the schema I appear to get past this bug.

[jira] [Updated] (SPARK-20471) Remove AggregateBenchmark testsuite warning: Two level hashmap is disabled but vectorized hashmap is enabled.

2017-04-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20471: Fix Version/s: 2.3.0 > Remove AggregateBenchmark testsuite warning: Two level hashmap is disabled > but

[jira] [Assigned] (SPARK-20471) Remove AggregateBenchmark testsuite warning: Two level hashmap is disabled but vectorized hashmap is enabled.

2017-04-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20471: --- Assignee: caoxuewen > Remove AggregateBenchmark testsuite warning: Two level hashmap is disabled >

[jira] [Resolved] (SPARK-20471) Remove AggregateBenchmark testsuite warning: Two level hashmap is disabled but vectorized hashmap is enabled.

2017-04-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20471. - Resolution: Fixed Fix Version/s: 2.2.1 > Remove AggregateBenchmark testsuite warning: Two level

[jira] [Resolved] (SPARK-20514) Upgrade Jetty to 9.3.11.v20160721

2017-04-28 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20514. Resolution: Fixed Assignee: Mark Grover Fix Version/s: 2.2.0 > Upgrade

[jira] [Commented] (SPARK-20487) `HiveTableScan` node is quite verbose in explained plan

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989452#comment-15989452 ] Apache Spark commented on SPARK-20487: -- User 'tejasapatil' has created a pull request for this

[jira] [Updated] (SPARK-20527) Schema issues when fields are queries in different order

2017-04-28 Thread John Berryman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Berryman updated SPARK-20527: -- Description: In the code below I * create a dataframe * shove it into hive * use spark.sql to

[jira] [Created] (SPARK-20527) Schema issues when fields are queries in different order

2017-04-28 Thread John Berryman (JIRA)
John Berryman created SPARK-20527: - Summary: Schema issues when fields are queries in different order Key: SPARK-20527 URL: https://issues.apache.org/jira/browse/SPARK-20527 Project: Spark

[jira] [Updated] (SPARK-20364) Parquet predicate pushdown on columns with dots return empty results

2017-04-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-20364: - Target Version/s: 2.2.0 Priority: Critical (was: Major) > Parquet predicate

[jira] [Comment Edited] (SPARK-20525) ClassCast exception when interpreting UDFs from a String in spark-shell

2017-04-28 Thread Dave Knoester (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989344#comment-15989344 ] Dave Knoester edited comment on SPARK-20525 at 4/28/17 7:38 PM: I've

[jira] [Updated] (SPARK-20525) ClassCast exception when interpreting UDFs from a String in spark-shell

2017-04-28 Thread Dave Knoester (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Knoester updated SPARK-20525: -- Attachment: UdfTest.scala Examples showing desired functionality. > ClassCast exception when

[jira] [Commented] (SPARK-20525) ClassCast exception when interpreting UDFs from a String in spark-shell

2017-04-28 Thread Dave Knoester (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989340#comment-15989340 ] Dave Knoester commented on SPARK-20525: --- In that case, spark-shell shouldn't be able to run this

[jira] [Updated] (SPARK-20525) ClassCast exception when interpreting UDFs from a String in spark-shell

2017-04-28 Thread Dave Knoester (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Knoester updated SPARK-20525: -- Description: I'm trying to interpret a string containing Scala code from inside a Spark

[jira] [Commented] (SPARK-20502) ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit

2017-04-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989317#comment-15989317 ] yuhao yang commented on SPARK-20502: Check here https://issues.apache.org/jira/browse/SPARK-18319 for

[jira] [Commented] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989302#comment-15989302 ] Ratandeep Ratti commented on SPARK-20516: - Ah. my bad {{spark-warehouse}} is a valid uri. I have

[jira] [Created] (SPARK-20526) Load doesn't work in PCAModel

2017-04-28 Thread Hayri Volkan Agun (JIRA)
Hayri Volkan Agun created SPARK-20526: - Summary: Load doesn't work in PCAModel Key: SPARK-20526 URL: https://issues.apache.org/jira/browse/SPARK-20526 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989226#comment-15989226 ] Sean Owen commented on SPARK-20516: --- {{spark-warehouse}} is a valid URI; it has no scheme, but it will

[jira] [Commented] (SPARK-20525) ClassCast exception when interpreting UDFs from a String in spark-shell

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989222#comment-15989222 ] Sean Owen commented on SPARK-20525: --- It's not really clear what you're reporting, but I don't expect

[jira] [Resolved] (SPARK-20524) Data does not inserting in table

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20524. --- Resolution: Not A Problem > Data does not inserting in table > > >

[jira] [Resolved] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

2017-04-28 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-20496. - Resolution: Fixed Fix Version/s: 2.2.0 2.1.2 Resolved with

[jira] [Assigned] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

2017-04-28 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-20496: --- Assignee: Bill Chambers > KafkaWriter Uses Unanalyzed Logical Plan >

[jira] [Assigned] (SPARK-20477) Document R bisecting k-means in R programming guide

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20477: Assignee: (was: Apache Spark) > Document R bisecting k-means in R programming guide >

[jira] [Assigned] (SPARK-20477) Document R bisecting k-means in R programming guide

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20477: Assignee: Apache Spark > Document R bisecting k-means in R programming guide >

[jira] [Commented] (SPARK-20477) Document R bisecting k-means in R programming guide

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989161#comment-15989161 ] Apache Spark commented on SPARK-20477: -- User 'wangmiao1981' has created a pull request for this

[jira] [Created] (SPARK-20525) ClassCast exception when interpreting UDFs from a String in spark-shell

2017-04-28 Thread Dave Knoester (JIRA)
Dave Knoester created SPARK-20525: - Summary: ClassCast exception when interpreting UDFs from a String in spark-shell Key: SPARK-20525 URL: https://issues.apache.org/jira/browse/SPARK-20525 Project:

[jira] [Comment Edited] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988989#comment-15988989 ] Ratandeep Ratti edited comment on SPARK-20516 at 4/28/17 3:31 PM: -- Yes,

[jira] [Comment Edited] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988690#comment-15988690 ] Ratandeep Ratti edited comment on SPARK-20516 at 4/28/17 3:27 PM: -- I'm

[jira] [Comment Edited] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988989#comment-15988989 ] Ratandeep Ratti edited comment on SPARK-20516 at 4/28/17 3:26 PM: -- Yes,

[jira] [Commented] (SPARK-20524) Data does not inserting in table

2017-04-28 Thread Gennadiy Ilyashenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988995#comment-15988995 ] Gennadiy Ilyashenko commented on SPARK-20524: - Ok, thank you. You can close it. > Data does

[jira] [Commented] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988989#comment-15988989 ] Ratandeep Ratti commented on SPARK-20516: - Yes, see this scala example:

[jira] [Commented] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

2017-04-28 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988953#comment-15988953 ] Bill Chambers commented on SPARK-20496: --- This should probably be backported too. > KafkaWriter

[jira] [Updated] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

2017-04-28 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-20496: -- Affects Version/s: 2.1.0 > KafkaWriter Uses Unanalyzed Logical Plan >

[jira] [Commented] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988950#comment-15988950 ] Apache Spark commented on SPARK-20496: -- User 'anabranch' has created a pull request for this issue:

[jira] [Commented] (SPARK-20392) Slow performance when calling fit on ML pipeline for dataset with many columns but few rows

2017-04-28 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988892#comment-15988892 ] Liang-Chi Hsieh commented on SPARK-20392: - Yeah, I have the same concern that the time still

[jira] [Commented] (SPARK-20524) Data does not inserting in table

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988847#comment-15988847 ] Sean Owen commented on SPARK-20524: --- There's not enough info here to even establish that it's a Spark

[jira] [Assigned] (SPARK-20523) Clean up build warnings for 2.2.0 release

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20523: Assignee: (was: Apache Spark) > Clean up build warnings for 2.2.0 release >

[jira] [Assigned] (SPARK-20523) Clean up build warnings for 2.2.0 release

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20523: Assignee: Apache Spark > Clean up build warnings for 2.2.0 release >

[jira] [Commented] (SPARK-20523) Clean up build warnings for 2.2.0 release

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988821#comment-15988821 ] Apache Spark commented on SPARK-20523: -- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-20524) Data does not inserting in table

2017-04-28 Thread Gennadiy Ilyashenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gennadiy Ilyashenko updated SPARK-20524: Summary: Data does not inserting in table (was: Data not inserted in table) >

[jira] [Updated] (SPARK-20524) Data not inserted in table

2017-04-28 Thread Gennadiy Ilyashenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gennadiy Ilyashenko updated SPARK-20524: Description: Hello. I run Spark-Hadoop in cluster mode (1 master, 2 slaves). I try

[jira] [Created] (SPARK-20524) Data not inserted in table

2017-04-28 Thread Gennadiy Ilyashenko (JIRA)
Gennadiy Ilyashenko created SPARK-20524: --- Summary: Data not inserted in table Key: SPARK-20524 URL: https://issues.apache.org/jira/browse/SPARK-20524 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-20523) Clean up build warnings for 2.2.0 release

2017-04-28 Thread Sean Owen (JIRA)
Sean Owen created SPARK-20523: - Summary: Clean up build warnings for 2.2.0 release Key: SPARK-20523 URL: https://issues.apache.org/jira/browse/SPARK-20523 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988718#comment-15988718 ] Sean Owen commented on SPARK-20516: --- That's right, you need to specify master one way or the other but

[jira] [Updated] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti updated SPARK-20516: Attachment: spark-20516.zip Attaching complete code which can be run in an IDE > Spark

[jira] [Comment Edited] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988690#comment-15988690 ] Ratandeep Ratti edited comment on SPARK-20516 at 4/28/17 12:04 PM: --- I'm

[jira] [Commented] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988690#comment-15988690 ] Ratandeep Ratti commented on SPARK-20516: - Hmm. I needed to specify the master as "local" when

[jira] [Commented] (SPARK-20522) hostname -f does not work with coreutils

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988582#comment-15988582 ] Sean Owen commented on SPARK-20522: --- Sounds OK to me, feel free to adjust instance of hostname -f

[jira] [Commented] (SPARK-20522) hostname -f does not work with coreutils

2017-04-28 Thread Dominic Monroe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988575#comment-15988575 ] Dominic Monroe commented on SPARK-20522: Void Linux doesn't work with it out of the box, as it

[jira] [Commented] (SPARK-20522) hostname -f does not work with coreutils

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988556#comment-15988556 ] Sean Owen commented on SPARK-20522: --- Which version of Linux doesn't it work on -- anything reasonable

[jira] [Created] (SPARK-20522) hostname -f does not work with coreutils

2017-04-28 Thread Dominic Monroe (JIRA)
Dominic Monroe created SPARK-20522: -- Summary: hostname -f does not work with coreutils Key: SPARK-20522 URL: https://issues.apache.org/jira/browse/SPARK-20522 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20495) Add StorageLevel to cacheTable API

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988451#comment-15988451 ] Apache Spark commented on SPARK-20495: -- User 'phatak-dev' has created a pull request for this issue:

[jira] [Commented] (SPARK-19688) Spark on Yarn Credentials File set to different application directory

2017-04-28 Thread Jiasheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988421#comment-15988421 ] Jiasheng Wang commented on SPARK-19688: --- [~jerryshao] I did not test this in Spark 2.1+, but I

[jira] [Comment Edited] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-28 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988400#comment-15988400 ] Rick Moritz edited comment on SPARK-20489 at 4/28/17 8:18 AM: -- The timezone

[jira] [Assigned] (SPARK-20459) JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20459: Assignee: Apache Spark > JdbcUtils throws IllegalStateException: Cause already

[jira] [Comment Edited] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-28 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988400#comment-15988400 ] Rick Moritz edited comment on SPARK-20489 at 4/28/17 8:17 AM: -- The timezone

[jira] [Assigned] (SPARK-20459) JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20459: Assignee: (was: Apache Spark) > JdbcUtils throws IllegalStateException: Cause already

[jira] [Commented] (SPARK-20459) JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988402#comment-15988402 ] Apache Spark commented on SPARK-20459: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-28 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988400#comment-15988400 ] Rick Moritz commented on SPARK-20489: - The timezone thing would make sense, if there were

[jira] [Updated] (SPARK-20521) The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md.

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20521: -- Priority: Trivial (was: Minor) Issue Type: Improvement (was: Bug) > The default of

[jira] [Assigned] (SPARK-20465) Throws a proper exception rather than ArrayIndexOutOfBoundsException when temp directories could not be got/created

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20465: - Assignee: Hyukjin Kwon > Throws a proper exception rather than ArrayIndexOutOfBoundsException

[jira] [Updated] (SPARK-20516) Spark SQL documentation out of date?

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20516: -- Priority: Minor (was: Major) I don't think that's true. master has always been something you

[jira] [Resolved] (SPARK-20465) Throws a proper exception rather than ArrayIndexOutOfBoundsException when temp directories could not be got/created

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20465. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17768

[jira] [Updated] (SPARK-20519) When the input parameter is null, may be a runtime exception occurs

2017-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20519: -- Priority: Trivial (was: Minor) > When the input parameter is null, may be a runtime exception occurs

[jira] [Comment Edited] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-28 Thread Frank Rosner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988350#comment-15988350 ] Frank Rosner edited comment on SPARK-20489 at 4/28/17 7:25 AM: --- In

[jira] [Commented] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-28 Thread Frank Rosner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988350#comment-15988350 ] Frank Rosner commented on SPARK-20489: -- In

[jira] [Comment Edited] (SPARK-20489) Different results in local mode and yarn mode when working with dates (race condition with SimpleDateFormat?)

2017-04-28 Thread Frank Rosner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988350#comment-15988350 ] Frank Rosner edited comment on SPARK-20489 at 4/28/17 7:24 AM: --- In

[jira] [Updated] (SPARK-20521) The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md.

2017-04-28 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20521: --- Component/s: (was: Web UI) (was: Spark Core)

[jira] [Assigned] (SPARK-20495) Add StorageLevel to cacheTable API

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20495: Assignee: (was: Apache Spark) > Add StorageLevel to cacheTable API >

[jira] [Assigned] (SPARK-20495) Add StorageLevel to cacheTable API

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20495: Assignee: Apache Spark > Add StorageLevel to cacheTable API >

[jira] [Commented] (SPARK-20495) Add StorageLevel to cacheTable API

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988346#comment-15988346 ] Apache Spark commented on SPARK-20495: -- User 'phatak-dev' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20521) The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md.

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20521: Assignee: Apache Spark > The default of 'spark.worker.cleanup.appDataTtl' should be

[jira] [Assigned] (SPARK-20521) The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md.

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20521: Assignee: (was: Apache Spark) > The default of 'spark.worker.cleanup.appDataTtl'

[jira] [Commented] (SPARK-20521) The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md.

2017-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988342#comment-15988342 ] Apache Spark commented on SPARK-20521: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Updated] (SPARK-20521) The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md.

2017-04-28 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20521: --- Description: Currently, our project needs to be set to clean up the worker directory cleanup

[jira] [Created] (SPARK-20521) The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md.

2017-04-28 Thread guoxiaolongzte (JIRA)
guoxiaolongzte created SPARK-20521: -- Summary: The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md. Key: SPARK-20521 URL: https://issues.apache.org/jira/browse/SPARK-20521

[jira] [Resolved] (SPARK-14471) The alias created in SELECT could be used in GROUP BY and followed expressions

2017-04-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-14471. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20476. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > Exception between