[jira] [Created] (SPARK-15863) Update SQL programming guide for Spark 2.0

Cheng Lian created SPARK-15863: -- Summary: Update SQL programming guide for Spark 2.0 Key: SPARK-15863 URL: https://issues.apache.org/jira/browse/SPARK-15863 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-15696) Improve `crosstab` to have a consistent column order

[ https://issues.apache.org/jira/browse/SPARK-15696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15696. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 > Improve

[jira] [Resolved] (SPARK-15791) NPE in ScalarSubquery

[ https://issues.apache.org/jira/browse/SPARK-15791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15791. - Resolution: Fixed Fix Version/s: 2.0.0 > NPE in ScalarSubquery > - >

[jira] [Closed] (SPARK-15842) Add support for socket stream.

[ https://issues.apache.org/jira/browse/SPARK-15842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma closed SPARK-15842. --- Resolution: Not A Problem > Add support for socket stream. > --

[jira] [Commented] (SPARK-15842) Add support for socket stream.

[ https://issues.apache.org/jira/browse/SPARK-15842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323837#comment-15323837 ] Prashant Sharma commented on SPARK-15842: - Thank you for making it clear. Actual question I had

[jira] [Closed] (SPARK-15838) CACHE TABLE AS SELECT should not replace the existing Temp Table

[ https://issues.apache.org/jira/browse/SPARK-15838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-15838. --- Resolution: Won't Fix > CACHE TABLE AS SELECT should not replace the existing Temp Table >

[jira] [Commented] (SPARK-15862) Better Error Message When Having Database Name in CACHE TABLE AS SELECT

[ https://issues.apache.org/jira/browse/SPARK-15862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323828#comment-15323828 ] Apache Spark commented on SPARK-15862: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15862) Better Error Message When Having Database Name in CACHE TABLE AS SELECT

[ https://issues.apache.org/jira/browse/SPARK-15862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15862: Assignee: Apache Spark > Better Error Message When Having Database Name in CACHE TABLE AS

[jira] [Assigned] (SPARK-15862) Better Error Message When Having Database Name in CACHE TABLE AS SELECT

[ https://issues.apache.org/jira/browse/SPARK-15862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15862: Assignee: (was: Apache Spark) > Better Error Message When Having Database Name in

[jira] [Created] (SPARK-15862) Better Error Message When Having Database Name in CACHE TABLE AS SELECT

Xiao Li created SPARK-15862: --- Summary: Better Error Message When Having Database Name in CACHE TABLE AS SELECT Key: SPARK-15862 URL: https://issues.apache.org/jira/browse/SPARK-15862 Project: Spark

[jira] [Updated] (SPARK-15838) CACHE TABLE AS SELECT should not replace the existing Temp Table

[ https://issues.apache.org/jira/browse/SPARK-15838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15838: Description: -Currently, {{CACHE TABLE AS SELECT}} replaces the existing Temp Table, if existed. This

[jira] [Updated] (SPARK-15838) CACHE TABLE AS SELECT should not replace the existing Temp Table

[ https://issues.apache.org/jira/browse/SPARK-15838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15838: Description: Currently, {{CACHE TABLE AS SELECT}} replaces the existing Temp Table, if existed. This

[jira] [Updated] (SPARK-15861) pyspark mapPartitions with none generator functions / functors

[ https://issues.apache.org/jira/browse/SPARK-15861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Bowyer updated SPARK-15861: Description: Hi all, it appears that the method `rdd.mapPartitions` does odd things if it is fed

[jira] [Created] (SPARK-15861) pyspark mapPartitions with none generator functions / functors

Greg Bowyer created SPARK-15861: --- Summary: pyspark mapPartitions with none generator functions / functors Key: SPARK-15861 URL: https://issues.apache.org/jira/browse/SPARK-15861 Project: Spark

[jira] [Commented] (SPARK-15858) "evaluateEachIteration" will fail on trying to run it on a model with 500+ trees

[ https://issues.apache.org/jira/browse/SPARK-15858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323797#comment-15323797 ] Apache Spark commented on SPARK-15858: -- User 'mhmoudr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15825) sort-merge-join gives invalid results when joining on a tupled key

[ https://issues.apache.org/jira/browse/SPARK-15825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15825: Assignee: Apache Spark > sort-merge-join gives invalid results when joining on a tupled

[jira] [Assigned] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15822: Assignee: Apache Spark > segmentation violation in o.a.s.unsafe.types.UTF8String with >

[jira] [Assigned] (SPARK-15825) sort-merge-join gives invalid results when joining on a tupled key

[ https://issues.apache.org/jira/browse/SPARK-15825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15825: Assignee: (was: Apache Spark) > sort-merge-join gives invalid results when joining on

[jira] [Commented] (SPARK-15825) sort-merge-join gives invalid results when joining on a tupled key

[ https://issues.apache.org/jira/browse/SPARK-15825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323783#comment-15323783 ] Apache Spark commented on SPARK-15825: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15822: Assignee: (was: Apache Spark) > segmentation violation in

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323781#comment-15323781 ] Apache Spark commented on SPARK-15822: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15858) "evaluateEachIteration" will fail on trying to run it on a model with 500+ trees

[ https://issues.apache.org/jira/browse/SPARK-15858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15858: Assignee: Apache Spark > "evaluateEachIteration" will fail on trying to run it on a model

[jira] [Assigned] (SPARK-15858) "evaluateEachIteration" will fail on trying to run it on a model with 500+ trees

[ https://issues.apache.org/jira/browse/SPARK-15858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15858: Assignee: (was: Apache Spark) > "evaluateEachIteration" will fail on trying to run it

[jira] [Commented] (SPARK-15858) "evaluateEachIteration" will fail on trying to run it on a model with 500+ trees

[ https://issues.apache.org/jira/browse/SPARK-15858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323777#comment-15323777 ] Apache Spark commented on SPARK-15858: -- User 'mhmoudr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15860) Metrics for codegen size and perf

[ https://issues.apache.org/jira/browse/SPARK-15860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15860: Assignee: Apache Spark > Metrics for codegen size and perf >

[jira] [Assigned] (SPARK-15860) Metrics for codegen size and perf

[ https://issues.apache.org/jira/browse/SPARK-15860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15860: Assignee: (was: Apache Spark) > Metrics for codegen size and perf >

[jira] [Commented] (SPARK-15860) Metrics for codegen size and perf

[ https://issues.apache.org/jira/browse/SPARK-15860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323761#comment-15323761 ] Apache Spark commented on SPARK-15860: -- User 'ericl' has created a pull request for this issue:

[jira] [Created] (SPARK-15860) Metrics for codegen size and perf

Eric Liang created SPARK-15860: -- Summary: Metrics for codegen size and perf Key: SPARK-15860 URL: https://issues.apache.org/jira/browse/SPARK-15860 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-15850) Remove function grouping in SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-15850. --- Resolution: Resolved > Remove function grouping in SparkSession >

[jira] [Resolved] (SPARK-15853) HDFSMetadataLog.get leaks the input stream

[ https://issues.apache.org/jira/browse/SPARK-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-15853. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13583

[jira] [Commented] (SPARK-15856) Revert API breaking changes made in DataFrameReader.text and SQLContext.range

[ https://issues.apache.org/jira/browse/SPARK-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323715#comment-15323715 ] Reynold Xin commented on SPARK-15856: - cc [~koert] > Revert API breaking changes made in

[jira] [Commented] (SPARK-15851) Spark 2.0 does not compile in Windows 7

[ https://issues.apache.org/jira/browse/SPARK-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323709#comment-15323709 ] Marcelo Vanzin commented on SPARK-15851: It should be simple to fix it to work with whatever that

[jira] [Commented] (SPARK-15851) Spark 2.0 does not compile in Windows 7

[ https://issues.apache.org/jira/browse/SPARK-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323704#comment-15323704 ] Alexander Ulanov commented on SPARK-15851: -- Sorry for confusion, I mean the shell that is

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323702#comment-15323702 ] Joseph K. Bradley commented on SPARK-15581: --- Synced some in person around the summit, and

[jira] [Assigned] (SPARK-15859) Optimize the Partition Pruning with Disjunction

[ https://issues.apache.org/jira/browse/SPARK-15859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15859: Assignee: Apache Spark > Optimize the Partition Pruning with Disjunction >

[jira] [Commented] (SPARK-15859) Optimize the Partition Pruning with Disjunction

[ https://issues.apache.org/jira/browse/SPARK-15859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323683#comment-15323683 ] Apache Spark commented on SPARK-15859: -- User 'chenghao-intel' has created a pull request for this

[jira] [Assigned] (SPARK-15859) Optimize the Partition Pruning with Disjunction

[ https://issues.apache.org/jira/browse/SPARK-15859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15859: Assignee: (was: Apache Spark) > Optimize the Partition Pruning with Disjunction >

[jira] [Resolved] (SPARK-15794) Should truncate toString() of very wide schemas

[ https://issues.apache.org/jira/browse/SPARK-15794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-15794. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13537

[jira] [Created] (SPARK-15859) Optimize the Partition Pruning with Disjunction

Cheng Hao created SPARK-15859: - Summary: Optimize the Partition Pruning with Disjunction Key: SPARK-15859 URL: https://issues.apache.org/jira/browse/SPARK-15859 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15855) dataframe.R example fails with "java.io.IOException: No input paths specified in job"

[ https://issues.apache.org/jira/browse/SPARK-15855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323667#comment-15323667 ] Shivaram Venkataraman commented on SPARK-15855: --- For the example to work in a distributed

[jira] [Commented] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323666#comment-15323666 ] Apache Spark commented on SPARK-15509: -- User 'keypointt' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15509: Assignee: Apache Spark > R MLlib algorithms should support input columns "features" and

[jira] [Assigned] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15509: Assignee: (was: Apache Spark) > R MLlib algorithms should support input columns

[jira] [Commented] (SPARK-15858) "evaluateEachIteration" will fail on trying to run it on a model with 500+ trees

[ https://issues.apache.org/jira/browse/SPARK-15858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323662#comment-15323662 ] Mahmoud Rawas commented on SPARK-15858: --- I am working on a solution. > "evaluateEachIteration"

[jira] [Resolved] (SPARK-15841) [SPARK REPL] REPLSuite has incorrect env set for a couple of tests.

[ https://issues.apache.org/jira/browse/SPARK-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-15841. -- Resolution: Fixed Assignee: Prashant Sharma Fix Version/s: 2.0.0 > [SPARK

[jira] [Created] (SPARK-15858) "evaluateEachIteration" will fail on trying to run it on a model with 500+ trees

Mahmoud Rawas created SPARK-15858: - Summary: "evaluateEachIteration" will fail on trying to run it on a model with 500+ trees Key: SPARK-15858 URL: https://issues.apache.org/jira/browse/SPARK-15858

[jira] [Updated] (SPARK-15856) Revert API breaking changes made in DataFrameReader.text and SQLContext.range

[ https://issues.apache.org/jira/browse/SPARK-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-15856: --- Description: In Spark 2.0, after unifying Datasets and DataFrames, we made two API breaking

[jira] [Commented] (SPARK-15857) Add Caller Context in Spark

[ https://issues.apache.org/jira/browse/SPARK-15857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323655#comment-15323655 ] Weiqing Yang commented on SPARK-15857: -- I will attach the design doc soon. > Add Caller Context in

[jira] [Updated] (SPARK-15856) Revert API breaking changes made in DataFrameReader.text and SQLContext.range

[ https://issues.apache.org/jira/browse/SPARK-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-15856: --- Description: In Spark 2.0, after unifying Datasets and DataFrames, we made two API breaking

[jira] [Created] (SPARK-15857) Add Caller Context in Spark

Weiqing Yang created SPARK-15857: Summary: Add Caller Context in Spark Key: SPARK-15857 URL: https://issues.apache.org/jira/browse/SPARK-15857 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-12447) Only update AM's internal state when executor is successfully launched by NM

[ https://issues.apache.org/jira/browse/SPARK-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12447. Resolution: Fixed Assignee: Saisai Shao (was: Apache Spark) Fix Version/s:

[jira] [Created] (SPARK-15856) Revert API breaking changes made in DataFrameReader.text and SQLContext.range

Cheng Lian created SPARK-15856: -- Summary: Revert API breaking changes made in DataFrameReader.text and SQLContext.range Key: SPARK-15856 URL: https://issues.apache.org/jira/browse/SPARK-15856 Project:

[jira] [Updated] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-15822: -- Priority: Blocker (was: Critical) > segmentation violation in

[jira] [Updated] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-15822: -- Description: Executors fail with segmentation violation while running application with

[jira] [Commented] (SPARK-15851) Spark 2.0 does not compile in Windows 7

[ https://issues.apache.org/jira/browse/SPARK-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323644#comment-15323644 ] Marcelo Vanzin commented on SPARK-15851: bq. "spark-build-info" can be rewritten as a shell

[jira] [Created] (SPARK-15855) dataframe.R example fails with "java.io.IOException: No input paths specified in job"

Yesha Vora created SPARK-15855: -- Summary: dataframe.R example fails with "java.io.IOException: No input paths specified in job" Key: SPARK-15855 URL: https://issues.apache.org/jira/browse/SPARK-15855

[jira] [Commented] (SPARK-15851) Spark 2.0 does not compile in Windows 7

[ https://issues.apache.org/jira/browse/SPARK-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323638#comment-15323638 ] Alexander Ulanov commented on SPARK-15851: -- I can do that. However, it seems that

[jira] [Created] (SPARK-15854) Spark History server gets null pointer exception

Yesha Vora created SPARK-15854: -- Summary: Spark History server gets null pointer exception Key: SPARK-15854 URL: https://issues.apache.org/jira/browse/SPARK-15854 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15851) Spark 2.0 does not compile in Windows 7

[ https://issues.apache.org/jira/browse/SPARK-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323629#comment-15323629 ] Marcelo Vanzin commented on SPARK-15851: Adding "bash" explicitly in the pom should be fine. Need

[jira] [Assigned] (SPARK-15853) HDFSMetadataLog.get leaks the input stream

[ https://issues.apache.org/jira/browse/SPARK-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15853: Assignee: Shixiong Zhu (was: Apache Spark) > HDFSMetadataLog.get leaks the input stream

[jira] [Commented] (SPARK-15851) Spark 2.0 does not compile in Windows 7

[ https://issues.apache.org/jira/browse/SPARK-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323624#comment-15323624 ] Alexander Ulanov commented on SPARK-15851: -- This does not work because Ant uses Java Process to

[jira] [Assigned] (SPARK-15853) HDFSMetadataLog.get leaks the input stream

[ https://issues.apache.org/jira/browse/SPARK-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15853: Assignee: Apache Spark (was: Shixiong Zhu) > HDFSMetadataLog.get leaks the input stream

[jira] [Updated] (SPARK-15830) Spark application should get hive tokens only when it is required

[ https://issues.apache.org/jira/browse/SPARK-15830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated SPARK-15830: --- Affects Version/s: 1.6.1 > Spark application should get hive tokens only when it is required >

[jira] [Created] (SPARK-15853) HDFSMetadataLog.get leaks the input stream

Shixiong Zhu created SPARK-15853: Summary: HDFSMetadataLog.get leaks the input stream Key: SPARK-15853 URL: https://issues.apache.org/jira/browse/SPARK-15853 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15851) Spark 2.0 does not compile in Windows 7

[ https://issues.apache.org/jira/browse/SPARK-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323620#comment-15323620 ] Marcelo Vanzin commented on SPARK-15851: [~tgraves] (and [~Dhruve Ashar]) hah we were talking

[jira] [Updated] (SPARK-15794) Should truncate toString() of very wide schemas

[ https://issues.apache.org/jira/browse/SPARK-15794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15794: Assignee: Eric Liang > Should truncate toString() of very wide schemas >

[jira] [Updated] (SPARK-15764) Replace n^2 loop in BindReferences

[ https://issues.apache.org/jira/browse/SPARK-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15764: Description: BindReferences contains a n^2 loop which causes performance issues when operating

[jira] [Updated] (SPARK-15794) Should truncate toString() of very wide schemas

[ https://issues.apache.org/jira/browse/SPARK-15794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15794: Target Version/s: 2.0.0 > Should truncate toString() of very wide schemas >

[jira] [Updated] (SPARK-15764) Replace n^2 loop in BindReferences

[ https://issues.apache.org/jira/browse/SPARK-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15764: Issue Type: Sub-task (was: Improvement) Parent: SPARK-15852 > Replace n^2 loop in

[jira] [Updated] (SPARK-15742) Reduce collections allocations in Catalyst tree transformation methods

[ https://issues.apache.org/jira/browse/SPARK-15742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15742: Issue Type: Sub-task (was: Improvement) Parent: SPARK-15852 > Reduce collections

[jira] [Updated] (SPARK-15748) Replace inefficient foldLeft() call in PartitionStatistics

[ https://issues.apache.org/jira/browse/SPARK-15748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15748: Issue Type: Sub-task (was: Improvement) Parent: SPARK-15852 > Replace inefficient

[jira] [Updated] (SPARK-15762) Cache Metadata.hashCode and use a singleton for Metadata.empty

[ https://issues.apache.org/jira/browse/SPARK-15762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15762: Issue Type: Sub-task (was: Improvement) Parent: SPARK-15852 > Cache Metadata.hashCode and

[jira] [Updated] (SPARK-15764) Replace n^2 loop in BindReferences

[ https://issues.apache.org/jira/browse/SPARK-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15764: Description: BindReferences contains a n^2 loop which causes performance issues when operating

[jira] [Updated] (SPARK-15794) Should truncate toString() of very wide schemas

[ https://issues.apache.org/jira/browse/SPARK-15794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15794: Issue Type: Sub-task (was: Bug) Parent: SPARK-15852 > Should truncate toString() of very

[jira] [Created] (SPARK-15852) Improve query planning performance for wide nested schema

Reynold Xin created SPARK-15852: --- Summary: Improve query planning performance for wide nested schema Key: SPARK-15852 URL: https://issues.apache.org/jira/browse/SPARK-15852 Project: Spark

[jira] [Resolved] (SPARK-14321) Reduce date format cost in date functions

[ https://issues.apache.org/jira/browse/SPARK-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14321. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > Reduce date

[jira] [Updated] (SPARK-15851) Spark 2.0 does not compile in Windows 7

[ https://issues.apache.org/jira/browse/SPARK-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov updated SPARK-15851: - Fix Version/s: 2.0.0 > Spark 2.0 does not compile in Windows 7 >

[jira] [Updated] (SPARK-15851) Spark 2.0 does not compile in Windows 7

[ https://issues.apache.org/jira/browse/SPARK-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov updated SPARK-15851: - Target Version/s: 2.0.0 Fix Version/s: (was: 2.0.0) > Spark 2.0 does not

[jira] [Created] (SPARK-15851) Spark 2.0 does not compile in Windows 7

Alexander Ulanov created SPARK-15851: Summary: Spark 2.0 does not compile in Windows 7 Key: SPARK-15851 URL: https://issues.apache.org/jira/browse/SPARK-15851 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-15850) Remove function grouping in SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15850: Assignee: Reynold Xin (was: Apache Spark) > Remove function grouping in SparkSession >

[jira] [Commented] (SPARK-15850) Remove function grouping in SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323560#comment-15323560 ] Apache Spark commented on SPARK-15850: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15850) Remove function grouping in SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15850: Assignee: Apache Spark (was: Reynold Xin) > Remove function grouping in SparkSession >

[jira] [Created] (SPARK-15850) Remove function grouping in SparkSession

Reynold Xin created SPARK-15850: --- Summary: Remove function grouping in SparkSession Key: SPARK-15850 URL: https://issues.apache.org/jira/browse/SPARK-15850 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-8426) Add blacklist mechanism for YARN container allocation

[ https://issues.apache.org/jira/browse/SPARK-8426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323522#comment-15323522 ] Kay Ousterhout commented on SPARK-8426: --- Can we merge this with SPARK-8425? This seems to be more

[jira] [Created] (SPARK-15849) FileNotFoundException on _temporary while doing saveAsTable to S3

Sandeep created SPARK-15849: --- Summary: FileNotFoundException on _temporary while doing saveAsTable to S3 Key: SPARK-15849 URL: https://issues.apache.org/jira/browse/SPARK-15849 Project: Spark

[jira] [Commented] (SPARK-13268) SQL Timestamp stored as GMT but toString returns GMT-08:00

[ https://issues.apache.org/jira/browse/SPARK-13268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323442#comment-15323442 ] Bo Meng commented on SPARK-13268: - Why is this related to Spark? The conversion does not use any Spark

[jira] [Commented] (SPARK-15613) Incorrect days to millis conversion

[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323386#comment-15323386 ] Bo Meng commented on SPARK-15613: - Does this only happen to 1.6? I have tried on the latest master and it

[jira] [Comment Edited] (SPARK-15613) Incorrect days to millis conversion

[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323386#comment-15323386 ] Bo Meng edited comment on SPARK-15613 at 6/9/16 9:24 PM: - Does this only happen

[jira] [Commented] (SPARK-14321) Reduce date format cost in date functions

[ https://issues.apache.org/jira/browse/SPARK-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323384#comment-15323384 ] Apache Spark commented on SPARK-14321: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Commented] (SPARK-14485) Task finished cause fetch failure when its executor has already been removed by driver

[ https://issues.apache.org/jira/browse/SPARK-14485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323344#comment-15323344 ] Marcelo Vanzin commented on SPARK-14485: bq. I don't think (a) is especially rare: that's the

[jira] [Issue Comment Deleted] (SPARK-15801) spark-submit --num-executors switch also works without YARN

[ https://issues.apache.org/jira/browse/SPARK-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Taws updated SPARK-15801: -- Comment: was deleted (was: Indeed, should be enough as it is then. ) > spark-submit

[jira] [Commented] (SPARK-15801) spark-submit --num-executors switch also works without YARN

[ https://issues.apache.org/jira/browse/SPARK-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323242#comment-15323242 ] Jonathan Taws commented on SPARK-15801: --- Indeed, should be enough as it is then. > spark-submit

[jira] [Commented] (SPARK-15801) spark-submit --num-executors switch also works without YARN

[ https://issues.apache.org/jira/browse/SPARK-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323239#comment-15323239 ] Jonathan Taws commented on SPARK-15801: --- Indeed, should be enough as it is then. > spark-submit

[jira] [Comment Edited] (SPARK-15781) Misleading deprecated property in standalone cluster configuration documentation

[ https://issues.apache.org/jira/browse/SPARK-15781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323235#comment-15323235 ] Jonathan Taws edited comment on SPARK-15781 at 6/9/16 8:11 PM: --- What are

[jira] [Commented] (SPARK-15781) Misleading deprecated property in standalone cluster configuration documentation

[ https://issues.apache.org/jira/browse/SPARK-15781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323235#comment-15323235 ] Jonathan Taws commented on SPARK-15781: --- What are our nextsteps on this ? CC Andrew or someone who

[jira] [Updated] (SPARK-15811) UDFs do not work in Spark 2.0-preview built with scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-15811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franklyn Dsouza updated SPARK-15811: Shepherd: Davies Liu > UDFs do not work in Spark 2.0-preview built with scala 2.10 >

[jira] [Updated] (SPARK-15848) Spark unable to read partitioned table in avro format and column name in upper case

[ https://issues.apache.org/jira/browse/SPARK-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated SPARK-15848: --- Affects Version/s: 1.6.1 > Spark unable to read partitioned table in avro format and column name in

[jira] [Commented] (SPARK-15848) Spark unable to read partitioned table in avro format and column name in upper case

[ https://issues.apache.org/jira/browse/SPARK-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323195#comment-15323195 ] Zhan Zhang commented on SPARK-15848: cat > file1.csv< file2.csv< val tbl =

[jira] [Created] (SPARK-15848) Spark unable to read partitioned table in avro format and column name in upper case

Zhan Zhang created SPARK-15848: -- Summary: Spark unable to read partitioned table in avro format and column name in upper case Key: SPARK-15848 URL: https://issues.apache.org/jira/browse/SPARK-15848

[jira] [Resolved] (SPARK-15839) Maven doc JAR generation fails when JAVA_7_HOME is set

[ https://issues.apache.org/jira/browse/SPARK-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15839. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13573

  1   2   3   >