[jira] [Updated] (SPARK-5648) suppot alter view/table tableName unset tblproperties(k)

[ https://issues.apache.org/jira/browse/SPARK-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5648: -- Description: make hivecontext support unset tblproperties like : alter view viewName unset

[jira] [Updated] (SPARK-5648) suppot alter ... unset tblproperties(key)

[ https://issues.apache.org/jira/browse/SPARK-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5648: -- Summary: suppot alter ... unset tblproperties(key) (was: suppot alter ... unset tblproperties(k) )

[jira] [Updated] (SPARK-5648) suppot alter view/table tableName unset tblproperties(k)

[ https://issues.apache.org/jira/browse/SPARK-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5648: -- Description: make hivecontext support unset tblproperties like : suppot alter view/table

[jira] [Updated] (SPARK-5648) suppot alter ... unset tblproperties(k)

[ https://issues.apache.org/jira/browse/SPARK-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5648: -- Summary: suppot alter ... unset tblproperties(k) (was: suppot alter view/table tableName unset

[jira] [Updated] (SPARK-5648) support alter ... unset tblproperties(key)

[ https://issues.apache.org/jira/browse/SPARK-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5648: -- Summary: support alter ... unset tblproperties(key) (was: suppot alter ... unset tblproperties(key) )

[jira] [Created] (SPARK-5648) suppot alter view/table tableName unset tblproperties(k)

DoingDone9 created SPARK-5648: - Summary: suppot alter view/table tableName unset tblproperties(k) Key: SPARK-5648 URL: https://issues.apache.org/jira/browse/SPARK-5648 Project: Spark Issue

[jira] [Updated] (SPARK-5648) suppot alter ... unset tblproperties(key)

[ https://issues.apache.org/jira/browse/SPARK-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5648: -- Description: make hivecontext support unset tblproperties(key) like : alter view viewName unset

[jira] [Commented] (SPARK-2789) Apply names to RDD to becoming SchemaRDD

[ https://issues.apache.org/jira/browse/SPARK-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308825#comment-14308825 ] Apache Spark commented on SPARK-2789: - User 'dwmclary' has created a pull request for

[jira] [Commented] (SPARK-5648) support alter ... unset tblproperties(key)

[ https://issues.apache.org/jira/browse/SPARK-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308835#comment-14308835 ] Apache Spark commented on SPARK-5648: - User 'DoingDone9' has created a pull request

[jira] [Commented] (SPARK-5598) Model import/export for ALS

[ https://issues.apache.org/jira/browse/SPARK-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308836#comment-14308836 ] Apache Spark commented on SPARK-5598: - User 'mengxr' has created a pull request for

[jira] [Created] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

Andrew Rowson created SPARK-5655: Summary: YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode Key: SPARK-5655 URL:

[jira] [Closed] (SPARK-5593) Replace BlockManager listener with Executor listener in ExecutorAllocationListener

[ https://issues.apache.org/jira/browse/SPARK-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5593. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Lianhui Wang Target Version/s:

[jira] [Updated] (SPARK-5653) in ApplicationMaster rename isDriver to isClusterMode

[ https://issues.apache.org/jira/browse/SPARK-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5653: - Affects Version/s: 1.2.0 in ApplicationMaster rename isDriver to isClusterMode

[jira] [Updated] (SPARK-5470) use defaultClassLoader of Serializer to load classes of classesToRegister in KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-5470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5470: -- Fix Version/s: 1.3.0 use defaultClassLoader of Serializer to load classes of classesToRegister in

[jira] [Updated] (SPARK-5593) Replace BlockManager listener with Executor listener in ExecutorAllocationListener

[ https://issues.apache.org/jira/browse/SPARK-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5593: - Affects Version/s: 1.2.0 Replace BlockManager listener with Executor listener in

[jira] [Updated] (SPARK-5653) in ApplicationMaster rename isDriver to isClusterMode

[ https://issues.apache.org/jira/browse/SPARK-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5653: - Affects Version/s: (was: 1.2.0) 1.0.0 in ApplicationMaster rename isDriver to

[jira] [Closed] (SPARK-5653) in ApplicationMaster rename isDriver to isClusterMode

[ https://issues.apache.org/jira/browse/SPARK-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5653. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Lianhui Wang Target Version/s:

[jira] [Closed] (SPARK-5396) Syntax error in spark scripts on windows.

[ https://issues.apache.org/jira/browse/SPARK-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5396. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Masayoshi TSUZUKI Target

[jira] [Commented] (SPARK-5656) NegativeArraySizeException in EigenValueDecomposition.symmetricEigs for large n and/or large k

[ https://issues.apache.org/jira/browse/SPARK-5656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309684#comment-14309684 ] Apache Spark commented on SPARK-5656: - User 'mbittmann' has created a pull request for

[jira] [Updated] (SPARK-540) Add API to customize in-memory representation of RDDs

[ https://issues.apache.org/jira/browse/SPARK-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-540: --- Component/s: Spark Core Add API to customize in-memory representation of RDDs

[jira] [Updated] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4705: - Target Version/s: 1.4.0 Driver retries in yarn-cluster mode always fail if event logging is enabled

[jira] [Resolved] (SPARK-5619) Support 'show roles' in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5619. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4397

[jira] [Created] (SPARK-5657) Add PySpark Avro Output Format example

Stanislav Los created SPARK-5657: Summary: Add PySpark Avro Output Format example Key: SPARK-5657 URL: https://issues.apache.org/jira/browse/SPARK-5657 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-5278) check ambiguous reference to fields in Spark SQL is incompleted

[ https://issues.apache.org/jira/browse/SPARK-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5278. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4068

[jira] [Updated] (SPARK-5416) Initialize Executor.threadPool before ExecutorSource

[ https://issues.apache.org/jira/browse/SPARK-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5416: -- Fix Version/s: 1.3.0 Initialize Executor.threadPool before ExecutorSource

[jira] [Updated] (SPARK-5396) Syntax error in spark scripts on windows.

[ https://issues.apache.org/jira/browse/SPARK-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5396: - Affects Version/s: (was: 1.2.0) 1.3.0 Syntax error in spark scripts on

[jira] [Resolved] (SPARK-5603) Preinsert casting and renaming rule is needed in the Analyzer

[ https://issues.apache.org/jira/browse/SPARK-5603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5603. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4373

[jira] [Created] (SPARK-5656) NegativeArraySizeException in EigenValueDecomposition.symmetricEigs for large n and/or large k

Mark Bittmann created SPARK-5656: Summary: NegativeArraySizeException in EigenValueDecomposition.symmetricEigs for large n and/or large k Key: SPARK-5656 URL: https://issues.apache.org/jira/browse/SPARK-5656

[jira] [Updated] (SPARK-3956) Python API for Distributed Matrix

[ https://issues.apache.org/jira/browse/SPARK-3956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3956: Component/s: PySpark Python API for Distributed Matrix -

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rowson updated SPARK-5655: - Description: When running a Spark job on a YARN cluster which doesn't run containers under the

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rowson updated SPARK-5655: - Description: When running a Spark job on a YARN cluster which doesn't run containers under the

[jira] [Commented] (SPARK-1799) Add init script to the debian packaging

[ https://issues.apache.org/jira/browse/SPARK-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309753#comment-14309753 ] Nicholas Chammas commented on SPARK-1799: - cc [~markhamstra], [~srowen],

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309784#comment-14309784 ] Patrick Wendell commented on SPARK-5388: On DELETE, I'll defer to you guys, have

[jira] [Resolved] (SPARK-5595) In memory data cache should be invalidated after insert into/overwrite

[ https://issues.apache.org/jira/browse/SPARK-5595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5595. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4373

[jira] [Closed] (SPARK-4337) Add ability to cancel pending requests to YARN

[ https://issues.apache.org/jira/browse/SPARK-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4337. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sandy Ryza Target Version/s:

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rowson updated SPARK-5655: - Description: When running a Spark job on a YARN cluster which doesn't run containers under the

[jira] [Updated] (SPARK-5656) NegativeArraySizeException in EigenValueDecomposition.symmetricEigs for large n and/or large k

[ https://issues.apache.org/jira/browse/SPARK-5656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Bittmann updated SPARK-5656: - Description: Large values of n or k in EigenValueDecomposition.symmetricEigs will fail with a

[jira] [Closed] (SPARK-5618) Optimise utility code.

[ https://issues.apache.org/jira/browse/SPARK-5618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5618. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Makoto Fukuhara Target

[jira] [Updated] (SPARK-560) Specialize RDDs / iterators

[ https://issues.apache.org/jira/browse/SPARK-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-560: --- Component/s: Spark Core Specialize RDDs / iterators ---

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309825#comment-14309825 ] Patrick Wendell commented on SPARK-5388: One the boolean and numeric values. I

[jira] [Resolved] (SPARK-5324) Results of describe can't be queried

[ https://issues.apache.org/jira/browse/SPARK-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5324. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4249

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5628: Fix Version/s: 1.2.2 Add option to return spark-ec2 version

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5628: Labels: backport-needed (was: ) Add option to return spark-ec2 version

[jira] [Closed] (SPARK-5636) Lower dynamic allocation add interval

[ https://issues.apache.org/jira/browse/SPARK-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5636. Resolution: Fixed Fix Version/s: 1.3.0 Lower dynamic allocation add interval

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rowson updated SPARK-5655: - Description: When running a Spark job on a YARN cluster which doesn't run containers under the

[jira] [Commented] (SPARK-4877) userClassPathFirst doesn't handle user classes inheriting from parent

[ https://issues.apache.org/jira/browse/SPARK-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309666#comment-14309666 ] Josh Rosen commented on SPARK-4877: --- I've gone ahead and committed this PR because it

[jira] [Closed] (SPARK-2945) Allow specifying num of executors in the context configuration

[ https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2945. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: WangTaoTheTonic Target

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309935#comment-14309935 ] DeepakVohra commented on SPARK-5625: Not clear if the assembly jar is to be extracted.

[jira] [Updated] (SPARK-5593) Replace BlockManager listener with Executor listener in ExecutorAllocationListener

[ https://issues.apache.org/jira/browse/SPARK-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5593: - Component/s: Spark Core Replace BlockManager listener with Executor listener in

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309655#comment-14309655 ] Sean Owen commented on SPARK-5625: -- These are in the assembly. The idea is that it is one

[jira] [Updated] (SPARK-706) Failures in block manager put leads to task hanging

[ https://issues.apache.org/jira/browse/SPARK-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-706: --- Component/s: Block Manager Failures in block manager put leads to task hanging

[jira] [Updated] (SPARK-3600) RDD[Double] doesn't use primitive arrays for caching

[ https://issues.apache.org/jira/browse/SPARK-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3600: Component/s: Spark Core RDD[Double] doesn't use primitive arrays for caching

[jira] [Updated] (SPARK-4024) Remember user preferences for metrics to show in the UI

[ https://issues.apache.org/jira/browse/SPARK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4024: Component/s: Web UI Remember user preferences for metrics to show in the UI

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309782#comment-14309782 ] Matei Zaharia commented on SPARK-5654: -- Yup, there's a tradeoff, but given that this

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5628: -- Assignee: Nicholas Chammas Add option to return spark-ec2 version

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309938#comment-14309938 ] DeepakVohra commented on SPARK-5531: Why two options, Direct Download and Select

[jira] [Updated] (SPARK-5371) SparkSQL Fails to parse Query with UNION ALL in subquery

[ https://issues.apache.org/jira/browse/SPARK-5371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5371: - Component/s: SQL SparkSQL Fails to parse Query with UNION ALL in subquery

[jira] [Updated] (SPARK-4854) Custom UDTF with Lateral View throws ClassNotFound exception in Spark SQL CLI

[ https://issues.apache.org/jira/browse/SPARK-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4854: - Component/s: SQL Custom UDTF with Lateral View throws ClassNotFound exception in Spark SQL CLI

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5427: - Component/s: SQL Add support for floor function in Spark SQL

[jira] [Updated] (SPARK-5314) java.lang.OutOfMemoryError in SparkSQL with GROUP BY

[ https://issues.apache.org/jira/browse/SPARK-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5314: - Component/s: SQL java.lang.OutOfMemoryError in SparkSQL with GROUP BY

[jira] [Updated] (SPARK-5129) make SqlContext support select date +/- XX DAYS from table

[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5129: - Component/s: SQL make SqlContext support select date +/- XX DAYS from table

[jira] [Updated] (SPARK-5001) BlockRDD removed unreasonablly in streaming

[ https://issues.apache.org/jira/browse/SPARK-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5001: - Component/s: Streaming BlockRDD removed unreasonablly in streaming

[jira] [Updated] (SPARK-2802) Improve the Cassandra sample and Add a new sample for Streaming to Cassandra

[ https://issues.apache.org/jira/browse/SPARK-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2802: - Component/s: Streaming Improve the Cassandra sample and Add a new sample for Streaming to Cassandra

[jira] [Updated] (SPARK-5066) Can not get all key that has same hashcode when reading key ordered from different Streaming.

[ https://issues.apache.org/jira/browse/SPARK-5066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5066: - Component/s: Streaming Can not get all key that has same hashcode when reading key ordered from

[jira] [Updated] (SPARK-5615) Fix testPackage in StreamingContextSuite

[ https://issues.apache.org/jira/browse/SPARK-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5615: - Component/s: Streaming Fix testPackage in StreamingContextSuite

[jira] [Updated] (SPARK-4174) Streaming: Optionally provide notifications to Receivers when DStream has been generated

[ https://issues.apache.org/jira/browse/SPARK-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4174: - Component/s: Streaming Streaming: Optionally provide notifications to Receivers when DStream has been

[jira] [Updated] (SPARK-4874) Report number of records read/written in a task

[ https://issues.apache.org/jira/browse/SPARK-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4874: --- Component/s: Web UI Spark Core Report number of records read/written in a

[jira] [Resolved] (SPARK-4874) Report number of records read/written in a task

[ https://issues.apache.org/jira/browse/SPARK-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4874. Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 Report

[jira] [Updated] (SPARK-4541) Add --version to spark-submit

[ https://issues.apache.org/jira/browse/SPARK-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4541: - Component/s: Spark Submit Add --version to spark-submit -

[jira] [Comment Edited] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310130#comment-14310130 ] Sandy Ryza edited comment on SPARK-4550 at 2/6/15 11:13 PM: I

[jira] [Comment Edited] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310130#comment-14310130 ] Sandy Ryza edited comment on SPARK-4550 at 2/6/15 11:13 PM: I

[jira] [Created] (SPARK-5658) Finalize DDL and write support APIs

Yin Huai created SPARK-5658: --- Summary: Finalize DDL and write support APIs Key: SPARK-5658 URL: https://issues.apache.org/jira/browse/SPARK-5658 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5658) Finalize DDL and write support APIs

[ https://issues.apache.org/jira/browse/SPARK-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310194#comment-14310194 ] Apache Spark commented on SPARK-5658: - User 'yhuai' has created a pull request for

[jira] [Updated] (SPARK-4983) Add sleep() before tagging EC2 instances to allow instance metadata to propagate

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4983: -- Assignee: Gen TANG Add sleep() before tagging EC2 instances to allow instance metadata to propagate

[jira] [Updated] (SPARK-4983) Add sleep() before tagging EC2 instances to allow instance metadata to propagate

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4983: -- Summary: Add sleep() before tagging EC2 instances to allow instance metadata to propagate (was: Tag

[jira] [Updated] (SPARK-5369) remove allocatedHostToContainersMap.synchronized in YarnAllocator

[ https://issues.apache.org/jira/browse/SPARK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5369: - Component/s: YARN remove allocatedHostToContainersMap.synchronized in YarnAllocator

[jira] [Updated] (SPARK-4360) task only execute on one node when spark on yarn

[ https://issues.apache.org/jira/browse/SPARK-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4360: - Component/s: YARN task only execute on one node when spark on yarn

[jira] [Updated] (SPARK-2971) Orphaned YARN ApplicationMaster lingers forever

[ https://issues.apache.org/jira/browse/SPARK-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2971: - Component/s: YARN Orphaned YARN ApplicationMaster lingers forever

[jira] [Updated] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

[ https://issues.apache.org/jira/browse/SPARK-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4346: - Component/s: YARN YarnClientSchedulerBack.asyncMonitorApplication should be common with

[jira] [Updated] (SPARK-4941) Yarn cluster mode does not upload all needed jars to driver node (Spark 1.2.0)

[ https://issues.apache.org/jira/browse/SPARK-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4941: - Component/s: YARN Yarn cluster mode does not upload all needed jars to driver node (Spark 1.2.0)

[jira] [Resolved] (SPARK-4492) Exception when following SimpleApp tutorial java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4492. -- Resolution: Not a Problem Exception when following SimpleApp tutorial

[jira] [Updated] (SPARK-5259) Fix endless retry stage by add task equal() and hashcode() to avoid stage.pendingTasks not empty while stage map output is available

[ https://issues.apache.org/jira/browse/SPARK-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5259: - Fix Version/s: (was: 1.2.0) Fix endless retry stage by add task equal() and hashcode() to avoid

[jira] [Commented] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309981#comment-14309981 ] Sean Owen commented on SPARK-4900: -- Do you have any more info, like how to reproduce

[jira] [Resolved] (SPARK-5525) [SPARK][SQL]

[ https://issues.apache.org/jira/browse/SPARK-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5525. -- Resolution: Invalid [SPARK][SQL] Key: SPARK-5525 URL:

[jira] [Updated] (SPARK-2722) Mechanism for escaping spark configs is not consistent

[ https://issues.apache.org/jira/browse/SPARK-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2722: - Component/s: Spark Core Mechanism for escaping spark configs is not consistent

[jira] [Resolved] (SPARK-5601) Make streaming algorithms Java-friendly

[ https://issues.apache.org/jira/browse/SPARK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5601. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4432

[jira] [Resolved] (SPARK-5586) Automatically provide sqlContext in Spark shell

[ https://issues.apache.org/jira/browse/SPARK-5586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5586. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4387

[jira] [Resolved] (SPARK-4983) Tag EC2 instances in the same call that launches them

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4983. --- Resolution: Fixed Fix Version/s: 1.2.2 1.3.0 Issue resolved by pull request

[jira] [Closed] (SPARK-706) Failures in block manager put leads to task hanging

[ https://issues.apache.org/jira/browse/SPARK-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-706. - Resolution: Cannot Reproduce Failures in block manager put leads to task hanging

[jira] [Closed] (SPARK-5600) Sort order of unfinished apps can be wrong in History Server

[ https://issues.apache.org/jira/browse/SPARK-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5600. Resolution: Fixed Assignee: Marcelo Vanzin Target Version/s: 1.3.0 Sort order of

[jira] [Closed] (SPARK-4994) Cleanup removed executors' ShuffleInfo in yarn shuffle service

[ https://issues.apache.org/jira/browse/SPARK-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4994. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Lianhui Wang Target Version/s:

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310147#comment-14310147 ] DeepakVohra commented on SPARK-5531: Thanks for updating the download links. Spark

[jira] [Updated] (SPARK-2996) Standalone and Yarn have different settings for adding the user classpath first

[ https://issues.apache.org/jira/browse/SPARK-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2996: - Priority: Major (was: Minor) Standalone and Yarn have different settings for adding the user classpath

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310161#comment-14310161 ] Sean Owen commented on SPARK-5531: -- What do you mean? nobody changed the site. I'll

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309948#comment-14309948 ] Sean Owen commented on SPARK-5531: -- They don't. Look at the page again. Spark download

[jira] [Updated] (SPARK-3753) Spark hive join results in empty with shared hive context

[ https://issues.apache.org/jira/browse/SPARK-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3753: - Component/s: SQL Spark hive join results in empty with shared hive context

[jira] [Updated] (SPARK-5109) Loading multiple parquet files into a single SchemaRDD

[ https://issues.apache.org/jira/browse/SPARK-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5109: - Component/s: SQL Loading multiple parquet files into a single SchemaRDD

[jira] [Closed] (SPARK-5444) 'spark.blockManager.port' conflict in netty service

[ https://issues.apache.org/jira/browse/SPARK-5444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5444. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: SaintBacchus Target Version/s:

[jira] [Updated] (SPARK-5041) hive-exec jar should be generated with JDK 6

[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5041: - Component/s: SQL hive-exec jar should be generated with JDK 6

[jira] [Updated] (SPARK-4985) Parquet support for date type

[ https://issues.apache.org/jira/browse/SPARK-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4985: - Component/s: SQL Parquet support for date type - Key:

  1   2   3   >