[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-5719: Description: Now web ui binds to 0.0.0.0. When multiple network plane is enabled, we may try to bind ui

[jira] [Updated] (SPARK-1805) Error launching cluster when master and slave machines are of different virtualization types

[ https://issues.apache.org/jira/browse/SPARK-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1805: - Target Version/s: (was: 1.3.0) Assignee: Nicholas Chammas Error launching cluster when

[jira] [Resolved] (SPARK-1805) Error launching cluster when master and slave machines are of different virtualization types

[ https://issues.apache.org/jira/browse/SPARK-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1805. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4455

[jira] [Resolved] (SPARK-4237) Generate right Manifest File for maven building

[ https://issues.apache.org/jira/browse/SPARK-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4237. -- Resolution: Won't Fix Per PR discussion, it sounds like the action here if anything is to omit most or

[jira] [Updated] (SPARK-5720) Support `Create Table Like` in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Sheng updated SPARK-5720: Summary: Support `Create Table Like` in HiveContext (was: Support `Create Table xx Like xx` in

[jira] [Commented] (SPARK-2653) Heap size should be the sum of driver.memory and executor.memory in local mode

[ https://issues.apache.org/jira/browse/SPARK-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314330#comment-14314330 ] liu chang commented on SPARK-2653: -- hi, Davies Liu I have review the spark core codes,

[jira] [Closed] (SPARK-5717) add sc.stop to LDA examples

[ https://issues.apache.org/jira/browse/SPARK-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang closed SPARK-5717. - merged. Thanks add sc.stop to LDA examples --- Key: SPARK-5717

[jira] [Commented] (SPARK-5081) Shuffle write increases

[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315341#comment-14315341 ] Kevin Jung commented on SPARK-5081: --- Xuefeng Wu mentioned about one difference of snappy

[jira] [Resolved] (SPARK-5687) in TaskResultGetter need to catch OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5687. -- Resolution: Won't Fix Resolving WontFix per PR discussion. in TaskResultGetter need to catch

[jira] [Updated] (SPARK-5679) Flaky tests in InputOutputMetricsSuite: input metrics with interleaved reads and input metrics with mixed read method

[ https://issues.apache.org/jira/browse/SPARK-5679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5679: --- Priority: Major (was: Blocker) Flaky tests in InputOutputMetricsSuite: input metrics with

[jira] [Resolved] (SPARK-5709) Add EXPLAIN support for DataFrame API for debugging purpose

[ https://issues.apache.org/jira/browse/SPARK-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5709. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4496

[jira] [Commented] (SPARK-5443) jsonRDD with schema should ignore sub-objects that are omitted in schema

[ https://issues.apache.org/jira/browse/SPARK-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315530#comment-14315530 ] Yin Huai commented on SPARK-5443: - Yeah, I think we can improve performance by only

[jira] [Closed] (SPARK-5729) Potential NPE in StandaloneRestServer if user specifies bad path

[ https://issues.apache.org/jira/browse/SPARK-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5729. Resolution: Fixed Fix Version/s: 1.3.0 Potential NPE in StandaloneRestServer if user specifies bad

[jira] [Commented] (SPARK-5728) MQTTStreamSuite leaves behind ActiveMQ database files

[ https://issues.apache.org/jira/browse/SPARK-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315360#comment-14315360 ] Apache Spark commented on SPARK-5728: - User 'srowen' has created a pull request for

[jira] [Created] (SPARK-5730) Group methods in the generated doc for spark.ml algorithms.

Xiangrui Meng created SPARK-5730: Summary: Group methods in the generated doc for spark.ml algorithms. Key: SPARK-5730 URL: https://issues.apache.org/jira/browse/SPARK-5730 Project: Spark

[jira] [Created] (SPARK-5731) Flaky Test: org.apache.spark.streaming.kafka.DirectKafkaStreamSuite.basic stream receiving with multiple topics and smallest starting offset

Patrick Wendell created SPARK-5731: -- Summary: Flaky Test: org.apache.spark.streaming.kafka.DirectKafkaStreamSuite.basic stream receiving with multiple topics and smallest starting offset Key: SPARK-5731 URL:

[jira] [Updated] (SPARK-5731) Flaky Test: org.apache.spark.streaming.kafka.DirectKafkaStreamSuite.basic stream receiving with multiple topics and smallest starting offset

[ https://issues.apache.org/jira/browse/SPARK-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5731: --- Affects Version/s: 1.3.0 Flaky Test:

[jira] [Updated] (SPARK-5731) Flaky Test: org.apache.spark.streaming.kafka.DirectKafkaStreamSuite.basic stream receiving with multiple topics and smallest starting offset

[ https://issues.apache.org/jira/browse/SPARK-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5731: --- Component/s: Tests Flaky Test: org.apache.spark.streaming.kafka.DirectKafkaStreamSuite.basic

[jira] [Updated] (SPARK-4879) Missing output partitions after job completes with speculative execution

[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4879: - Fix Version/s: 1.3.0 Missing output partitions after job completes with speculative execution

[jira] [Updated] (SPARK-5155) Python API for MQTT streaming

[ https://issues.apache.org/jira/browse/SPARK-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-5155: - Assignee: Prabeesh K Python API for MQTT streaming -

[jira] [Commented] (SPARK-5729) Potential NPE in StandaloneRestServer if user specifies bad path

[ https://issues.apache.org/jira/browse/SPARK-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315428#comment-14315428 ] Apache Spark commented on SPARK-5729: - User 'andrewor14' has created a pull request

[jira] [Created] (SPARK-5729) Potential NPE in StandaloneRestServer if user specifies bad path

Andrew Or created SPARK-5729: Summary: Potential NPE in StandaloneRestServer if user specifies bad path Key: SPARK-5729 URL: https://issues.apache.org/jira/browse/SPARK-5729 Project: Spark

[jira] [Resolved] (SPARK-5683) Improve the json serialization for DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5683. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4468

[jira] [Commented] (SPARK-1302) httpd doesn't start in spark-ec2 (cc2.8xlarge)

[ https://issues.apache.org/jira/browse/SPARK-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315447#comment-14315447 ] Greg Temchenko commented on SPARK-1302: --- I'm getting this httpd error on t2.medium

[jira] [Commented] (SPARK-5454) [SQL] Self join with ArrayType columns problems

[ https://issues.apache.org/jira/browse/SPARK-5454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315515#comment-14315515 ] Apache Spark commented on SPARK-5454: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-5706) Support inference schema from a single json string

[ https://issues.apache.org/jira/browse/SPARK-5706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315524#comment-14315524 ] Yin Huai commented on SPARK-5706: - Is https://issues.apache.org/jira/browse/SPARK-4336

[jira] [Commented] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315545#comment-14315545 ] Kashish Jain commented on SPARK-5613: - Thanks Patrick and Andrew

[jira] [Updated] (SPARK-4879) Missing output partitions after job completes with speculative execution

[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4879: - Labels: backport-needed (was: ) Missing output partitions after job completes with speculative

[jira] [Updated] (SPARK-5493) Support proxy users under kerberos

[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5493: --- Assignee: Marcelo Vanzin Support proxy users under kerberos

[jira] [Resolved] (SPARK-5493) Support proxy users under kerberos

[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5493. Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 Support

[jira] [Created] (SPARK-5728) MQTTStreamSuite leaves behind ActiveMQ database files

Sean Owen created SPARK-5728: Summary: MQTTStreamSuite leaves behind ActiveMQ database files Key: SPARK-5728 URL: https://issues.apache.org/jira/browse/SPARK-5728 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-5658) Finalize DDL and write support APIs

[ https://issues.apache.org/jira/browse/SPARK-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5658. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4446

[jira] [Resolved] (SPARK-5576) saveAsTable into Hive fails due to duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-5576. - Resolution: Won't Fix I am resolving it per discussions in the PR

[jira] [Resolved] (SPARK-5704) createDataFrame replace applySchema/inferSchema

[ https://issues.apache.org/jira/browse/SPARK-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5704. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4498

[jira] [Commented] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314424#comment-14314424 ] Apache Spark commented on SPARK-5655: - User 'growse' has created a pull request for

[jira] [Commented] (SPARK-5720) `Create Table Like` in HiveContext need support `like registered temporary table`

[ https://issues.apache.org/jira/browse/SPARK-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314446#comment-14314446 ] Li Sheng commented on SPARK-5720: - We need support user registered temp table as source

[jira] [Commented] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314451#comment-14314451 ] Apache Spark commented on SPARK-5655: - User 'growse' has created a pull request for

[jira] [Updated] (SPARK-5717) add sc.stop to LDA examples

[ https://issues.apache.org/jira/browse/SPARK-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5717: - Fix Version/s: 1.3.0 add sc.stop to LDA examples --- Key:

[jira] [Updated] (SPARK-5720) `Create Table Like` in HiveContext need support `like registered temporary table`

[ https://issues.apache.org/jira/browse/SPARK-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Sheng updated SPARK-5720: Issue Type: Improvement (was: New Feature) `Create Table Like` in HiveContext need support `like

[jira] [Updated] (SPARK-5720) `Create Table Like` in HiveContext need support `like registered temporary table`

[ https://issues.apache.org/jira/browse/SPARK-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Sheng updated SPARK-5720: Summary: `Create Table Like` in HiveContext need support `like registered temporary table` (was: Support

[jira] [Commented] (SPARK-2653) Heap size should be the sum of driver.memory and executor.memory in local mode

[ https://issues.apache.org/jira/browse/SPARK-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314441#comment-14314441 ] Davies Liu commented on SPARK-2653: --- [~andrewor14] Could you help to answer the question

[jira] [Resolved] (SPARK-5717) add sc.stop to LDA examples

[ https://issues.apache.org/jira/browse/SPARK-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5717. -- Resolution: Fixed Assignee: yuhao yang Target Version/s: 1.3.0 Resolved by

[jira] [Updated] (SPARK-5239) JdbcRDD throws java.lang.AbstractMethodError: oracle.jdbc.driver.xxxxxx.isClosed()Z

[ https://issues.apache.org/jira/browse/SPARK-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5239: - Assignee: Gankun Luo JdbcRDD throws java.lang.AbstractMethodError:

[jira] [Created] (SPARK-5712) Semicolon at end of a comment line

Adrian Wang created SPARK-5712: -- Summary: Semicolon at end of a comment line Key: SPARK-5712 URL: https://issues.apache.org/jira/browse/SPARK-5712 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-5239) JdbcRDD throws java.lang.AbstractMethodError: oracle.jdbc.driver.xxxxxx.isClosed()Z

[ https://issues.apache.org/jira/browse/SPARK-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5239. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4470

[jira] [Commented] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313789#comment-14313789 ] Apache Spark commented on SPARK-5700: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313788#comment-14313788 ] Cheng Lian commented on SPARK-5671: --- Thanks, Josh. PR submitted. Bump jets3t version

[jira] [Issue Comment Deleted] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5671: -- Comment: was deleted (was: Thanks, Josh. PR submitted.) Bump jets3t version from 0.9.0 to 0.9.2 in

[jira] [Commented] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313790#comment-14313790 ] Cheng Lian commented on SPARK-5671: --- Thanks, Josh. PR submitted. Bump jets3t version

[jira] [Commented] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313793#comment-14313793 ] Cheng Lian commented on SPARK-5700: --- Thanks, Josh. PR submitted. Bump jets3t version

[jira] [Issue Comment Deleted] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5700: -- Comment: was deleted (was: Thanks, Josh. PR submitted.) Bump jets3t version from 0.9.2 to 0.9.3 in

[jira] [Commented] (SPARK-5712) Semicolon at end of a comment line

[ https://issues.apache.org/jira/browse/SPARK-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313807#comment-14313807 ] Apache Spark commented on SPARK-5712: - User 'adrian-wang' has created a pull request

[jira] [Updated] (SPARK-5712) Semicolon at end of a comment line

[ https://issues.apache.org/jira/browse/SPARK-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang updated SPARK-5712: --- Description: HIVE-3348 Semicolon at end of a comment line --

[jira] [Commented] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313794#comment-14313794 ] Cheng Lian commented on SPARK-5700: --- Thanks, Josh. PR submitted. Bump jets3t version

[jira] [Commented] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313863#comment-14313863 ] Sean Owen commented on SPARK-4900: -- Yeah, that fixes the error at least. I imagine the

[jira] [Resolved] (SPARK-5558) pySpark zip function unexpected errors

[ https://issues.apache.org/jira/browse/SPARK-5558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5558. -- Resolution: Fixed Fix Version/s: 1.3.0 Could be related to how

[jira] [Commented] (SPARK-4208) stack over flow error while using sqlContext.sql

[ https://issues.apache.org/jira/browse/SPARK-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313871#comment-14313871 ] seekerak commented on SPARK-4208: - me too my env:

[jira] [Created] (SPARK-5714) Refactor initial step of LDA to remove redundant operations

Liang-Chi Hsieh created SPARK-5714: -- Summary: Refactor initial step of LDA to remove redundant operations Key: SPARK-5714 URL: https://issues.apache.org/jira/browse/SPARK-5714 Project: Spark

[jira] [Comment Edited] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313947#comment-14313947 ] Matt Cheah edited comment on SPARK-4906 at 2/10/15 10:15 AM: -

[jira] [Created] (SPARK-5716) Support TOK_CHARSETLITERAL in HiveQl

Adrian Wang created SPARK-5716: -- Summary: Support TOK_CHARSETLITERAL in HiveQl Key: SPARK-5716 URL: https://issues.apache.org/jira/browse/SPARK-5716 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-5716) Support TOK_CHARSETLITERAL in HiveQl

[ https://issues.apache.org/jira/browse/SPARK-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang updated SPARK-5716: --- Description: where value = _UTF8 0x12345678 Environment: (was: _UTF8 0x12345678) Support

[jira] [Created] (SPARK-5717) add sc.stop to LDA examples

yuhao yang created SPARK-5717: - Summary: add sc.stop to LDA examples Key: SPARK-5717 URL: https://issues.apache.org/jira/browse/SPARK-5717 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5566) Tokenizer for mllib package

[ https://issues.apache.org/jira/browse/SPARK-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313996#comment-14313996 ] Augustin Borsu commented on SPARK-5566: --- We could use a tokenizer like this, but we

[jira] [Commented] (SPARK-5676) License missing from spark-ec2 repo

[ https://issues.apache.org/jira/browse/SPARK-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313995#comment-14313995 ] Adam B commented on SPARK-5676: --- I agree that spark-ec2 has less to do with Mesos than even

[jira] [Resolved] (SPARK-5705) Explore GPU-accelerated Linear Algebra Libraries

[ https://issues.apache.org/jira/browse/SPARK-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5705. -- Resolution: Duplicate This already had a discussion going; let's merge the two. Explore

[jira] [Commented] (SPARK-4360) task only execute on one node when spark on yarn

[ https://issues.apache.org/jira/browse/SPARK-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313898#comment-14313898 ] seekerak commented on SPARK-4360: - i have resolved this issue by configure yarn scheduler

[jira] [Created] (SPARK-5713) Support python serialization for RandomForest

Guillaume Charhon created SPARK-5713: Summary: Support python serialization for RandomForest Key: SPARK-5713 URL: https://issues.apache.org/jira/browse/SPARK-5713 Project: Spark Issue

[jira] [Commented] (SPARK-5714) Refactor initial step of LDA to remove redundant operations

[ https://issues.apache.org/jira/browse/SPARK-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313917#comment-14313917 ] Apache Spark commented on SPARK-5714: - User 'viirya' has created a pull request for

[jira] [Closed] (SPARK-5667) Remove version from spark-ec2 example.

[ https://issues.apache.org/jira/browse/SPARK-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel Peralvo closed SPARK-5667. - Remove version from spark-ec2 example. --

[jira] [Created] (SPARK-5715) Shuffle size increase, performance loss from Spark 1.1.0 to Spark 1.2.0 (and 1.2.1)

Dr. Christian Betz created SPARK-5715: - Summary: Shuffle size increase, performance loss from Spark 1.1.0 to Spark 1.2.0 (and 1.2.1) Key: SPARK-5715 URL: https://issues.apache.org/jira/browse/SPARK-5715

[jira] [Commented] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313947#comment-14313947 ] Matt Cheah commented on SPARK-4906: --- Spark has logic for failing a stage if there are

[jira] [Commented] (SPARK-5716) Support TOK_CHARSETLITERAL in HiveQl

[ https://issues.apache.org/jira/browse/SPARK-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313955#comment-14313955 ] Apache Spark commented on SPARK-5716: - User 'adrian-wang' has created a pull request

[jira] [Resolved] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5700. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4499

[jira] [Commented] (SPARK-5717) add sc.stop to LDA examples

[ https://issues.apache.org/jira/browse/SPARK-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313968#comment-14313968 ] Apache Spark commented on SPARK-5717: - User 'hhbyyh' has created a pull request for

[jira] [Comment Edited] (SPARK-4360) task only execute on one node when spark on yarn

[ https://issues.apache.org/jira/browse/SPARK-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313898#comment-14313898 ] seekerak edited comment on SPARK-4360 at 2/10/15 9:37 AM: -- i have

[jira] [Commented] (SPARK-2653) Heap size should be the sum of driver.memory and executor.memory in local mode

[ https://issues.apache.org/jira/browse/SPARK-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313940#comment-14313940 ] liu chang commented on SPARK-2653: -- I would like to fix it. I will patch a PR soon.

[jira] [Resolved] (SPARK-5715) Shuffle size increase, performance loss from Spark 1.1.0 to Spark 1.2.0 (and 1.2.1)

[ https://issues.apache.org/jira/browse/SPARK-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5715. -- Resolution: Duplicate Can you move your comment to the existing JIRA, SPARK-5081? Shuffle size

[jira] [Created] (SPARK-5719) allow UIs to bind to specified host

Tao Wang created SPARK-5719: --- Summary: allow UIs to bind to specified host Key: SPARK-5719 URL: https://issues.apache.org/jira/browse/SPARK-5719 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-5719: Summary: allow daemons to bind to specified host (was: allow UIs to bind to specified host) allow

[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-5719: Description: Now web ui binds to 0.0.0.0. When multiple network plane is enabled, we may try to bind ui

[jira] [Commented] (SPARK-5719) allow daemons to bind to specified host

[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314192#comment-14314192 ] Apache Spark commented on SPARK-5719: - User 'WangTaoTheTonic' has created a pull

[jira] [Commented] (SPARK-3889) JVM dies with SIGBUS, resulting in ConnectionManager failed ACK

[ https://issues.apache.org/jira/browse/SPARK-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314651#comment-14314651 ] Aaron Davidson commented on SPARK-3889: --- The only place we memory map in 1.1 is this

[jira] [Commented] (SPARK-3889) JVM dies with SIGBUS, resulting in ConnectionManager failed ACK

[ https://issues.apache.org/jira/browse/SPARK-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314650#comment-14314650 ] Aaron Davidson commented on SPARK-3889: --- The only place we memory map in 1.1 is this

[jira] [Resolved] (SPARK-5716) Support TOK_CHARSETLITERAL in HiveQl

[ https://issues.apache.org/jira/browse/SPARK-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5716. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4502

[jira] [Created] (SPARK-5721) Propagate missing external shuffle service errors to client

Kostas Sakellis created SPARK-5721: -- Summary: Propagate missing external shuffle service errors to client Key: SPARK-5721 URL: https://issues.apache.org/jira/browse/SPARK-5721 Project: Spark

[jira] [Updated] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4105: -- Affects Version/s: 1.2.1 1.3.0 FAILED_TO_UNCOMPRESS(5) errors when fetching

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5655: - Target Version/s: 1.3.0, 1.2.2 Affects Version/s: (was: 1.2.0) 1.2.1

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5655: - Priority: Critical (was: Blocker) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop

[jira] [Created] (SPARK-5720) Support `Create Table xx Like xx` in HiveContext

Li Sheng created SPARK-5720: --- Summary: Support `Create Table xx Like xx` in HiveContext Key: SPARK-5720 URL: https://issues.apache.org/jira/browse/SPARK-5720 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-3754) Spark Streaming fileSystem API is not callable from Java

[ https://issues.apache.org/jira/browse/SPARK-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314899#comment-14314899 ] Tathagata Das commented on SPARK-3754: -- Yes, it is. This has already been fixed.

[jira] [Closed] (SPARK-3754) Spark Streaming fileSystem API is not callable from Java

[ https://issues.apache.org/jira/browse/SPARK-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-3754. Resolution: Duplicate Spark Streaming fileSystem API is not callable from Java

[jira] [Updated] (SPARK-5722) Infer_schema_type incorrect for Integers in pyspark

[ https://issues.apache.org/jira/browse/SPARK-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Don Drake updated SPARK-5722: - Description: The Integers datatype in Python does not match what a Scala/Java integer is defined as.

[jira] [Resolved] (SPARK-5686) Support `show current roles`

[ https://issues.apache.org/jira/browse/SPARK-5686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5686. - Resolution: Fixed Issue resolved by pull request 4471

[jira] [Closed] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5613. Resolution: Fixed YarnClientSchedulerBackend fails to get application report when yarn restarts

[jira] [Updated] (SPARK-5722) Infer_schema_type incorrect for Integers in pyspark

[ https://issues.apache.org/jira/browse/SPARK-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Don Drake updated SPARK-5722: - Summary: Infer_schema_type incorrect for Integers in pyspark (was: Infer_schma_type incorrect for

[jira] [Commented] (SPARK-4964) Exactly-once + WAL-free Kafka Support in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314903#comment-14314903 ] Apache Spark commented on SPARK-4964: - User 'koeninger' has created a pull request for

[jira] [Created] (SPARK-5723) Change the default file format to Parquet for CTAS statements.

Yin Huai created SPARK-5723: --- Summary: Change the default file format to Parquet for CTAS statements. Key: SPARK-5723 URL: https://issues.apache.org/jira/browse/SPARK-5723 Project: Spark Issue

[jira] [Commented] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314922#comment-14314922 ] Andrew Or commented on SPARK-5613: -- Thanks Patrick. I just verified that it was merged

[jira] [Closed] (SPARK-4136) Under dynamic allocation, cancel outstanding executor requests when no longer needed

[ https://issues.apache.org/jira/browse/SPARK-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4136. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sandy Ryza Under dynamic allocation,

[jira] [Updated] (SPARK-4879) Missing output partitions after job completes with speculative execution

[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4879: - Target Version/s: 1.0.3, 1.3.0, 1.1.2, 1.2.2 (was: 1.0.3, 1.3.0, 1.1.2, 1.2.1) Missing output

  1   2   >