[jira] [Updated] (SPARK-2454) Separate driver spark home from executor spark home

[ https://issues.apache.org/jira/browse/SPARK-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2454: --- Assignee: Andrew Or Separate driver spark home from executor spark home

[jira] [Created] (SPARK-2802) Improve the Cassandra sample and Add a new sample for Streaming to Cassandra

Helena Edelson created SPARK-2802: - Summary: Improve the Cassandra sample and Add a new sample for Streaming to Cassandra Key: SPARK-2802 URL: https://issues.apache.org/jira/browse/SPARK-2802

[jira] [Resolved] (SPARK-2675) LiveListenerBus should set higher capacity for its event queue

[ https://issues.apache.org/jira/browse/SPARK-2675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2675. Resolution: Not a Problem LiveListenerBus should set higher capacity for its event queue

[jira] [Resolved] (SPARK-2012) PySpark StatCounter with numpy arrays

[ https://issues.apache.org/jira/browse/SPARK-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2012. --- Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Jeremy Freeman PySpark StatCounter

[jira] [Resolved] (SPARK-2799) Simplify some Scala operations for clarity, performance

[ https://issues.apache.org/jira/browse/SPARK-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2799. -- Resolution: Won't Fix Too much risk of merge conflicts later -- not going to do this in a big-bang

[jira] [Resolved] (SPARK-2478) Add Python APIs for decision tree

[ https://issues.apache.org/jira/browse/SPARK-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2478. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1727

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083699#comment-14083699 ] Patrick Wendell commented on SPARK-1812: [~avati] can you create sub-tasks for the

[jira] [Updated] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1853: - Target Version/s: 1.2.0 (was: 1.1.0) Show Streaming application code context (file, line

[jira] [Updated] (SPARK-2804) Remove scalalogging dependency in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2804: --- Priority: Blocker (was: Major) Remove scalalogging dependency in Spark SQL

[jira] [Resolved] (SPARK-1470) Use the scala-logging wrapper instead of the directly sfl4j api

[ https://issues.apache.org/jira/browse/SPARK-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1470. Resolution: Won't Fix Closed in favor of SPARK-2804 Use the scala-logging wrapper

[jira] [Created] (SPARK-2804) Remove scalalogging dependency in Spark SQL

Patrick Wendell created SPARK-2804: -- Summary: Remove scalalogging dependency in Spark SQL Key: SPARK-2804 URL: https://issues.apache.org/jira/browse/SPARK-2804 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-1842) update scala-logging-slf4j to version 2.1.2

[ https://issues.apache.org/jira/browse/SPARK-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1842. Resolution: Won't Fix Closed in favor of SPARK-2804 update scala-logging-slf4j to

[jira] [Commented] (SPARK-1449) Please delete old releases from mirroring system

[ https://issues.apache.org/jira/browse/SPARK-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083728#comment-14083728 ] Sebb commented on SPARK-1449: - PING - is there anybody there? Please delete old releases

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083749#comment-14083749 ] Anand Avati commented on SPARK-1812: [~pwendell], sure I will create sub-tasks. Was

[jira] [Commented] (SPARK-2783) Basic support for analyze in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083755#comment-14083755 ] Apache Spark commented on SPARK-2783: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-2785) Avoid asserts for unimplemented hive features

[ https://issues.apache.org/jira/browse/SPARK-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083757#comment-14083757 ] Apache Spark commented on SPARK-2785: - User 'marmbrus' has created a pull request for

[jira] [Resolved] (SPARK-2804) Remove scalalogging dependency in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2804. - Resolution: Fixed Resolved here:

[jira] [Commented] (SPARK-2739) Rename registerAsTable to registerTempTable

[ https://issues.apache.org/jira/browse/SPARK-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083770#comment-14083770 ] Apache Spark commented on SPARK-2739: - User 'marmbrus' has created a pull request for

[jira] [Created] (SPARK-2805) update akka to version 2.3

Anand Avati created SPARK-2805: -- Summary: update akka to version 2.3 Key: SPARK-2805 URL: https://issues.apache.org/jira/browse/SPARK-2805 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-1997) Update breeze to version 0.8.1

[ https://issues.apache.org/jira/browse/SPARK-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083784#comment-14083784 ] Anand Avati commented on SPARK-1997: Please re-open this issue as the patch was

[jira] [Created] (SPARK-2806) update json4s-jackson to version 3.2.10

Anand Avati created SPARK-2806: -- Summary: update json4s-jackson to version 3.2.10 Key: SPARK-2806 URL: https://issues.apache.org/jira/browse/SPARK-2806 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-2797) SchemaRDDs don't support unpersist()

[ https://issues.apache.org/jira/browse/SPARK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083788#comment-14083788 ] Yin Huai commented on SPARK-2797: - Oh. I see the problem. In Scala RDD, we are using

[jira] [Created] (SPARK-2807) update kafka to version 2.3

Anand Avati created SPARK-2807: -- Summary: update kafka to version 2.3 Key: SPARK-2807 URL: https://issues.apache.org/jira/browse/SPARK-2807 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-2807) update kafka to version 0.8.1

[ https://issues.apache.org/jira/browse/SPARK-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anand Avati updated SPARK-2807: --- Summary: update kafka to version 0.8.1 (was: update kafka to version 2.3) update kafka to version

[jira] [Created] (SPARK-2810) update scala-maven-plugin to version 3.2.0

Anand Avati created SPARK-2810: -- Summary: update scala-maven-plugin to version 3.2.0 Key: SPARK-2810 URL: https://issues.apache.org/jira/browse/SPARK-2810 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-2784) Make language configurable using SQLConf instead of hql/sql functions

[ https://issues.apache.org/jira/browse/SPARK-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083797#comment-14083797 ] Apache Spark commented on SPARK-2784: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-2797) SchemaRDDs don't support unpersist()

[ https://issues.apache.org/jira/browse/SPARK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083796#comment-14083796 ] Apache Spark commented on SPARK-2797: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-2809) update chill to version 0.4

[ https://issues.apache.org/jira/browse/SPARK-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083798#comment-14083798 ] Sean Owen commented on SPARK-2809: -- Does it make sense to open all these JIRAs? chill

[jira] [Commented] (SPARK-2414) Remove jquery

[ https://issues.apache.org/jira/browse/SPARK-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083805#comment-14083805 ] Apache Spark commented on SPARK-2414: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-2809) update chill to version 0.4

[ https://issues.apache.org/jira/browse/SPARK-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083806#comment-14083806 ] Anand Avati commented on SPARK-2809: [~srowen], spark is currently using twitter chill

[jira] [Created] (SPARK-2812) convert maven to archetype based build

Anand Avati created SPARK-2812: -- Summary: convert maven to archetype based build Key: SPARK-2812 URL: https://issues.apache.org/jira/browse/SPARK-2812 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-1997) Update breeze to version 0.8.1

[ https://issues.apache.org/jira/browse/SPARK-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083810#comment-14083810 ] Xiangrui Meng commented on SPARK-1997: -- I just checked breeze's dependency on

[jira] [Commented] (SPARK-1997) Update breeze to version 0.8.1

[ https://issues.apache.org/jira/browse/SPARK-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083811#comment-14083811 ] Anand Avati commented on SPARK-1997: Ah, you are right, scalalogging was removed, not

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083812#comment-14083812 ] Anand Avati commented on SPARK-1812: [~pwendell] I have created sub-tasks for the

[jira] [Commented] (SPARK-2806) update json4s-jackson to version 3.2.10

[ https://issues.apache.org/jira/browse/SPARK-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083814#comment-14083814 ] Anand Avati commented on SPARK-2806: Posted https://github.com/apache/spark/pull/1702

[jira] [Commented] (SPARK-2810) update scala-maven-plugin to version 3.2.0

[ https://issues.apache.org/jira/browse/SPARK-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083817#comment-14083817 ] Anand Avati commented on SPARK-2810: Posted https://github.com/apache/spark/pull/1711

[jira] [Commented] (SPARK-2805) update akka to version 2.3

[ https://issues.apache.org/jira/browse/SPARK-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083813#comment-14083813 ] Anand Avati commented on SPARK-2805: Posted https://github.com/apache/spark/pull/1685

[jira] [Resolved] (SPARK-2797) SchemaRDDs don't support unpersist()

[ https://issues.apache.org/jira/browse/SPARK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2797. - Resolution: Fixed Fix Version/s: 1.1.0 SchemaRDDs don't support unpersist()

[jira] [Commented] (SPARK-1997) Update breeze to version 0.8.1

[ https://issues.apache.org/jira/browse/SPARK-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083824#comment-14083824 ] Apache Spark commented on SPARK-1997: - User 'avati' has created a pull request for

[jira] [Updated] (SPARK-2481) The environment variables SPARK_HISTORY_OPTS is covered in start-history-server.sh

[ https://issues.apache.org/jira/browse/SPARK-2481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2481: --- Affects Version/s: 1.0.1 1.0.0 The environment variables SPARK_HISTORY_OPTS

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083836#comment-14083836 ] Chris Fregly commented on SPARK-1981: - hey nick- due to the Kinesis Client Library's

[jira] [Created] (SPARK-2813) Implement SQRT() directly in Catalyst

William Benton created SPARK-2813: - Summary: Implement SQRT() directly in Catalyst Key: SPARK-2813 URL: https://issues.apache.org/jira/browse/SPARK-2813 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2813) Implement SQRT() directly in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083862#comment-14083862 ] Apache Spark commented on SPARK-2813: - User 'willb' has created a pull request for

[jira] [Updated] (SPARK-2813) Implement SQRT() directly in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Benton updated SPARK-2813: -- Summary: Implement SQRT() directly in Spark SQL (was: Implement SQRT() directly in Spark SQP)

[jira] [Updated] (SPARK-2813) Implement SQRT() directly in Spark SQP

[ https://issues.apache.org/jira/browse/SPARK-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Benton updated SPARK-2813: -- Summary: Implement SQRT() directly in Spark SQP (was: Implement SQRT() directly in Catalyst)

[jira] [Updated] (SPARK-2602) sbt/sbt test steals window focus on OS X

[ https://issues.apache.org/jira/browse/SPARK-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2602: --- Assignee: Sean Owen sbt/sbt test steals window focus on OS X

[jira] [Resolved] (SPARK-2602) sbt/sbt test steals window focus on OS X

[ https://issues.apache.org/jira/browse/SPARK-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2602. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1747

[jira] [Commented] (SPARK-2414) Remove jquery

[ https://issues.apache.org/jira/browse/SPARK-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083867#comment-14083867 ] Patrick Wendell commented on SPARK-2414: I've merged Sean's PR to address the

[jira] [Resolved] (SPARK-2742) The variable inputFormatInfo and inputFormatMap never used

[ https://issues.apache.org/jira/browse/SPARK-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2742. Resolution: Fixed The variable inputFormatInfo and inputFormatMap never used

[jira] [Resolved] (SPARK-2573) This file make-distribution.sh has an error, please fix it

[ https://issues.apache.org/jira/browse/SPARK-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2573. Resolution: Fixed This file make-distribution.sh has an error, please fix it

[jira] [Resolved] (SPARK-2382) build error:

[ https://issues.apache.org/jira/browse/SPARK-2382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2382. Resolution: Not a Problem Closing as per [~srowen] build error: -

[jira] [Resolved] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2728. Resolution: Not a Problem Closing as per [~srowen] Integer overflow in partition index