[jira] [Commented] (SPARK-4916) [SQL][DOCS]Update SQL programming guide about cache section

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255538#comment-14255538 ] Apache Spark commented on SPARK-4916: - User 'luogankun' has created a pull request for

[jira] [Created] (SPARK-4917) Add a function to convert into a graph with canonical edges in GraphOps

2014-12-22 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4917: --- Summary: Add a function to convert into a graph with canonical edges in GraphOps Key: SPARK-4917 URL: https://issues.apache.org/jira/browse/SPARK-4917 Project:

[jira] [Commented] (SPARK-4917) Add a function to convert into a graph with canonical edges in GraphOps

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255543#comment-14255543 ] Apache Spark commented on SPARK-4917: - User 'maropu' has created a pull request for

[jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution

2014-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255606#comment-14255606 ] Sean Owen commented on SPARK-2075: -- [~sunrui] Yes, but I am still not clear that anyone

[jira] [Created] (SPARK-4918) Reuse Text in saveAsTextFile

2014-12-22 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-4918: --- Summary: Reuse Text in saveAsTextFile Key: SPARK-4918 URL: https://issues.apache.org/jira/browse/SPARK-4918 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-4918) Reuse Text in saveAsTextFile

2014-12-22 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-4918: Component/s: Spark Core Reuse Text in saveAsTextFile

[jira] [Commented] (SPARK-4918) Reuse Text in saveAsTextFile

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255697#comment-14255697 ] Apache Spark commented on SPARK-4918: - User 'zsxwing' has created a pull request for

[jira] [Created] (SPARK-4919) Can Spark SQL thrift server UI provide JOB kill operate or any REST API?

2014-12-22 Thread Xiaoyu Wang (JIRA)
Xiaoyu Wang created SPARK-4919: -- Summary: Can Spark SQL thrift server UI provide JOB kill operate or any REST API? Key: SPARK-4919 URL: https://issues.apache.org/jira/browse/SPARK-4919 Project: Spark

[jira] [Commented] (SPARK-4919) Can Spark SQL thrift server UI provide JOB kill operate or any REST API?

2014-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255707#comment-14255707 ] Sean Owen commented on SPARK-4919: -- (Could you ask questions at u...@apache.org instead?

[jira] [Updated] (SPARK-4919) Can Spark SQL thrift server UI provide JOB kill operate or any REST API?

2014-12-22 Thread Xiaoyu Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Wang updated SPARK-4919: --- Description: Can Spark SQL thrift server UI provide “JOB” kill operate or any REST API? Stages is

[jira] [Commented] (SPARK-2808) update kafka to version 0.8.2

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255717#comment-14255717 ] Apache Spark commented on SPARK-2808: - User 'helena' has created a pull request for

[jira] [Updated] (SPARK-3376) Memory-based shuffle strategy to reduce overhead of disk I/O

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-3376: Description: I think a memory-based shuffle can reduce some overhead of disk I/O. I just want to know is

[jira] [Updated] (SPARK-3376) Memory-based shuffle strategy to reduce overhead of disk I/O

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-3376: Description: I think a memory-based shuffle can reduce some overhead of disk I/O. I just want to know is

[jira] [Updated] (SPARK-3376) Memory-based shuffle strategy to reduce overhead of disk I/O

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-3376: Description: I think a memory-based shuffle can reduce some overhead of disk I/O. I just want to know is

[jira] [Updated] (SPARK-3376) Memory-based shuffle strategy to reduce overhead of disk I/O

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-3376: Description: I think a memory-based shuffle can reduce some overhead of disk I/O. I just want to know is

[jira] [Updated] (SPARK-3376) Memory-based shuffle strategy to reduce overhead of disk I/O

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-3376: Description: I think a memory-based shuffle can reduce some overhead of disk I/O. I just want to know is

[jira] [Commented] (SPARK-2541) Standalone mode can't access secure HDFS anymore

2014-12-22 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255772#comment-14255772 ] Thomas Graves commented on SPARK-2541: -- Sorry don't follow your question, are you

[jira] [Updated] (SPARK-3376) Memory-based shuffle strategy to reduce overhead of disk I/O

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-3376: Description: I think a memory-based shuffle can reduce some overhead of disk I/O. I just want to know is

[jira] [Created] (SPARK-4920) current spark version In UI is not striking

2014-12-22 Thread uncleGen (JIRA)
uncleGen created SPARK-4920: --- Summary: current spark version In UI is not striking Key: SPARK-4920 URL: https://issues.apache.org/jira/browse/SPARK-4920 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-4920: Summary: current spark version in UI is not striking (was: current spark version In UI is not striking)

[jira] [Updated] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-4920: Description: !https://raw.githubusercontent.com/uncleGen/Tech-Notes/master/spark_version.jpg! current

[jira] [Updated] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-4920: Description: It is not convenient to see the Spark version. We can keep the same style with Spark website.

[jira] [Updated] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-4920: Description: we can keep the same style with Spark website

[jira] [Commented] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255850#comment-14255850 ] Apache Spark commented on SPARK-4920: - User 'uncleGen' has created a pull request for

[jira] [Commented] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255855#comment-14255855 ] Sean Owen commented on SPARK-4920: -- I slight prefer the current UI, where the version is

[jira] [Commented] (SPARK-4907) Inconsistent loss and gradient in LeastSquaresGradient compared with R

2014-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255954#comment-14255954 ] Sean Owen commented on SPARK-4907: -- PS I think you will want to update the docs too, for

[jira] [Created] (SPARK-4921) Performance issue caused by TaskSetManager returning PROCESS_LOCAL for NO_PREF tasks

2014-12-22 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created SPARK-4921: -- Summary: Performance issue caused by TaskSetManager returning PROCESS_LOCAL for NO_PREF tasks Key: SPARK-4921 URL: https://issues.apache.org/jira/browse/SPARK-4921

[jira] [Commented] (SPARK-4921) Performance issue caused by TaskSetManager returning PROCESS_LOCAL for NO_PREF tasks

2014-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256015#comment-14256015 ] Xuefu Zhang commented on SPARK-4921: cc: [~lirui], [~sandyr] Performance issue

[jira] [Resolved] (SPARK-4919) Can Spark SQL thrift server UI provide JOB kill operate or any REST API?

2014-12-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4919. --- Resolution: Invalid Can Spark SQL thrift server UI provide JOB kill operate or any REST API?

[jira] [Updated] (SPARK-4921) Performance issue caused by TaskSetManager returning PROCESS_LOCAL for NO_PREF tasks

2014-12-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated SPARK-4921: --- Attachment: NO_PREF.patch Performance issue caused by TaskSetManager returning PROCESS_LOCAL for

[jira] [Updated] (SPARK-4751) Support dynamic allocation for standalone mode

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4751: - Priority: Critical (was: Blocker) Support dynamic allocation for standalone mode

[jira] [Created] (SPARK-4922) Support dynamic allocation for coarse-grained Mesos

2014-12-22 Thread Andrew Or (JIRA)
Andrew Or created SPARK-4922: Summary: Support dynamic allocation for coarse-grained Mesos Key: SPARK-4922 URL: https://issues.apache.org/jira/browse/SPARK-4922 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3174) Provide elastic scaling within a Spark application

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256045#comment-14256045 ] Andrew Or commented on SPARK-3174: -- Hey [~nemccarthy] I filed one at SPARK-4922, which is

[jira] [Updated] (SPARK-4918) Reuse Text in saveAsTextFile

2014-12-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4918: --- Description: When code reviewing https://github.com/apache/spark/pull/3740, [~rxin] pointed out that

[jira] [Updated] (SPARK-4918) Reuse Text in saveAsTextFile

2014-12-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4918: --- Assignee: Shixiong Zhu Reuse Text in saveAsTextFile

[jira] [Resolved] (SPARK-4918) Reuse Text in saveAsTextFile

2014-12-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4918. Resolution: Fixed Fix Version/s: 1.3.0 Reuse Text in saveAsTextFile

[jira] [Updated] (SPARK-4915) Wrong classname of external shuffle service in the doc for dynamic allocation

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4915: - Affects Version/s: 1.2.0 Wrong classname of external shuffle service in the doc for dynamic allocation

[jira] [Closed] (SPARK-4915) Wrong classname of external shuffle service in the doc for dynamic allocation

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4915. Resolution: Fixed Fix Version/s: 1.3.0 1.2.0 Assignee:

[jira] [Updated] (SPARK-4915) Wrong classname of external shuffle service in the doc for dynamic allocation

2014-12-22 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-4915: -- Fix Version/s: (was: 1.2.0) 1.2.1 Wrong classname of external shuffle service

[jira] [Updated] (SPARK-4881) Use SparkConf#getBoolean instead of get().toBoolean

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4881: - Priority: Trivial (was: Minor) Use SparkConf#getBoolean instead of get().toBoolean

[jira] [Commented] (SPARK-4915) Wrong classname of external shuffle service in the doc for dynamic allocation

2014-12-22 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256084#comment-14256084 ] Andrew Ash commented on SPARK-4915: --- Changing fix version to 1.2.1 from 1.2.0 because

[jira] [Updated] (SPARK-4870) Add version information to driver log

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4870: - Priority: Minor (was: Major) Add version information to driver log

[jira] [Closed] (SPARK-4870) Add version information to driver log

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4870. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Zhang, Liye Target Version/s:

[jira] [Closed] (SPARK-4883) Add a name to the directoryCleaner thread

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4883. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Assignee:

[jira] [Updated] (SPARK-4883) Add a name to the directoryCleaner thread

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4883: - Affects Version/s: 1.2.0 Add a name to the directoryCleaner thread

[jira] [Updated] (SPARK-4520) SparkSQL exception when reading certain columns from a parquet file

2014-12-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4520: Assignee: sadhan sood SparkSQL exception when reading certain columns from a parquet file

[jira] [Updated] (SPARK-4733) Add missing prameter comments in ShuffleDependency

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4733: - Affects Version/s: 1.2.0 Add missing prameter comments in ShuffleDependency

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

2014-12-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256140#comment-14256140 ] Michael Armbrust commented on SPARK-2973: - I think the confusion there would be if

[jira] [Closed] (SPARK-4733) Add missing prameter comments in ShuffleDependency

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4733. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Takeshi Yamamuro Target

[jira] [Closed] (SPARK-4447) Remove layers of abstraction in YARN code no longer needed after dropping yarn-alpha

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4447. Resolution: Fixed Fix Version/s: 1.3.0 Remove layers of abstraction in YARN code no longer needed

[jira] [Updated] (SPARK-4447) Remove layers of abstraction in YARN code no longer needed after dropping yarn-alpha

2014-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4447: - Priority: Critical (was: Major) Remove layers of abstraction in YARN code no longer needed after

[jira] [Commented] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2014-12-22 Thread David Ross (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256174#comment-14256174 ] David Ross commented on SPARK-4908: --- Note that noticed this line from native Hive

[jira] [Comment Edited] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2014-12-22 Thread David Ross (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256174#comment-14256174 ] David Ross edited comment on SPARK-4908 at 12/22/14 8:43 PM: -

[jira] [Resolved] (SPARK-4079) Snappy bundled with Spark does not work on older Linux distributions

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4079. Resolution: Fixed Fix Version/s: 1.3.0 Snappy bundled with Spark does not work on

[jira] [Resolved] (SPARK-4864) Add documentation to Netty-based configs

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4864. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Add documentation

[jira] [Updated] (SPARK-4520) SparkSQL exception when reading certain columns from a parquet file

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4520: --- Target Version/s: 1.2.1 (was: 1.3.0) SparkSQL exception when reading certain columns from a

[jira] [Commented] (SPARK-1714) Take advantage of AMRMClient APIs to simplify logic in YarnAllocationHandler

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256216#comment-14256216 ] Apache Spark commented on SPARK-1714: - User 'sryza' has created a pull request for

[jira] [Updated] (SPARK-1714) Take advantage of AMRMClient APIs to simplify logic in YarnAllocationHandler

2014-12-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-1714: -- Target Version/s: 1.3.0 Affects Version/s: 1.2.0 Fix Version/s: (was: 1.2.0) Take

[jira] [Commented] (SPARK-3452) Maven build should skip publishing artifacts people shouldn't depend on

2014-12-22 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256228#comment-14256228 ] Peng Cheng commented on SPARK-3452: --- IMHO REPL should be kept being published, one of my

[jira] [Created] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-22 Thread Peng Cheng (JIRA)
Peng Cheng created SPARK-4923: - Summary: Maven build should keep publishing spark-repl Key: SPARK-4923 URL: https://issues.apache.org/jira/browse/SPARK-4923 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-4818) Join operation should use iterator/lazy evaluation

2014-12-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4818. --- Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 1.1.2 Issue

[jira] [Updated] (SPARK-4818) Join operation should use iterator/lazy evaluation

2014-12-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4818: -- Assignee: Shixiong Zhu Join operation should use iterator/lazy evaluation

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256308#comment-14256308 ] Patrick Wendell commented on SPARK-4923: Hey [~pc...@uowmail.edu.au] - we removed

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-22 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256319#comment-14256319 ] Peng Cheng commented on SPARK-4923: --- Hey Patrick, The following API has been integrated

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-22 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256322#comment-14256322 ] Peng Cheng commented on SPARK-4923: --- Sorry my project is

[jira] [Created] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2014-12-22 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-4924: - Summary: Factor out code to launch Spark applications into a separate library Key: SPARK-4924 URL: https://issues.apache.org/jira/browse/SPARK-4924 Project: Spark

[jira] [Updated] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2014-12-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-4924: -- Attachment: spark-launcher.txt Attaching a mini-spec to describe the motivation and a proposal

[jira] [Commented] (SPARK-2541) Standalone mode can't access secure HDFS anymore

2014-12-22 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256357#comment-14256357 ] Nicholas Chammas commented on SPARK-2541: - I was just wondering if we needed to

[jira] [Created] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

2014-12-22 Thread Alex Liu (JIRA)
Alex Liu created SPARK-4925: --- Summary: Publish Spark SQL hive-thriftserver maven artifact Key: SPARK-4925 URL: https://issues.apache.org/jira/browse/SPARK-4925 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-4907) Inconsistent loss and gradient in LeastSquaresGradient compared with R

2014-12-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4907. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3746

[jira] [Updated] (SPARK-4907) Inconsistent loss and gradient in LeastSquaresGradient compared with R

2014-12-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4907: - Assignee: DB Tsai Inconsistent loss and gradient in LeastSquaresGradient compared with R

[jira] [Updated] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4925: --- Fix Version/s: (was: 1.1.2) (was: 1.2.0) Publish Spark SQL

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256393#comment-14256393 ] Patrick Wendell commented on SPARK-4923: Hey [~pc...@uowmail.edu.au], thanks for

[jira] [Commented] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256397#comment-14256397 ] Patrick Wendell commented on SPARK-4925: The hive-thriftserver module is just used

[jira] [Updated] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4925: --- Component/s: Build Publish Spark SQL hive-thriftserver maven artifact

[jira] [Updated] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4925: --- Affects Version/s: (was: 1.1.1) 1.2.0 Publish Spark SQL

[jira] [Updated] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4923: --- Component/s: Build Maven build should keep publishing spark-repl

[jira] [Commented] (SPARK-3816) Add configureOutputJobPropertiesForStorageHandler to JobConf in SparkHadoopWriter

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256399#comment-14256399 ] Apache Spark commented on SPARK-3816: - User 'alexliu68' has created a pull request for

[jira] [Commented] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

2014-12-22 Thread Alex Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256405#comment-14256405 ] Alex Liu commented on SPARK-4925: - Our build.xml downloads hive-thriftserver maven

[jira] [Updated] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4920: --- Assignee: uncleGen current spark version in UI is not striking

[jira] [Resolved] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4920. Resolution: Fixed Fix Version/s: 1.2.1 I believe this has been fixed:

[jira] [Commented] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256415#comment-14256415 ] Apache Spark commented on SPARK-4925: - User 'alexliu68' has created a pull request for

[jira] [Commented] (SPARK-4921) Performance issue caused by TaskSetManager returning PROCESS_LOCAL for NO_PREF tasks

2014-12-22 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256425#comment-14256425 ] Rui Li commented on SPARK-4921: --- I'm not sure if this is intended, but returning

[jira] [Updated] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-22 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Cheng updated SPARK-4923: -- Attachment: SPARK-4923__Maven_build_should_keep_publishing_spark-repl.patch thank you so much! First

[jira] [Updated] (SPARK-4923) Maven build should keep publishing spark-repl

2014-12-22 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Cheng updated SPARK-4923: -- Target Version/s: 1.3.0, 1.2.1 (was: 1.3.0) Maven build should keep publishing spark-repl

[jira] [Assigned] (SPARK-3860) Improve dimension joins

2014-12-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-3860: --- Assignee: Michael Armbrust Improve dimension joins ---

[jira] [Created] (SPARK-4926) Spark manipulate Hbase

2014-12-22 Thread Lily (JIRA)
Lily created SPARK-4926: --- Summary: Spark manipulate Hbase Key: SPARK-4926 URL: https://issues.apache.org/jira/browse/SPARK-4926 Project: Spark Issue Type: Question Reporter: Lily When I

[jira] [Commented] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

2014-12-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256468#comment-14256468 ] Patrick Wendell commented on SPARK-4906: Hey [~mingyu.z...@gmail.com] - could you

[jira] [Created] (SPARK-4927) Spark does not clean up properly during long jobs.

2014-12-22 Thread Ilya Ganelin (JIRA)
Ilya Ganelin created SPARK-4927: --- Summary: Spark does not clean up properly during long jobs. Key: SPARK-4927 URL: https://issues.apache.org/jira/browse/SPARK-4927 Project: Spark Issue Type:

[jira] [Created] (SPARK-4928) Operation ,,=,= with Decimal report error

2014-12-22 Thread guowei (JIRA)
guowei created SPARK-4928: - Summary: Operation ,,=,= with Decimal report error Key: SPARK-4928 URL: https://issues.apache.org/jira/browse/SPARK-4928 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4928) Operator ,,=,= with decimal between different precision report error

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256509#comment-14256509 ] Apache Spark commented on SPARK-4928: - User 'guowei2' has created a pull request for

[jira] [Commented] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256526#comment-14256526 ] Apache Spark commented on SPARK-4920: - User 'uncleGen' has created a pull request for

[jira] [Commented] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256544#comment-14256544 ] Apache Spark commented on SPARK-4920: - User 'liyezhang556520' has created a pull

[jira] [Commented] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256545#comment-14256545 ] Zhang, Liye commented on SPARK-4920: Seems standalone mode is not with the version. I

[jira] [Comment Edited] (SPARK-4920) current spark version in UI is not striking

2014-12-22 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256545#comment-14256545 ] Zhang, Liye edited comment on SPARK-4920 at 12/23/14 3:25 AM: --

[jira] [Commented] (SPARK-4890) Upgrade Boto to 2.34.0; automatically download Boto from PyPi instead of packaging it

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256581#comment-14256581 ] Apache Spark commented on SPARK-4890: - User 'nchammas' has created a pull request for

[jira] [Created] (SPARK-4929) Yarn Client mode can not support the HA after the exitcode change

2014-12-22 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-4929: --- Summary: Yarn Client mode can not support the HA after the exitcode change Key: SPARK-4929 URL: https://issues.apache.org/jira/browse/SPARK-4929 Project: Spark

[jira] [Commented] (SPARK-4929) Yarn Client mode can not support the HA after the exitcode change

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256585#comment-14256585 ] Apache Spark commented on SPARK-4929: - User 'SaintBacchus' has created a pull request

[jira] [Created] (SPARK-4930) [SQL][DOCS]Update SQL programming guide

2014-12-22 Thread Gankun Luo (JIRA)
Gankun Luo created SPARK-4930: - Summary: [SQL][DOCS]Update SQL programming guide Key: SPARK-4930 URL: https://issues.apache.org/jira/browse/SPARK-4930 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4930) [SQL][DOCS]Update SQL programming guide

2014-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256632#comment-14256632 ] Apache Spark commented on SPARK-4930: - User 'luogankun' has created a pull request for

  1   2   >