[jira] [Commented] (SPARK-6368) Build a specialized serializer for Exchange operator.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524117#comment-14524117 ] Apache Spark commented on SPARK-6368: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-6907) Create an isolated classloader for the Hive Client.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6907: --- Assignee: Apache Spark (was: Michael Armbrust) Create an isolated classloader for the Hive

[jira] [Assigned] (SPARK-7316) Add step capability to RDD sliding window

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7316: --- Assignee: Apache Spark Add step capability to RDD sliding window

[jira] [Assigned] (SPARK-7316) Add step capability to RDD sliding window

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7316: --- Assignee: (was: Apache Spark) Add step capability to RDD sliding window

[jira] [Commented] (SPARK-7316) Add step capability to RDD sliding window

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524309#comment-14524309 ] Apache Spark commented on SPARK-7316: - User 'avulanov' has created a pull request for

[jira] [Updated] (SPARK-7216) Show driver details in Mesos cluster UI

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7216: - Affects Version/s: 1.4.0 Show driver details in Mesos cluster UI

[jira] [Closed] (SPARK-7216) Show driver details in Mesos cluster UI

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7216. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Timothy Chen Target Version/s:

[jira] [Resolved] (SPARK-6229) Support SASL encryption in network/common module

2015-05-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6229. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Marcelo Vanzin Support SASL

[jira] [Resolved] (SPARK-2808) update kafka to version 0.8.2

2015-05-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2808. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Cody Koeninger update kafka

[jira] [Commented] (SPARK-7113) Add the direct stream related information to the streaming listener and web UI

2015-05-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524408#comment-14524408 ] Tathagata Das commented on SPARK-7113: -- [~jerryshao] Since this other sub task is

[jira] [Created] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Mridul Muralidharan (JIRA)
Mridul Muralidharan created SPARK-7317: -- Summary: ShuffleHandle needs to be exposed Key: SPARK-7317 URL: https://issues.apache.org/jira/browse/SPARK-7317 Project: Spark Issue Type:

[jira] [Created] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-01 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7315: Summary: Flaky Test: WriteAheadLogBackedBlockRDDSuite Key: SPARK-7315 URL: https://issues.apache.org/jira/browse/SPARK-7315 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFoundException with Kryo, Guava 14

2015-05-01 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524372#comment-14524372 ] Russell Alexander Spitzer commented on SPARK-6069: -- Running with --conf

[jira] [Resolved] (SPARK-7309) Shutdown the thread pools in ReceivedBlockHandler and DAGScheduler

2015-05-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7309. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shixiong Zhu Shutdown the

[jira] [Updated] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2691: - Assignee: (was: Timothy Chen) Allow Spark on Mesos to be launched with Docker

[jira] [Closed] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2691. Resolution: Fixed Fix Version/s: 1.4.0 Allow Spark on Mesos to be launched with Docker

[jira] [Updated] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2691: - Assignee: Chris Heller Allow Spark on Mesos to be launched with Docker

[jira] [Assigned] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6166: --- Assignee: (was: Apache Spark) Add config to limit number of concurrent outbound

[jira] [Assigned] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6166: --- Assignee: Apache Spark Add config to limit number of concurrent outbound connections for

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524205#comment-14524205 ] Apache Spark commented on SPARK-6166: - User 'mridulm' has created a pull request for

[jira] [Resolved] (SPARK-7112) Add InputInfoTracker to have a generic way to track input data rates for all input streams.

2015-05-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7112. -- Resolution: Fixed Add InputInfoTracker to have a generic way to track input data rates for all

[jira] [Closed] (SPARK-6443) Support HA in standalone cluster mode

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6443. Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: 1.4.0 Support HA in standalone

[jira] [Resolved] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7317. Resolution: Fixed Fix Version/s: 1.4.0 ShuffleHandle needs to be exposed

[jira] [Resolved] (SPARK-3444) Provide a way to easily change the log level in the Spark shell while running

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3444. Resolution: Fixed Fix Version/s: 1.4.0 Provide a way to easily change the log level

[jira] [Closed] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6954. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Sandy Ryza (was: Cheolsoo Park)

[jira] [Updated] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6954: - Target Version/s: 1.3.1, 1.4.0 (was: 1.4.0) ExecutorAllocationManager can end up requesting a negative

[jira] [Updated] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6954: - Labels: backport-needed yarn (was: yarn) ExecutorAllocationManager can end up requesting a negative

[jira] [Reopened] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6954: -- ExecutorAllocationManager can end up requesting a negative number of executors

[jira] [Updated] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6954: - Target Version/s: 1.3.2, 1.4.0 (was: 1.3.1, 1.4.0) ExecutorAllocationManager can end up requesting a

[jira] [Commented] (SPARK-7113) Add the direct stream related information to the streaming listener and web UI

2015-05-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524536#comment-14524536 ] Saisai Shao commented on SPARK-7113: Yes, I will do it. Thanks a lot :). Add the

[jira] [Created] (SPARK-7314) Upgrade Pyrolite with patches

2015-05-01 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7314: Summary: Upgrade Pyrolite with patches Key: SPARK-7314 URL: https://issues.apache.org/jira/browse/SPARK-7314 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7314) Upgrade Pyrolite with patches

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524130#comment-14524130 ] Apache Spark commented on SPARK-7314: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-7314) Upgrade Pyrolite with patches

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7314: --- Assignee: Apache Spark (was: Xiangrui Meng) Upgrade Pyrolite with patches

[jira] [Assigned] (SPARK-7314) Upgrade Pyrolite with patches

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7314: --- Assignee: Xiangrui Meng (was: Apache Spark) Upgrade Pyrolite with patches

[jira] [Resolved] (SPARK-6999) infinite recursion with createDataFrame(JavaRDD[Row], java.util.List[String])

2015-05-01 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-6999. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5804

[jira] [Assigned] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7317: --- Assignee: Apache Spark (was: Mridul Muralidharan) ShuffleHandle needs to be exposed

[jira] [Assigned] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7317: --- Assignee: Mridul Muralidharan (was: Apache Spark) ShuffleHandle needs to be exposed

[jira] [Commented] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524469#comment-14524469 ] Apache Spark commented on SPARK-7317: - User 'mridulm' has created a pull request for

[jira] [Commented] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524252#comment-14524252 ] Apache Spark commented on SPARK-7315: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7315: --- Assignee: Apache Spark (was: Tathagata Das) Flaky Test: WriteAheadLogBackedBlockRDDSuite

[jira] [Assigned] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7315: --- Assignee: Tathagata Das (was: Apache Spark) Flaky Test: WriteAheadLogBackedBlockRDDSuite

[jira] [Assigned] (SPARK-7241) Pearson correlation for DataFrames

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7241: --- Assignee: Apache Spark (was: Burak Yavuz) Pearson correlation for DataFrames

[jira] [Assigned] (SPARK-7241) Pearson correlation for DataFrames

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7241: --- Assignee: Burak Yavuz (was: Apache Spark) Pearson correlation for DataFrames

[jira] [Commented] (SPARK-7241) Pearson correlation for DataFrames

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524489#comment-14524489 ] Apache Spark commented on SPARK-7241: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-7313) Allow for configuring max_samples in range partitioner.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7313: --- Assignee: Apache Spark (was: Mridul Muralidharan) Allow for configuring max_samples in

[jira] [Commented] (SPARK-7313) Allow for configuring max_samples in range partitioner.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524105#comment-14524105 ] Apache Spark commented on SPARK-7313: - User 'mridulm' has created a pull request for

[jira] [Assigned] (SPARK-7313) Allow for configuring max_samples in range partitioner.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7313: --- Assignee: Mridul Muralidharan (was: Apache Spark) Allow for configuring max_samples in

[jira] [Assigned] (SPARK-6907) Create an isolated classloader for the Hive Client.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6907: --- Assignee: Michael Armbrust (was: Apache Spark) Create an isolated classloader for the Hive

[jira] [Commented] (SPARK-6907) Create an isolated classloader for the Hive Client.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524161#comment-14524161 ] Apache Spark commented on SPARK-6907: - User 'marmbrus' has created a pull request for

[jira] [Resolved] (SPARK-7312) SPARK-6913 broke jdk6 build

2015-05-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7312. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5847

[jira] [Updated] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7304: --- Assignee: Rajendra Include $@ in call to mvn in make-distribution.sh

[jira] [Resolved] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7304. Resolution: Fixed Fix Version/s: 1.4.0 Include $@ in call to mvn in

[jira] [Resolved] (SPARK-7260) Support changing Spark's log level programatically

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7260. Resolution: Duplicate Support changing Spark's log level programatically

[jira] [Commented] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524466#comment-14524466 ] Apache Spark commented on SPARK-6954: - User 'sryza' has created a pull request for

[jira] [Commented] (SPARK-7242) Frequent items for DataFrames

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524575#comment-14524575 ] Apache Spark commented on SPARK-7242: - User 'brkyvz' has created a pull request for

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFoundException with Kryo, Guava 14

2015-05-01 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524363#comment-14524363 ] Russell Alexander Spitzer commented on SPARK-6069: -- We've seen the same

[jira] [Commented] (SPARK-6986) Makes SparkSqlSerializer2 support sort-based shuffle with sort merge

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525070#comment-14525070 ] Apache Spark commented on SPARK-6986: - User 'yhuai' has created a pull request for

[jira] [Updated] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Description: Fix default system alias problem. execute the sql statement will cause problem: select

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525063#comment-14525063 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525061#comment-14525061 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525057#comment-14525057 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525059#comment-14525059 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525062#comment-14525062 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525054#comment-14525054 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Updated] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7318: - Description: {code} def transform[U: ClassTag](transformFunc: RDD[T] = RDD[U]): DStream[U] = {

[jira] [Updated] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Description: Fix default system alias problem. execute the sql statement will cause problem: select

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525060#comment-14525060 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525056#comment-14525056 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525055#comment-14525055 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525058#comment-14525058 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Assigned] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7318: --- Assignee: Apache Spark (was: Andrew Or) DStream isn't cleaning closures correctly

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525051#comment-14525051 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a

[jira] [Commented] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14525052#comment-14525052 ] Apache Spark commented on SPARK-7318: - User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7318: --- Assignee: Andrew Or (was: Apache Spark) DStream isn't cleaning closures correctly

[jira] [Created] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7318: Summary: DStream isn't cleaning closures correctly Key: SPARK-7318 URL: https://issues.apache.org/jira/browse/SPARK-7318 Project: Spark Issue Type: Bug

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the

[jira] [Created] (SPARK-7303) push down project if possible when the child is sort

2015-05-01 Thread Fei Wang (JIRA)
Fei Wang created SPARK-7303: --- Summary: push down project if possible when the child is sort Key: SPARK-7303 URL: https://issues.apache.org/jira/browse/SPARK-7303 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-5891) Add Binarizer

2015-05-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5891. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5699

[jira] [Commented] (SPARK-7299) saving Oracle-source DataFrame to Hive changes scale

2015-05-01 Thread Ken Geis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523236#comment-14523236 ] Ken Geis commented on SPARK-7299: - This passes my test! saving Oracle-source DataFrame

[jira] [Commented] (SPARK-5246) spark/spark-ec2.py cannot start Spark master in VPC if local DNS name does not resolve

2015-05-01 Thread Nick Lipple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523351#comment-14523351 ] Nick Lipple commented on SPARK-5246: is there a workaround for this issue? any reason

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

2015-05-01 Thread longbao wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523226#comment-14523226 ] longbao wang commented on SPARK-2336: - I really agree with you,and i'm already

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

2015-05-01 Thread longbao wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523227#comment-14523227 ] longbao wang commented on SPARK-2336: - I really agree with you,and i'm already

[jira] [Issue Comment Deleted] (SPARK-2336) Approximate k-NN Models for MLLib

2015-05-01 Thread longbao wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] longbao wang updated SPARK-2336: Comment: was deleted (was: I really agree with you,and i'm already implementing it,but i have a

[jira] [Assigned] (SPARK-7303) push down project if possible when the child is sort

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7303: --- Assignee: Apache Spark push down project if possible when the child is sort

[jira] [Assigned] (SPARK-7294) Add a between function in Column

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7294: --- Assignee: (was: Apache Spark) Add a between function in Column

[jira] [Commented] (SPARK-7294) Add a between function in Column

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523359#comment-14523359 ] Apache Spark commented on SPARK-7294: - User 'kaka1992' has created a pull request for

[jira] [Created] (SPARK-7302) SPARK building documentation still mentions building for yarn 0.23

2015-05-01 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-7302: Summary: SPARK building documentation still mentions building for yarn 0.23 Key: SPARK-7302 URL: https://issues.apache.org/jira/browse/SPARK-7302 Project: Spark

[jira] [Updated] (SPARK-7289) Combine Limit and Sort to avoid total ordering

2015-05-01 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Wang updated SPARK-7289: Description: Optimize following sql select key from (select * from testData order by key) t limit 5 from

[jira] [Comment Edited] (SPARK-5246) spark/spark-ec2.py cannot start Spark master in VPC if local DNS name does not resolve

2015-05-01 Thread Nick Lipple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523351#comment-14523351 ] Nick Lipple edited comment on SPARK-5246 at 5/1/15 3:53 PM: is

[jira] [Assigned] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7149: --- Assignee: (was: Apache Spark) Defalt system alias problem ---

[jira] [Commented] (SPARK-3066) Support recommendAll in matrix factorization model

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522825#comment-14522825 ] Apache Spark commented on SPARK-3066: - User 'mengxr' has created a pull request for

  1   2   3   >