[jira] [Resolved] (SPARK-10786) SparkSQLCLIDriver should take the whole statement to generate the CommandProcessor

2015-11-02 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-10786. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8895

[jira] [Updated] (SPARK-11449) PortableDataStream should be a factory

2015-11-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-11449: -- Summary: PortableDataStream should be a factory (was: Improve documentation on close

[jira] [Updated] (SPARK-2992) The transforms formerly known as non-lazy

2015-11-02 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-2992: --- Description: An umbrella for a grab-bag of tickets involving lazy implementations of

[jira] [Assigned] (SPARK-9836) Provide R-like summary statistics for ordinary least squares via normal equation solver

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9836: --- Assignee: Yanbo Liang (was: Apache Spark) > Provide R-like summary statistics for ordinary

[jira] [Assigned] (SPARK-9836) Provide R-like summary statistics for ordinary least squares via normal equation solver

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9836: --- Assignee: Apache Spark (was: Yanbo Liang) > Provide R-like summary statistics for ordinary

[jira] [Commented] (SPARK-9836) Provide R-like summary statistics for ordinary least squares via normal equation solver

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985258#comment-14985258 ] Apache Spark commented on SPARK-9836: - User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11450) Add support for UnsafeRow to Expand

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11450: Assignee: Apache Spark > Add support for UnsafeRow to Expand >

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985433#comment-14985433 ] Sean Owen commented on SPARK-11371: --- I don't feel strongly about it, and it's not really my area. My

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985424#comment-14985424 ] Ted Yu commented on SPARK-11371: [~sowen]: Do you think it is worth adding the alias ? Thanks > Make

[jira] [Assigned] (SPARK-10978) Allow PrunedFilterScan to eliminate predicates from further evaluation

2015-11-02 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-10978: -- Assignee: Cheng Lian > Allow PrunedFilterScan to eliminate predicates from further evaluation

[jira] [Created] (SPARK-11458) add word count example for Dataset

2015-11-02 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11458: --- Summary: add word count example for Dataset Key: SPARK-11458 URL: https://issues.apache.org/jira/browse/SPARK-11458 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-11458) add word count example for Dataset

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985324#comment-14985324 ] Apache Spark commented on SPARK-11458: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11458) add word count example for Dataset

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11458: Assignee: (was: Apache Spark) > add word count example for Dataset >

[jira] [Assigned] (SPARK-11458) add word count example for Dataset

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11458: Assignee: Apache Spark > add word count example for Dataset >

[jira] [Commented] (SPARK-9357) Remove JoinedRow

2015-11-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985264#comment-14985264 ] Herman van Hovell commented on SPARK-9357: -- Is this ticket still relevant? > Remove JoinedRow >

[jira] [Assigned] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6373: --- Assignee: Apache Spark > Add SSL/TLS for the Netty based BlockTransferService >

[jira] [Commented] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985412#comment-14985412 ] Apache Spark commented on SPARK-6373: - User 'turp1twin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6373: --- Assignee: (was: Apache Spark) > Add SSL/TLS for the Netty based BlockTransferService >

[jira] [Commented] (SPARK-11450) Add support for UnsafeRow to Expand

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985262#comment-14985262 ] Apache Spark commented on SPARK-11450: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11450) Add support for UnsafeRow to Expand

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11450: Assignee: (was: Apache Spark) > Add support for UnsafeRow to Expand >

[jira] [Assigned] (SPARK-11449) PortableDataStream should be a factory

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11449: Assignee: Apache Spark > PortableDataStream should be a factory >

[jira] [Assigned] (SPARK-11449) PortableDataStream should be a factory

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11449: Assignee: (was: Apache Spark) > PortableDataStream should be a factory >

[jira] [Commented] (SPARK-11447) Null comparison requires type information but type extraction fails for complex types

2015-11-02 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985569#comment-14985569 ] kevin yu commented on SPARK-11447: -- Hello Kapil: When you say Doesn't work, does it mean that you got

[jira] [Commented] (SPARK-11457) Yarn AM proxy filter configuration should be reloaded when recovered from checkpoint

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985187#comment-14985187 ] Apache Spark commented on SPARK-11457: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11457) Yarn AM proxy filter configuration should be reloaded when recovered from checkpoint

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11457: Assignee: Apache Spark > Yarn AM proxy filter configuration should be reloaded when

[jira] [Assigned] (SPARK-11457) Yarn AM proxy filter configuration should be reloaded when recovered from checkpoint

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11457: Assignee: (was: Apache Spark) > Yarn AM proxy filter configuration should be reloaded

[jira] [Resolved] (SPARK-10997) Netty-based RPC env should support a "client-only" mode.

2015-11-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10997. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 >

[jira] [Updated] (SPARK-11311) spark cannot describe temporary functions

2015-11-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11311: -- Assignee: Adrian Wang > spark cannot describe temporary functions >

[jira] [Resolved] (SPARK-9817) Improve the container placement strategy by considering the localities of pending container requests

2015-11-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9817. --- Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 1.6.0 > Improve the

[jira] [Resolved] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

2015-11-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11437. Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 9392

[jira] [Updated] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

2015-11-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11437: --- Fix Version/s: (was: 1.6.1) 1.6.0 > createDataFrame shouldn't .take() when

[jira] [Commented] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-11-02 Thread Stefano Baghino (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985755#comment-14985755 ] Stefano Baghino commented on SPARK-7425: I would like to contribute on this issue. Is there an

[jira] [Assigned] (SPARK-11333) Add the receiver's executor information to UI

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11333: Assignee: Shixiong Zhu (was: Apache Spark) > Add the receiver's executor information to

[jira] [Commented] (SPARK-11333) Add the receiver's executor information to UI

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985756#comment-14985756 ] Apache Spark commented on SPARK-11333: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11333) Add the receiver's executor information to UI

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11333: Assignee: Apache Spark (was: Shixiong Zhu) > Add the receiver's executor information to

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985651#comment-14985651 ] Yin Huai commented on SPARK-11371: -- Since DataFrame API provides it as a function, I think it is fine to

[jira] [Commented] (SPARK-11198) Support record de-aggregation in KinesisReceiver

2015-11-02 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985701#comment-14985701 ] Burak Yavuz commented on SPARK-11198: - Just tested this. It works during regular operation, but

[jira] [Updated] (SPARK-11398) misleading dialect conf at the start of spark-sql

2015-11-02 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-11398: - Description: 1. def dialectClassName in HiveContext is unnecessary. In HiveContext, if

[jira] [Updated] (SPARK-11398) unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the start of spark-sql

2015-11-02 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-11398: - Summary: unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the

[jira] [Updated] (SPARK-11398) unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the start of spark-sql

2015-11-02 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-11398: - Description: 1. def dialectClassName in HiveContext is unnecessary. In HiveContext, if

[jira] [Updated] (SPARK-11398) unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the start of spark-sql

2015-11-02 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-11398: - Description: 1. def dialectClassName in HiveContext is unnecessary. In HiveContext, if

[jira] [Updated] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9034: Assignee: Navis > Reflect field names defined in GenericUDTF > -- >

[jira] [Commented] (SPARK-11275) [SQL] Incorrect results when using rollup/cube

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986764#comment-14986764 ] Apache Spark commented on SPARK-11275: -- User 'aray' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11399) Include_example should support labels to cut out different parts in one example code

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11399: Assignee: (was: Apache Spark) > Include_example should support labels to cut out

[jira] [Commented] (SPARK-11399) Include_example should support labels to cut out different parts in one example code

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986834#comment-14986834 ] Apache Spark commented on SPARK-11399: -- User 'yinxusen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11399) Include_example should support labels to cut out different parts in one example code

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11399: Assignee: Apache Spark > Include_example should support labels to cut out different parts

[jira] [Resolved] (SPARK-11456) Remove deprecatd junit.framework in Java tests

2015-11-02 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-11456. -- Resolution: Fixed Fix Version/s: 1.6.0 > Remove deprecatd junit.framework in Java tests

[jira] [Updated] (SPARK-11437) createDataFrame shouldn't .take() when provided schema

2015-11-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11437: -- Assignee: Jason White > createDataFrame shouldn't .take() when provided schema >

[jira] [Comment Edited] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-11-02 Thread Stefano Baghino (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985884#comment-14985884 ] Stefano Baghino edited comment on SPARK-7425 at 11/2/15 7:55 PM: - I'm

[jira] [Commented] (SPARK-3474) The env variable SPARK_MASTER_IP does not work

2015-11-02 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985938#comment-14985938 ] Konstantin Boudnik commented on SPARK-3474: --- Actually, it seems there's still something to this

[jira] [Updated] (SPARK-11275) [SQL] Incorrect results when using rollup/cube

2015-11-02 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11275: Summary: [SQL] Incorrect results when using rollup/cube (was: [SQL] Regression in rollup/cube ) > [SQL]

[jira] [Updated] (SPARK-11275) [SQL] Incorrect results when using rollup/cube

2015-11-02 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11275: Affects Version/s: 1.3.0 1.4.0 > [SQL] Incorrect results when using rollup/cube >

[jira] [Commented] (SPARK-11250) Generate different alias for columns with same name during join

2015-11-02 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985860#comment-14985860 ] Narine Kokhlikyan commented on SPARK-11250: --- Hi [~davies], [~rxin], [~shivaram] I have some

[jira] [Assigned] (SPARK-11275) [SQL] Regression in rollup/cube

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11275: Assignee: Apache Spark > [SQL] Regression in rollup/cube >

[jira] [Assigned] (SPARK-11275) [SQL] Regression in rollup/cube

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11275: Assignee: (was: Apache Spark) > [SQL] Regression in rollup/cube >

[jira] [Commented] (SPARK-11275) [SQL] Regression in rollup/cube

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985935#comment-14985935 ] Apache Spark commented on SPARK-11275: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

2015-11-02 Thread Jacob Wellington (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985949#comment-14985949 ] Jacob Wellington commented on SPARK-8170: - I'm running into an issue when I'm trying to connect to

[jira] [Updated] (SPARK-11444) Allow bacth seqOp combination in treeAggregate

2015-11-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-11444: Summary: Allow bacth seqOp combination in treeAggregate (was: Allow bacth seqOp combination in

[jira] [Commented] (SPARK-11444) Allow bacth seqOp combination in treeAggregate

2015-11-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985882#comment-14985882 ] holdenk commented on SPARK-11444: - Draft design:

[jira] [Updated] (SPARK-11444) Allow bacth seqOp combination in treeAggregate

2015-11-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-11444: Description: Allow batch seqOp in treeAggregate so as to allow better integration with GPU type workloads.

[jira] [Commented] (SPARK-11439) Optiomization of creating sparse feature without dense one

2015-11-02 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985890#comment-14985890 ] Nakul Jindal commented on SPARK-11439: -- I will work on this. > Optiomization of creating sparse

[jira] [Commented] (SPARK-11115) Host verification is not correct for IPv6

2015-11-02 Thread watson xi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985985#comment-14985985 ] watson xi commented on SPARK-5: --- started getting some intermittent socket connection errors after

[jira] [Commented] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-11-02 Thread Stefano Baghino (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985884#comment-14985884 ] Stefano Baghino commented on SPARK-7425: I'm checking the code and I'm not sure this solution

[jira] [Comment Edited] (SPARK-11115) Host verification is not correct for IPv6

2015-11-02 Thread watson xi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985985#comment-14985985 ] watson xi edited comment on SPARK-5 at 11/2/15 8:39 PM: started getting

[jira] [Resolved] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9034. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8456

[jira] [Resolved] (SPARK-11469) Initial implementation

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11469. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9393

[jira] [Created] (SPARK-11448) We should skip caching part-files in ParquetRelation when configured to merge schema and respect summaries

2015-11-02 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-11448: --- Summary: We should skip caching part-files in ParquetRelation when configured to merge schema and respect summaries Key: SPARK-11448 URL:

[jira] [Assigned] (SPARK-11448) We should skip caching part-files in ParquetRelation when configured to merge schema and respect summaries

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11448: Assignee: (was: Apache Spark) > We should skip caching part-files in ParquetRelation

[jira] [Updated] (SPARK-11448) We should skip caching part-files in ParquetRelation when configured to merge schema and respect summaries

2015-11-02 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-11448: Description: We now cache part-files, metadata, common metadata in ParquetRelation as

[jira] [Commented] (SPARK-11448) We should skip caching part-files in ParquetRelation when configured to merge schema and respect summaries

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984878#comment-14984878 ] Apache Spark commented on SPARK-11448: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-02 Thread Study Hsueh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984879#comment-14984879 ] Study Hsueh commented on SPARK-11191: - Ok, it looks like `FunctionRegistry.getFunctionInfo` does not

[jira] [Commented] (SPARK-11275) [SQL] Regression in rollup/cube

2015-11-02 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984881#comment-14984881 ] Xiao Li commented on SPARK-11275: - Agree. It becomes more complex when you need to resolve both cases at

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-11-02 Thread Ricardo Almeida (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984880#comment-14984880 ] Ricardo Almeida commented on SPARK-3789: Any update on having GraphX on Python? > [GRAPHX] Python

[jira] [Commented] (SPARK-11275) [SQL] Regression in rollup/cube

2015-11-02 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984863#comment-14984863 ] Herman van Hovell commented on SPARK-11275: --- This is caused by the fact that the logical Expand

[jira] [Assigned] (SPARK-11448) We should skip caching part-files in ParquetRelation when configured to merge schema and respect summaries

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11448: Assignee: Apache Spark > We should skip caching part-files in ParquetRelation when

[jira] [Commented] (SPARK-11449) PortableDataStream should be a factory

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985419#comment-14985419 ] Apache Spark commented on SPARK-11449: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Commented] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985438#comment-14985438 ] Ted Yu commented on SPARK-11371: [~rxin] [~yhuai]: Your comment is welcome. > Make "mean" an alias for

[jira] [Created] (SPARK-11460) Locality waits should be based on task set creation time, not last launch time

2015-11-02 Thread Shengyue Ji (JIRA)
Shengyue Ji created SPARK-11460: --- Summary: Locality waits should be based on task set creation time, not last launch time Key: SPARK-11460 URL: https://issues.apache.org/jira/browse/SPARK-11460

[jira] [Created] (SPARK-11462) Add JavaStreamingListener

2015-11-02 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11462: Summary: Add JavaStreamingListener Key: SPARK-11462 URL: https://issues.apache.org/jira/browse/SPARK-11462 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4557) Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a Function<..., Void>

2015-11-02 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986101#comment-14986101 ] Bryan Cutler commented on SPARK-4557: - Hi [~somi...@us.ibm.com], the right way to make a pull request

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in

[jira] [Updated] (SPARK-11336) Include a link to the source file in generated example code

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11336: -- Shepherd: Xiangrui Meng > Include a link to the source file in generated example code >

[jira] [Commented] (SPARK-11359) Kinesis receiver does not checkpoint to DynamoDB if there is no new data.

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986137#comment-14986137 ] Apache Spark commented on SPARK-11359: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Resolved] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11383. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9353

[jira] [Updated] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11262: -- Target Version/s: 1.6.0 > Unit test for gradient, loss layers, memory management for

[jira] [Created] (SPARK-11459) Allow configuring checkpoint dir, filenames

2015-11-02 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-11459: - Summary: Allow configuring checkpoint dir, filenames Key: SPARK-11459 URL: https://issues.apache.org/jira/browse/SPARK-11459 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9836) Provide R-like summary statistics for ordinary least squares via normal equation solver

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9836: - Shepherd: Xiangrui Meng Priority: Critical (was: Major) > Provide R-like summary statistics

[jira] [Created] (SPARK-11463) SparkContext fail to create in non-main thread in Python

2015-11-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11463: -- Summary: SparkContext fail to create in non-main thread in Python Key: SPARK-11463 URL: https://issues.apache.org/jira/browse/SPARK-11463 Project: Spark Issue

[jira] [Resolved] (SPARK-11358) Deprecate `runs` in k-means

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11358. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9322

[jira] [Updated] (SPARK-11445) Replace example code in mllib-ensembles.md using include_example

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11445: -- Component/s: MLlib > Replace example code in mllib-ensembles.md using include_example >

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in

[jira] [Updated] (SPARK-11445) Replace example code in mllib-ensembles.md using include_example

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11445: -- Shepherd: Xusen Yin > Replace example code in mllib-ensembles.md using include_example >

[jira] [Updated] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11371: - Assignee: Ted Yu > Make "mean" an alias for "avg" operator > --- > >

[jira] [Resolved] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11371. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9332

[jira] [Assigned] (SPARK-10429) MutableProjection should evaluate all expressions first and then update the mutable row

2015-11-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-10429: -- Assignee: Davies Liu (was: Wenchen Fan) > MutableProjection should evaluate all expressions

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-11-02 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986089#comment-14986089 ] shane knapp commented on SPARK-11255: - okie dokie! an RPM of 3.1.1-7 was found, and i have a staging

[jira] [Assigned] (SPARK-11359) Kinesis receiver does not checkpoint to DynamoDB if there is no new data.

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11359: Assignee: Apache Spark (was: Burak Yavuz) > Kinesis receiver does not checkpoint to

[jira] [Updated] (SPARK-11336) Include a link to the source file in generated example code

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11336: -- Parent Issue: SPARK-11337 (was: SPARK-11137) > Include a link to the source file in generated

  1   2   3   >