[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column

2015-06-18 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593109#comment-14593109 ] Yu Ishikawa commented on SPARK-8348: will do > Add in operator to DataFrame Column >

[jira] [Commented] (SPARK-7814) Turn code generation on by default

2015-06-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593095#comment-14593095 ] Reynold Xin commented on SPARK-7814: Let's continue the discussion in SPARK-8461. >

[jira] [Created] (SPARK-8477) Add in operator to DataFrame Column in Python

2015-06-18 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-8477: -- Summary: Add in operator to DataFrame Column in Python Key: SPARK-8477 URL: https://issues.apache.org/jira/browse/SPARK-8477 Project: Spark Issue Type: New Featu

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-18 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593090#comment-14593090 ] Yu Ishikawa commented on SPARK-6813: [~shivaram] sounds interesting! I created a proto

[jira] [Resolved] (SPARK-8348) Add in operator to DataFrame Column

2015-06-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8348. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Yu Ishikawa > Add in operator to Da

[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column

2015-06-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593086#comment-14593086 ] Reynold Xin commented on SPARK-8348: [~yuu.ishik...@gmail.com] can you also add the Py

[jira] [Updated] (SPARK-7443) MLlib 1.4 QA plan

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7443: - Description: h2. API * Check API compliance using java-compliance-checker (SPARK-7458) *

[jira] [Commented] (SPARK-7443) MLlib 1.4 QA plan

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593040#comment-14593040 ] Joseph K. Bradley commented on SPARK-7443: -- Almost done. Just submitted the migr

[jira] [Commented] (SPARK-7715) Update MLlib Programming Guide for 1.4

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593038#comment-14593038 ] Apache Spark commented on SPARK-7715: - User 'jkbradley' has created a pull request for

[jira] [Updated] (SPARK-7715) Update MLlib Programming Guide for 1.4

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7715: - Target Version/s: 1.4.1, 1.5.0 (was: 1.4.0) > Update MLlib Programming Guide for 1.4 > --

[jira] [Commented] (SPARK-8279) udf_round_3 test fails

2015-06-18 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593031#comment-14593031 ] Yijie Shen commented on SPARK-8279: --- I've just retest `udf_round_3` locally and passed t

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

2015-06-18 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-8475: --- Issue Type: Improvement (was: Bug) > SparkSubmit with Ivy jars is very slow to load with no internet

[jira] [Resolved] (SPARK-8458) ORC data source can only write to the file system defined in Hadoop configuration

2015-06-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-8458. --- Resolution: Fixed Resolved by https://github.com/apache/spark/pull/6892 > ORC data source can only wr

[jira] [Assigned] (SPARK-8476) Setters inc/decDiskBytesSpilled in TaskMetrics should also be private.

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8476: --- Assignee: Apache Spark > Setters inc/decDiskBytesSpilled in TaskMetrics should also be privat

[jira] [Commented] (SPARK-8476) Setters inc/decDiskBytesSpilled in TaskMetrics should also be private.

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592994#comment-14592994 ] Apache Spark commented on SPARK-8476: - User 'ueshin' has created a pull request for th

[jira] [Assigned] (SPARK-8476) Setters inc/decDiskBytesSpilled in TaskMetrics should also be private.

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8476: --- Assignee: (was: Apache Spark) > Setters inc/decDiskBytesSpilled in TaskMetrics should als

[jira] [Created] (SPARK-8476) Setters inc/decDiskBytesSpilled in TaskMetrics should also be private.

2015-06-18 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-8476: Summary: Setters inc/decDiskBytesSpilled in TaskMetrics should also be private. Key: SPARK-8476 URL: https://issues.apache.org/jira/browse/SPARK-8476 Project: Spark

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

2015-06-18 Thread Nathan McCarthy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-8475: --- Description: Spark Submit adds maven central & spark bintray to the ChainResolver before it a

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

2015-06-18 Thread Nathan McCarthy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-8475: --- Description: Spark Submit adds maven central & spark bintray to the ChainResolver before it a

[jira] [Created] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load when no internet access

2015-06-18 Thread Nathan McCarthy (JIRA)
Nathan McCarthy created SPARK-8475: -- Summary: SparkSubmit with Ivy jars is very slow to load when no internet access Key: SPARK-8475 URL: https://issues.apache.org/jira/browse/SPARK-8475 Project: Spa

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

2015-06-18 Thread Nathan McCarthy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-8475: --- Summary: SparkSubmit with Ivy jars is very slow to load with no internet access (was: SparkSu

[jira] [Updated] (SPARK-8467) Add LDAModel.describeTopics() in Python

2015-06-18 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated SPARK-8467: --- Summary: Add LDAModel.describeTopics() in Python (was: Add LDAModel. describeTopics() in Python) > A

[jira] [Updated] (SPARK-8474) [STREAMING] Kafka DirectStream API stops receiving messages if collective size of the messages specified in spark.streaming.kafka.maxRatePerPartition exceeds the default

2015-06-18 Thread Dibyendu Bhattacharya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Bhattacharya updated SPARK-8474: - Description: The issue is , if in Kafka there are variable size messages ranging f

[jira] [Commented] (SPARK-8449) HDF5 read/write support for Spark MLlib

2015-06-18 Thread Stephen Carman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592982#comment-14592982 ] Stephen Carman commented on SPARK-8449: --- I'm gonna have to checkout and build their

[jira] [Created] (SPARK-8474) [STREAMING] Kafka DirectStream API stops receiving messages if collective size of the messages specified in spark.streaming.kafka.maxRatePerPartition exceeds the default

2015-06-18 Thread Dibyendu Bhattacharya (JIRA)
Dibyendu Bhattacharya created SPARK-8474: Summary: [STREAMING] Kafka DirectStream API stops receiving messages if collective size of the messages specified in spark.streaming.kafka.maxRatePerPartition exceeds the default fetch size ( fet

[jira] [Commented] (SPARK-8058) Add tests for SPARK-7853 and SPARK-8020

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592966#comment-14592966 ] Apache Spark commented on SPARK-8058: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592965#comment-14592965 ] Apache Spark commented on SPARK-8368: - User 'yhuai' has created a pull request for thi

[jira] [Issue Comment Deleted] (SPARK-6932) A Prototype of Parameter Server

2015-06-18 Thread zhangyouhua (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangyouhua updated SPARK-6932: --- Comment: was deleted (was: @Qiping Li in your idea the PS client run in slave node, but where the PS S

[jira] [Updated] (SPARK-8080) Custom Receiver.store with Iterator type do not give correct count at Spark UI

2015-06-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8080: - Affects Version/s: (was: 1.2.0) 1.2.2 1.3.1 > Cu

[jira] [Updated] (SPARK-8080) Custom Receiver.store with Iterator type do not give correct count at Spark UI

2015-06-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8080: - Assignee: Dibyendu Bhattacharya > Custom Receiver.store with Iterator type do not give correct cou

[jira] [Updated] (SPARK-8080) Custom Receiver.store with Iterator type do not give correct count at Spark UI

2015-06-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8080: - Fix Version/s: 1.4.1 > Custom Receiver.store with Iterator type do not give correct count at Spark

[jira] [Resolved] (SPARK-8080) Custom Receiver.store with Iterator type do not give correct count at Spark UI

2015-06-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-8080. -- Resolution: Fixed Fix Version/s: 1.5.0 > Custom Receiver.store with Iterator type do not

[jira] [Assigned] (SPARK-8471) Implement Discrete Cosine Transform feature transformer

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8471: --- Assignee: Apache Spark > Implement Discrete Cosine Transform feature transformer > --

[jira] [Commented] (SPARK-8471) Implement Discrete Cosine Transform feature transformer

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592914#comment-14592914 ] Apache Spark commented on SPARK-8471: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-8471) Implement Discrete Cosine Transform feature transformer

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8471: --- Assignee: (was: Apache Spark) > Implement Discrete Cosine Transform feature transformer >

[jira] [Resolved] (SPARK-8462) Documentation fixes for Spark SQL

2015-06-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8462. --- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-8471) Implement Discrete Cosine Transform feature transformer

2015-06-18 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592908#comment-14592908 ] Feynman Liang commented on SPARK-8471: -- Starting work. > Implement Discrete Cosine T

[jira] [Updated] (SPARK-8462) Documentation fixes for Spark SQL

2015-06-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8462: -- Assignee: Lars Francke > Documentation fixes for Spark SQL > - > >

[jira] [Created] (SPARK-8473) Documentation for DCT

2015-06-18 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-8473: Summary: Documentation for DCT Key: SPARK-8473 URL: https://issues.apache.org/jira/browse/SPARK-8473 Project: Spark Issue Type: New Feature Compone

[jira] [Created] (SPARK-8472) Python API for DCT

2015-06-18 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-8472: Summary: Python API for DCT Key: SPARK-8472 URL: https://issues.apache.org/jira/browse/SPARK-8472 Project: Spark Issue Type: New Feature Components

[jira] [Resolved] (SPARK-8135) Don't load defaults when reconstituting Hadoop Configurations

2015-06-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8135. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6679 [https://github.com/

[jira] [Created] (SPARK-8471) Implement Discrete Cosine Transform feature transformer

2015-06-18 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-8471: Summary: Implement Discrete Cosine Transform feature transformer Key: SPARK-8471 URL: https://issues.apache.org/jira/browse/SPARK-8471 Project: Spark Issue T

[jira] [Commented] (SPARK-8391) showDagViz throws OutOfMemoryError, cause the whole jobPage dies

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592888#comment-14592888 ] Apache Spark commented on SPARK-8391: - User 'XuTingjun' has created a pull request for

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-06-18 Thread zhangyouhua (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592887#comment-14592887 ] zhangyouhua commented on SPARK-6932: Model partition across servers Currently all the

[jira] [Commented] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

2015-06-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592879#comment-14592879 ] Saisai Shao commented on SPARK-8389: OK, let me think a bit on this, but this can only

[jira] [Updated] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

2015-06-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8470: Assignee: Andrew Or > MissingRequirementError for ScalaReflection on user classes >

[jira] [Updated] (SPARK-8160) Tungsten style external aggregation

2015-06-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8160: --- Target Version/s: 1.5.0 > Tungsten style external aggregation > --- >

[jira] [Commented] (SPARK-6675) HiveContext setConf is not stable

2015-06-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592845#comment-14592845 ] Yin Huai commented on SPARK-6675: - [~invkrh] Can you try 1.4 or master and see if this pro

[jira] [Created] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

2015-06-18 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-8470: --- Summary: MissingRequirementError for ScalaReflection on user classes Key: SPARK-8470 URL: https://issues.apache.org/jira/browse/SPARK-8470 Project: Spark

[jira] [Updated] (SPARK-8307) Improve timestamp from parquet

2015-06-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8307: Shepherd: Cheng Lian > Improve timestamp from parquet > -- > >

[jira] [Updated] (SPARK-7157) Add approximate stratified sampling to DataFrame

2015-06-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7157: Shepherd: Reynold Xin > Add approximate stratified sampling to DataFrame > -

[jira] [Updated] (SPARK-6675) HiveContext setConf is not stable

2015-06-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6675: Shepherd: Yin Huai (was: Cheng Lian) > HiveContext setConf is not stable >

[jira] [Updated] (SPARK-8469) Application timeline view unreadable with many executors

2015-06-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8469: - Attachment: Screen Shot 2015-06-18 at 5.51.21 PM.png > Application timeline view unreadable with many exec

[jira] [Updated] (SPARK-8469) Application timeline view unreadable with many executors

2015-06-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8469: - Description: This is a problem with using dynamic allocation with many executors. See screenshot. We may w

[jira] [Created] (SPARK-8469) Application timeline view unreadable with many executors

2015-06-18 Thread Andrew Or (JIRA)
Andrew Or created SPARK-8469: Summary: Application timeline view unreadable with many executors Key: SPARK-8469 URL: https://issues.apache.org/jira/browse/SPARK-8469 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

2015-06-18 Thread Qiyuan Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592815#comment-14592815 ] Qiyuan Qiu commented on SPARK-2336: --- Hi [~saurfang] and [~datawlb], May I ask why both

[jira] [Created] (SPARK-8468) Cross-validation with RegressionEvaluator prefers higher RMSE

2015-06-18 Thread Chelsea Zhang (JIRA)
Chelsea Zhang created SPARK-8468: Summary: Cross-validation with RegressionEvaluator prefers higher RMSE Key: SPARK-8468 URL: https://issues.apache.org/jira/browse/SPARK-8468 Project: Spark

[jira] [Comment Edited] (SPARK-8431) Add in operator to DataFrame Column in SparkR

2015-06-18 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592803#comment-14592803 ] Yu Ishikawa edited comment on SPARK-8431 at 6/19/15 12:44 AM: --

[jira] [Assigned] (SPARK-8458) ORC data source can only write to the file system defined in Hadoop configuration

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8458: --- Assignee: Apache Spark (was: Cheng Lian) > ORC data source can only write to the file system

[jira] [Assigned] (SPARK-8458) ORC data source can only write to the file system defined in Hadoop configuration

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8458: --- Assignee: Cheng Lian (was: Apache Spark) > ORC data source can only write to the file system

[jira] [Commented] (SPARK-8458) ORC data source can only write to the file system defined in Hadoop configuration

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592807#comment-14592807 ] Apache Spark commented on SPARK-8458: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-8431) Add in operator to DataFrame Column in SparkR

2015-06-18 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592803#comment-14592803 ] Yu Ishikawa commented on SPARK-8431: Hi [~shivaram] and [~davies], thank you for your

[jira] [Updated] (SPARK-8087) PipelineModel.copy didn't copy the stages

2015-06-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8087: - Priority: Blocker (was: Critical) > PipelineModel.copy didn't copy the stages > -

[jira] [Updated] (SPARK-8151) Pipeline components should correctly implement copy

2015-06-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8151: - Priority: Blocker (was: Critical) > Pipeline components should correctly implement copy > ---

[jira] [Created] (SPARK-8467) Add LDAModel. describeTopics() in Python

2015-06-18 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-8467: -- Summary: Add LDAModel. describeTopics() in Python Key: SPARK-8467 URL: https://issues.apache.org/jira/browse/SPARK-8467 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-8058) Add tests for SPARK-7853 and SPARK-8020

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8058: --- Assignee: Apache Spark (was: Yin Huai) > Add tests for SPARK-7853 and SPARK-8020 > -

[jira] [Assigned] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8368: --- Assignee: Apache Spark (was: Yin Huai) > ClassNotFoundException in closure for map > --

[jira] [Commented] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592753#comment-14592753 ] Apache Spark commented on SPARK-8368: - User 'yhuai' has created a pull request for thi

[jira] [Assigned] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8368: --- Assignee: Yin Huai (was: Apache Spark) > ClassNotFoundException in closure for map > --

[jira] [Assigned] (SPARK-8058) Add tests for SPARK-7853 and SPARK-8020

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8058: --- Assignee: Yin Huai (was: Apache Spark) > Add tests for SPARK-7853 and SPARK-8020 > -

[jira] [Commented] (SPARK-8058) Add tests for SPARK-7853 and SPARK-8020

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592754#comment-14592754 ] Apache Spark commented on SPARK-8058: - User 'yhuai' has created a pull request for thi

[jira] [Resolved] (SPARK-8446) Add helper functions for testing physical SparkPlan operators

2015-06-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8446. - Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by p

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-18 Thread Amit Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592736#comment-14592736 ] Amit Ramesh commented on SPARK-8337: [~ap4dl] can you please chime in here? Thanks! >

[jira] [Created] (SPARK-8466) Bug in SQL Optimizer: Unresolved Attribute after pushing Filter below Project

2015-06-18 Thread Kai Zeng (JIRA)
Kai Zeng created SPARK-8466: --- Summary: Bug in SQL Optimizer: Unresolved Attribute after pushing Filter below Project Key: SPARK-8466 URL: https://issues.apache.org/jira/browse/SPARK-8466 Project: Spark

[jira] [Closed] (SPARK-7816) Mark params, getters, and user-facing classes final

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-7816. Resolution: Won't Fix Decided not to fix. Marking classes as final can make them harder to

[jira] [Updated] (SPARK-7667) MLlib Python API consistency check

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7667: - Assignee: Yanbo Liang > MLlib Python API consistency check > -

[jira] [Created] (SPARK-8465) ScalaReflectionException with DataFrames in 1.4

2015-06-18 Thread Chad Urso McDaniel (JIRA)
Chad Urso McDaniel created SPARK-8465: - Summary: ScalaReflectionException with DataFrames in 1.4 Key: SPARK-8465 URL: https://issues.apache.org/jira/browse/SPARK-8465 Project: Spark Issue

[jira] [Commented] (SPARK-8461) ClassNotFoundException when code generation is enabled

2015-06-18 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592701#comment-14592701 ] Herman van Hovell tot Westerflier commented on SPARK-8461: -- I hav

[jira] [Resolved] (SPARK-8376) Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs

2015-06-18 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-8376. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Assignee: Shixion

[jira] [Updated] (SPARK-8463) No suitable driver found for write.jdbc

2015-06-18 Thread Matthew Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Jones updated SPARK-8463: - Description: I am getting a java.sql.SQLException: No suitable driver found for jdbc:mysql://dbho

[jira] [Created] (SPARK-8464) Consider separating aggregator and non-aggregator paths in ExternalSorter

2015-06-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8464: - Summary: Consider separating aggregator and non-aggregator paths in ExternalSorter Key: SPARK-8464 URL: https://issues.apache.org/jira/browse/SPARK-8464 Project: Spark

[jira] [Updated] (SPARK-8463) No suitable driver found for write.jdbc

2015-06-18 Thread Matthew Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Jones updated SPARK-8463: - Description: I am getting a java.sql.SQLException: No suitable driver found for jdbc:mysql://dbho

[jira] [Updated] (SPARK-8461) ClassNotFoundException when code generation is enabled

2015-06-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8461: -- Description: Build Spark without {{-Phive}} to make sure the isolated classloader for Hive support is i

[jira] [Assigned] (SPARK-8462) Documentation fixes for Spark SQL

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8462: --- Assignee: Apache Spark > Documentation fixes for Spark SQL >

[jira] [Assigned] (SPARK-8462) Documentation fixes for Spark SQL

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8462: --- Assignee: (was: Apache Spark) > Documentation fixes for Spark SQL > -

[jira] [Commented] (SPARK-8462) Documentation fixes for Spark SQL

2015-06-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592674#comment-14592674 ] Apache Spark commented on SPARK-8462: - User 'lfrancke' has created a pull request for

[jira] [Commented] (SPARK-7633) Streaming Logistic Regression- Python bindings

2015-06-18 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592670#comment-14592670 ] Mike Dusenberry commented on SPARK-7633: Okay, no problem. Definitely feel free t

[jira] [Created] (SPARK-8463) No suitable driver found for write.jdbc

2015-06-18 Thread Matthew Jones (JIRA)
Matthew Jones created SPARK-8463: Summary: No suitable driver found for write.jdbc Key: SPARK-8463 URL: https://issues.apache.org/jira/browse/SPARK-8463 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8461) ClassNotFoundException when code generation is enabled

2015-06-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8461: -- Description: Build Spark with {{-Phive}}, then run the following Spark shell snippet: {code} sqlContext.

[jira] [Updated] (SPARK-8461) ClassNotFoundException when code generation is enabled

2015-06-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8461: -- Description: Build Spark with {{-Phive}}, then run the following Spark shell snippet: {code} sqlContext.

[jira] [Created] (SPARK-8462) Documentation fixes for Spark SQL

2015-06-18 Thread Lars Francke (JIRA)
Lars Francke created SPARK-8462: --- Summary: Documentation fixes for Spark SQL Key: SPARK-8462 URL: https://issues.apache.org/jira/browse/SPARK-8462 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-8461) ClassNotFoundException when code generation is enabled

2015-06-18 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8461: - Summary: ClassNotFoundException when code generation is enabled Key: SPARK-8461 URL: https://issues.apache.org/jira/browse/SPARK-8461 Project: Spark Issue Type: Bu

[jira] [Created] (SPARK-8460) Distinguish between shuffle and non-shuffle spills in metrics

2015-06-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8460: - Summary: Distinguish between shuffle and non-shuffle spills in metrics Key: SPARK-8460 URL: https://issues.apache.org/jira/browse/SPARK-8460 Project: Spark Issue

[jira] [Commented] (SPARK-8420) Inconsistent behavior with Dataframe Timestamp between 1.3.1 and 1.4.0

2015-06-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592654#comment-14592654 ] Michael Armbrust commented on SPARK-8420: - Note that the fix does also have slight

[jira] [Updated] (SPARK-8420) Inconsistent behavior with Dataframe Timestamp between 1.3.1 and 1.4.0

2015-06-18 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8420: Labels: releasenotes (was: ) > Inconsistent behavior with Dataframe Timestamp between 1.3.1

[jira] [Updated] (SPARK-7808) Package doc for spark.ml.feature

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7808: - Target Version/s: 1.4.1, 1.5.0 (was: 1.4.0) > Package doc for spark.ml.feature >

[jira] [Updated] (SPARK-7536) Audit MLlib Python API for 1.4

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7536: - Description: **NOTE: This is targeted at 1.5.0 because it has so many useful links for JIR

[jira] [Updated] (SPARK-7536) Audit MLlib Python API for 1.4

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7536: - Target Version/s: 1.5.0 (was: 1.4.0) > Audit MLlib Python API for 1.4 > -

[jira] [Updated] (SPARK-7536) Audit MLlib Python API for 1.4

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7536: - Description: For new public APIs added to MLlib, we need to check the generated HTML doc a

[jira] [Updated] (SPARK-6173) Python doc parity with Scala/Java in MLlib

2015-06-18 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6173: - Target Version/s: 1.5.0 (was: 1.4.0) > Python doc parity with Scala/Java in MLlib > -

  1   2   3   4   >