[jira] [Commented] (SPARK-8021) DataFrameReader/Writer in Python does not match Scala

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568672#comment-14568672 ] Apache Spark commented on SPARK-8021: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-8032) Make version checking in mllib/__init__.py more robust for version NumPy 1.10

2015-06-02 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-8032: -- Summary: Make version checking in mllib/__init__.py more robust for version NumPy 1.10 Key: SPARK-8032 URL: https://issues.apache.org/jira/browse/SPARK-8032 Project:

[jira] [Assigned] (SPARK-8021) DataFrameReader/Writer in Python does not match Scala

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8021: --- Assignee: Apache Spark (was: Davies Liu) DataFrameReader/Writer in Python does not match

[jira] [Assigned] (SPARK-8021) DataFrameReader/Writer in Python does not match Scala

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8021: --- Assignee: Davies Liu (was: Apache Spark) DataFrameReader/Writer in Python does not match

[jira] [Created] (SPARK-8034) spark-sql security authorization bug

2015-06-02 Thread nilone (JIRA)
nilone created SPARK-8034: - Summary: spark-sql security authorization bug Key: SPARK-8034 URL: https://issues.apache.org/jira/browse/SPARK-8034 Project: Spark Issue Type: Bug Components:

[jira] [Closed] (SPARK-8035) 2

2015-06-02 Thread nilone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nilone closed SPARK-8035. - Resolution: Invalid 2 - Key: SPARK-8035 URL:

[jira] [Commented] (SPARK-7980) Support SQLContext.range(end)

2015-06-02 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568720#comment-14568720 ] Animesh Baranawal commented on SPARK-7980: -- Regarding the python support for

[jira] [Comment Edited] (SPARK-6816) Add SparkConf API to configure SparkR

2015-06-02 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567187#comment-14567187 ] Rick Moritz edited comment on SPARK-6816 at 6/2/15 8:55 AM:

[jira] [Assigned] (SPARK-8038) PySpark SQL when functions is broken on Column

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8038: --- Assignee: Apache Spark PySpark SQL when functions is broken on Column

[jira] [Assigned] (SPARK-8004) Spark does not enclose column names when fetchting from jdbc sources

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8004: --- Assignee: Apache Spark Spark does not enclose column names when fetchting from jdbc sources

[jira] [Commented] (SPARK-8004) Spark does not enclose column names when fetchting from jdbc sources

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568666#comment-14568666 ] Apache Spark commented on SPARK-8004: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-8004) Spark does not enclose column names when fetchting from jdbc sources

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8004: --- Assignee: (was: Apache Spark) Spark does not enclose column names when fetchting from

[jira] [Created] (SPARK-8035) 2

2015-06-02 Thread nilone (JIRA)
nilone created SPARK-8035: - Summary: 2 Key: SPARK-8035 URL: https://issues.apache.org/jira/browse/SPARK-8035 Project: Spark Issue Type: Bug Reporter: nilone -- This message was

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568726#comment-14568726 ] Saisai Shao commented on SPARK-4352: Hi [~sandyr], I have a proposal based on ratio to

[jira] [Commented] (SPARK-7980) Support SQLContext.range(end)

2015-06-02 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568722#comment-14568722 ] Animesh Baranawal commented on SPARK-7980: -- Regarding the python support for

[jira] [Issue Comment Deleted] (SPARK-7980) Support SQLContext.range(end)

2015-06-02 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Animesh Baranawal updated SPARK-7980: - Comment: was deleted (was: Regarding the python support for range, I am unable to check

[jira] [Created] (SPARK-8037) Ignores files whose name starts with . while enumerating files in HadoopFsRelation

2015-06-02 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8037: - Summary: Ignores files whose name starts with . while enumerating files in HadoopFsRelation Key: SPARK-8037 URL: https://issues.apache.org/jira/browse/SPARK-8037 Project:

[jira] [Commented] (SPARK-6816) Add SparkConf API to configure SparkR

2015-06-02 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568807#comment-14568807 ] Rick Moritz commented on SPARK-6816: [~shivaram], I am integrating SparkR into an

[jira] [Assigned] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8032: --- Assignee: (was: Apache Spark) Make NumPy version checking in mllib/__init__.py

[jira] [Closed] (SPARK-8034) spark-sql security authorization bug

2015-06-02 Thread nilone (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nilone closed SPARK-8034. - Resolution: Invalid spark-sql security authorization bug

[jira] [Created] (SPARK-8036) Ignores files whose name starts with . while enumerating files in HadoopFsRelation

2015-06-02 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8036: - Summary: Ignores files whose name starts with . while enumerating files in HadoopFsRelation Key: SPARK-8036 URL: https://issues.apache.org/jira/browse/SPARK-8036 Project:

[jira] [Resolved] (SPARK-8033) spark-sql thriftserver security authorization bugs!

2015-06-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8033. -- Resolution: Duplicate spark-sql thriftserver security authorization bugs!

[jira] [Commented] (SPARK-6988) Fix Spark SQL documentation for 1.3.x

2015-06-02 Thread Saurabh Santhosh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568705#comment-14568705 ] Saurabh Santhosh commented on SPARK-6988: - Hey, Can someone update the Spark

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-02 Thread Akhil Thatipamula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568717#comment-14568717 ] Akhil Thatipamula commented on SPARK-7993: -- I am planning to check whether the

[jira] [Commented] (SPARK-8011) DecimalType is not a datatype

2015-06-02 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568823#comment-14568823 ] Liang-Chi Hsieh commented on SPARK-8011: Try DecimalType.Unlimited? DecimalType

[jira] [Assigned] (SPARK-8038) PySpark SQL when functions is broken on Column

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8038: --- Assignee: (was: Apache Spark) PySpark SQL when functions is broken on Column

[jira] [Commented] (SPARK-8038) PySpark SQL when functions is broken on Column

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568836#comment-14568836 ] Apache Spark commented on SPARK-8038: - User 'ogirardot' has created a pull request for

[jira] [Assigned] (SPARK-8037) Ignores files whose name starts with . while enumerating files in HadoopFsRelation

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8037: --- Assignee: Cheng Lian (was: Apache Spark) Ignores files whose name starts with . while

[jira] [Assigned] (SPARK-8037) Ignores files whose name starts with . while enumerating files in HadoopFsRelation

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8037: --- Assignee: Apache Spark (was: Cheng Lian) Ignores files whose name starts with . while

[jira] [Commented] (SPARK-8037) Ignores files whose name starts with . while enumerating files in HadoopFsRelation

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568857#comment-14568857 ] Apache Spark commented on SPARK-8037: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-6988) Fix Spark SQL documentation for 1.3.x

2015-06-02 Thread Saurabh Santhosh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568704#comment-14568704 ] Saurabh Santhosh commented on SPARK-6988: - Hey Can someone update the spark

[jira] [Reopened] (SPARK-8033) spark-sql thriftserver security authorization bugs!

2015-06-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-8033: -- spark-sql thriftserver security authorization bugs! ---

[jira] [Resolved] (SPARK-8033) spark-sql thriftserver security authorization bugs!

2015-06-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8033. -- Resolution: Fixed [~nilone] Please read

[jira] [Created] (SPARK-8038) PySpark SQL when functions is broken on Column

2015-06-02 Thread Olivier Girardot (JIRA)
Olivier Girardot created SPARK-8038: --- Summary: PySpark SQL when functions is broken on Column Key: SPARK-8038 URL: https://issues.apache.org/jira/browse/SPARK-8038 Project: Spark Issue

[jira] [Updated] (SPARK-7893) Complex Operators between Graphs

2015-06-02 Thread Andy Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Huang updated SPARK-7893: -- Description: Currently there are 30+ operators in GraphX, while few of them consider operators between

[jira] [Commented] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

2015-06-02 Thread Nicolas PHUNG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568854#comment-14568854 ] Nicolas PHUNG commented on SPARK-7122: -- For _KafkaUtils.createStream_, jobs take

[jira] [Updated] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-02 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-8032: --- Summary: Make NumPy version checking in mllib/__init__.py (was: Make version checking in

[jira] [Commented] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568679#comment-14568679 ] Apache Spark commented on SPARK-8032: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8032: --- Assignee: Apache Spark Make NumPy version checking in mllib/__init__.py

[jira] [Resolved] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

2015-06-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8023. Resolution: Fixed Fix Version/s: 1.4.0 Random Number Generation inconsistent in projections

[jira] [Created] (SPARK-8033) spark-sql thriftserver security authorization bugs!

2015-06-02 Thread nilone (JIRA)
nilone created SPARK-8033: - Summary: spark-sql thriftserver security authorization bugs! Key: SPARK-8033 URL: https://issues.apache.org/jira/browse/SPARK-8033 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568726#comment-14568726 ] Saisai Shao edited comment on SPARK-4352 at 6/2/15 9:23 AM: Hi

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-02 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568839#comment-14568839 ] Saisai Shao commented on SPARK-4352: Hi [~steve_l], thanks a lot for your suggestions,

[jira] [Updated] (SPARK-8032) Make version checking in mllib/__init__.py

2015-06-02 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-8032: --- Summary: Make version checking in mllib/__init__.py (was: Make version checking in mllib/__init__.py

[jira] [Comment Edited] (SPARK-7680) Add a fake Receiver that generates random strings, useful for prototyping

2015-06-02 Thread Rohith Yeravothula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564815#comment-14564815 ] Rohith Yeravothula edited comment on SPARK-7680 at 6/2/15 8:03 AM:

[jira] [Commented] (SPARK-6988) Fix Spark SQL documentation for 1.3.x

2015-06-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568798#comment-14568798 ] Sean Owen commented on SPARK-6988: -- [~Saurabh Santhosh] This isn't how you report new

[jira] [Resolved] (SPARK-8015) flume-sink should not depend on Guava.

2015-06-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-8015. -- Resolution: Fixed Fix Version/s: 1.4.0 flume-sink should not depend on Guava.

[jira] [Updated] (SPARK-7894) Graph Union Operator

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7894: - Target Version/s: (was: 1.5.0) Graph Union Operator

[jira] [Created] (SPARK-8048) Explicit partitionning of an RDD with 0 partition will yield empty outer join

2015-06-02 Thread Olivier Toupin (JIRA)
Olivier Toupin created SPARK-8048: - Summary: Explicit partitionning of an RDD with 0 partition will yield empty outer join Key: SPARK-8048 URL: https://issues.apache.org/jira/browse/SPARK-8048

[jira] [Commented] (SPARK-7893) Complex Operators between Graphs

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569495#comment-14569495 ] Joseph K. Bradley commented on SPARK-7893: -- [~andyyehoo] I'm removing the target

[jira] [Updated] (SPARK-7958) Failed StreamingContext.start() can leak active actors

2015-06-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7958: - Affects Version/s: (was: 1.4.0) 1.1.1 1.2.2

[jira] [Commented] (SPARK-7541) Check model save/load for MLlib 1.4

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569496#comment-14569496 ] Joseph K. Bradley commented on SPARK-7541: -- Oh, I see. That sounds good to do,

[jira] [Updated] (SPARK-8048) Explicit partitionning of an RDD with 0 partition will yield empty outer join

2015-06-02 Thread Olivier Toupin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Toupin updated SPARK-8048: -- Affects Version/s: 1.3.1 Explicit partitionning of an RDD with 0 partition will yield empty

[jira] [Updated] (SPARK-7958) Failed StreamingContext.start() can leak active actors

2015-06-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7958: - Target Version/s: 1.4.0 (was: 1.4.1) Failed StreamingContext.start() can leak active actors

[jira] [Resolved] (SPARK-7985) Remove fittingParamMap references. Update ML Doc Estimator, Transformer, and Param examples.

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7985. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6514

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-06-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569623#comment-14569623 ] Sandy Ryza commented on SPARK-4352: --- In the case where the task number = executor number

[jira] [Commented] (SPARK-7893) Complex Operators between Graphs

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569490#comment-14569490 ] Joseph K. Bradley commented on SPARK-7893: -- I guess I'm OK with keeping an

[jira] [Updated] (SPARK-7893) Complex Operators between Graphs

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7893: - Issue Type: Umbrella (was: Improvement) Complex Operators between Graphs

[jira] [Updated] (SPARK-7890) Document that Spark 2.11 now supports Kafka

2015-06-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7890: - Fix Version/s: (was: 1.4.1) (was: 1.5.0) 1.4.0

[jira] [Updated] (SPARK-8015) flume-sink should not depend on Guava.

2015-06-02 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8015: - Assignee: Marcelo Vanzin flume-sink should not depend on Guava.

[jira] [Updated] (SPARK-7985) Remove fittingParamMap references. Update ML Doc Estimator, Transformer, and Param examples.

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7985: - Assignee: Mike Dusenberry Remove fittingParamMap references. Update ML Doc Estimator,

[jira] [Updated] (SPARK-7893) Complex Operators between Graphs

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7893: - Target Version/s: (was: 1.5.0) Complex Operators between Graphs

[jira] [Closed] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-06-02 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Williams closed SPARK-5784. Resolution: Not A Problem Add StatsDSink to MetricsSystem ---

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-06-02 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569655#comment-14569655 ] Ryan Williams commented on SPARK-5784: -- [~varvind] seems like no; Spark packages

[jira] [Assigned] (SPARK-8050) Make Savable and Loader Java-friendly.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8050: --- Assignee: Xiangrui Meng (was: Apache Spark) Make Savable and Loader Java-friendly.

[jira] [Commented] (SPARK-7991) Python DataFrame: support passing a list into describe

2015-06-02 Thread Amey Chaugule (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569650#comment-14569650 ] Amey Chaugule commented on SPARK-7991: -- [~rxin] : I'd like to work on this in case

[jira] [Assigned] (SPARK-8049) OneVsRest's output includes a temp column

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8049: --- Assignee: Apache Spark (was: Xiangrui Meng) OneVsRest's output includes a temp column

[jira] [Commented] (SPARK-8049) OneVsRest's output includes a temp column

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569708#comment-14569708 ] Apache Spark commented on SPARK-8049: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-8049) OneVsRest's output includes a temp column

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8049: --- Assignee: Xiangrui Meng (was: Apache Spark) OneVsRest's output includes a temp column

[jira] [Assigned] (SPARK-8050) Make Savable and Loader Java-friendly.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8050: --- Assignee: Apache Spark (was: Xiangrui Meng) Make Savable and Loader Java-friendly.

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-06-02 Thread Greg Senia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569671#comment-14569671 ] Greg Senia commented on SPARK-5159: --- SparkSQLThriftServer does not adhere to

[jira] [Created] (SPARK-8051) StringIndexerModel (and other models) shouldn't complain if the input column is missing.

2015-06-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8051: Summary: StringIndexerModel (and other models) shouldn't complain if the input column is missing. Key: SPARK-8051 URL: https://issues.apache.org/jira/browse/SPARK-8051

[jira] [Resolved] (SPARK-8014) DataFrame.write.mode(error).save(...) should not scan the output folder

2015-06-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8014. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6583

[jira] [Created] (SPARK-8050) Make Savable and Loader Java-friendly.

2015-06-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8050: Summary: Make Savable and Loader Java-friendly. Key: SPARK-8050 URL: https://issues.apache.org/jira/browse/SPARK-8050 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-8049) OneVsRest's output includes a temp column

2015-06-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8049: Summary: OneVsRest's output includes a temp column Key: SPARK-8049 URL: https://issues.apache.org/jira/browse/SPARK-8049 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6164) CrossValidatorModel should keep stats from fitting

2015-06-02 Thread Leah McGuire (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569714#comment-14569714 ] Leah McGuire commented on SPARK-6164: - I fixed the merge conflict. Should be good to

[jira] [Created] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8057: --- Summary: Call TaskAttemptContext.getTaskAttemptID using Reflection Key: SPARK-8057 URL: https://issues.apache.org/jira/browse/SPARK-8057 Project: Spark Issue

[jira] [Updated] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-8057: Affects Version/s: 1.3.1 Call TaskAttemptContext.getTaskAttemptID using Reflection

[jira] [Assigned] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8057: --- Assignee: (was: Apache Spark) Call TaskAttemptContext.getTaskAttemptID using Reflection

[jira] [Commented] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570043#comment-14570043 ] Apache Spark commented on SPARK-8057: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8057: --- Assignee: Apache Spark Call TaskAttemptContext.getTaskAttemptID using Reflection

[jira] [Created] (SPARK-8058) Add tests for SPARK-7853 and SPARK-8020

2015-06-02 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8058: --- Summary: Add tests for SPARK-7853 and SPARK-8020 Key: SPARK-8058 URL: https://issues.apache.org/jira/browse/SPARK-8058 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-8059) Reduce latency between executor requests and RM heartbeat

2015-06-02 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-8059: - Summary: Reduce latency between executor requests and RM heartbeat Key: SPARK-8059 URL: https://issues.apache.org/jira/browse/SPARK-8059 Project: Spark

[jira] [Commented] (SPARK-8040) Remove Debian specific loopback address setting code

2015-06-02 Thread Yuta Kurosaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570093#comment-14570093 ] Yuta Kurosaki commented on SPARK-8040: -- I am sorry that I couldn't explain well. With

[jira] [Created] (SPARK-8055) Spark Launcher Improvements

2015-06-02 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-8055: - Summary: Spark Launcher Improvements Key: SPARK-8055 URL: https://issues.apache.org/jira/browse/SPARK-8055 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-8055) Spark Launcher Improvements

2015-06-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1457#comment-1457 ] Marcelo Vanzin commented on SPARK-8055: --- /cc [~klmarkey]

[jira] [Resolved] (SPARK-8026) Add Column.alias to Scala/Java API

2015-06-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8026. Resolution: Fixed Fix Version/s: 1.4.0 Add Column.alias to Scala/Java API

[jira] [Commented] (SPARK-8059) Reduce latency between executor requests and RM heartbeat

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570073#comment-14570073 ] Apache Spark commented on SPARK-8059: - User 'vanzin' has created a pull request for

[jira] [Created] (SPARK-8056) Design an easier way to construct schema for both Scala and Python

2015-06-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8056: -- Summary: Design an easier way to construct schema for both Scala and Python Key: SPARK-8056 URL: https://issues.apache.org/jira/browse/SPARK-8056 Project: Spark

[jira] [Updated] (SPARK-8049) OneVsRest's output includes a temp column

2015-06-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8049: - Fix Version/s: 1.5.0 1.4.1 OneVsRest's output includes a temp column

[jira] [Commented] (SPARK-7558) Log test name when starting and finishing each test

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570033#comment-14570033 ] Apache Spark commented on SPARK-7558: - User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-8059) Reduce latency between executor requests and RM heartbeat

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8059: --- Assignee: (was: Apache Spark) Reduce latency between executor requests and RM heartbeat

[jira] [Commented] (SPARK-7879) KMeans API for spark.ml Pipelines

2015-06-02 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570089#comment-14570089 ] Yu Ishikawa commented on SPARK-7879: I will implement it. KMeans API for spark.ml

[jira] [Commented] (SPARK-7991) Python DataFrame: support passing a list into describe

2015-06-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569788#comment-14569788 ] Reynold Xin commented on SPARK-7991: Please go ahead. This one should be simple.

[jira] [Created] (SPARK-8053) ElementwiseProduct scalingVec param name should match between ml,mllib

2015-06-02 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-8053: Summary: ElementwiseProduct scalingVec param name should match between ml,mllib Key: SPARK-8053 URL: https://issues.apache.org/jira/browse/SPARK-8053

[jira] [Commented] (SPARK-8054) Java compatibility fixes for MLlib 1.4

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569900#comment-14569900 ] Apache Spark commented on SPARK-8054: - User 'jkbradley' has created a pull request for

[jira] [Resolved] (SPARK-7529) Java compatibility check for MLlib 1.4

2015-06-02 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7529. -- Resolution: Fixed Fix Version/s: 1.4.0 I'm marking this Fixed. Since the PR

[jira] [Commented] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

2015-06-02 Thread Thomas Omans (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569912#comment-14569912 ] Thomas Omans commented on SPARK-2551: - Wanted to chime in since I upgraded parquet re:

[jira] [Assigned] (SPARK-8051) StringIndexerModel (and other models) shouldn't complain if the input column is missing.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8051: --- Assignee: Apache Spark (was: Xiangrui Meng) StringIndexerModel (and other models)

[jira] [Commented] (SPARK-8051) StringIndexerModel (and other models) shouldn't complain if the input column is missing.

2015-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569796#comment-14569796 ] Apache Spark commented on SPARK-8051: - User 'mengxr' has created a pull request for

  1   2   3   >