[jira] [Created] (SPARK-9845) Add built-in UDF

2015-08-11 Thread Alex Liu (JIRA)
Alex Liu created SPARK-9845: --- Summary: Add built-in UDF Key: SPARK-9845 URL: https://issues.apache.org/jira/browse/SPARK-9845 Project: Spark Issue Type: Improvement Components: SQL

[jira] [Created] (SPARK-9847) ML Params copyValues should copy default values to default map, not set map

2015-08-11 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9847: Summary: ML Params copyValues should copy default values to default map, not set map Key: SPARK-9847 URL: https://issues.apache.org/jira/browse/SPARK-9847

[jira] [Updated] (SPARK-9816) Support BinaryType in Concat

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9816: --- Target Version/s: 1.6.0 Support BinaryType in Concat

[jira] [Resolved] (SPARK-8925) Add @since tags to mllib.util

2015-08-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8925. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7436

[jira] [Updated] (SPARK-8925) Add @since tags to mllib.util

2015-08-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8925: - Assignee: Sudhakar Thota Add @since tags to mllib.util -

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2015-08-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692293#comment-14692293 ] Yin Huai commented on SPARK-9740: - Actually, seems our old first/last functions do not

[jira] [Created] (SPARK-9848) Add @since tag to new public APIs in 1.5

2015-08-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9848: Summary: Add @since tag to new public APIs in 1.5 Key: SPARK-9848 URL: https://issues.apache.org/jira/browse/SPARK-9848 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9848) Add @since tag to new public APIs in 1.5

2015-08-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9848: - Labels: starter (was: ) Add @since tag to new public APIs in 1.5

[jira] [Updated] (SPARK-9848) Add @since tag to new public APIs in 1.5

2015-08-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9848: - Issue Type: Sub-task (was: Documentation) Parent: SPARK-7751 Add @since tag to new

[jira] [Commented] (SPARK-7751) Add @since to stable and experimental methods in MLlib

2015-08-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692303#comment-14692303 ] Xiangrui Meng commented on SPARK-7751: -- This issue is addressed in SPARK-8967. We

[jira] [Assigned] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8971: --- Assignee: Seth Hendrickson (was: Apache Spark) Support balanced class labels when

[jira] [Commented] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-08-11 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692312#comment-14692312 ] Seth Hendrickson commented on SPARK-8971: - I went ahead and created the PR for

[jira] [Commented] (SPARK-8967) Implement @since as an annotation

2015-08-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692318#comment-14692318 ] Xiangrui Meng commented on SPARK-8967: -- One example is `deprecated` annotation in

[jira] [Created] (SPARK-9846) User guide for Multilayer Perceptron Classifier

2015-08-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9846: Summary: User guide for Multilayer Perceptron Classifier Key: SPARK-9846 URL: https://issues.apache.org/jira/browse/SPARK-9846 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-9814) EqualNotNull not passing to data sources

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9814. Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 1.5.0 EqualNotNull not

[jira] [Resolved] (SPARK-9824) Internal Accumulators will leak WeakReferences

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9824. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 Internal

[jira] [Updated] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9776: - Priority: Major (was: Blocker) [~sthota] Blocker is for committers to set. This does not rise to that

[jira] [Updated] (SPARK-9789) Reinstate LogisticRegression threshold Param

2015-08-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9789: - Shepherd: DB Tsai Reinstate LogisticRegression threshold Param

[jira] [Resolved] (SPARK-9788) LDA docConcentration, gammaShape 1.5 binary incompatibility fixes

2015-08-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9788. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8077

[jira] [Commented] (SPARK-7454) Perf test for power iteration clustering (PIC)

2015-08-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692299#comment-14692299 ] Joseph K. Bradley commented on SPARK-7454: -- If you won't have time, please say so

[jira] [Updated] (SPARK-9848) Add @since tag to new public APIs in 1.5

2015-08-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9848: - Description: We should get a list of new APIs from SPARK-9660. cc: [~fliang] Add @since tag to

[jira] [Assigned] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8971: --- Assignee: Apache Spark (was: Seth Hendrickson) Support balanced class labels when

[jira] [Commented] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692309#comment-14692309 ] Apache Spark commented on SPARK-8971: - User 'sethah' has created a pull request for

[jira] [Commented] (SPARK-7751) Add @since to stable and experimental methods in MLlib

2015-08-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692316#comment-14692316 ] Joseph K. Bradley commented on SPARK-7751: -- OK I guess we just need to be more

[jira] [Updated] (SPARK-9850) Adaptive execution in Spark

2015-08-11 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-9850: - Assignee: Yin Huai Adaptive execution in Spark ---

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-11 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692600#comment-14692600 ] Yu Ishikawa commented on SPARK-9427: [~shivaram] After all, I'd like to split this

[jira] [Updated] (SPARK-9407) Parquet shouldn't fail when pushing down predicates over a column whose underlying Parquet type is an ENUM

2015-08-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9407: -- Summary: Parquet shouldn't fail when pushing down predicates over a column whose underlying Parquet

[jira] [Resolved] (SPARK-7165) Sort Merge Join for outer joins

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7165. Resolution: Fixed Fix Version/s: 1.5.0 Sort Merge Join for outer joins

[jira] [Updated] (SPARK-9730) Sort Merge Join for Full Outer Join

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9730: --- Parent Issue: SPARK-9697 (was: SPARK-7165) Sort Merge Join for Full Outer Join

[jira] [Updated] (SPARK-9730) Sort Merge Join for Full Outer Join

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9730: --- Target Version/s: 1.6.0 (was: 1.5.0) Sort Merge Join for Full Outer Join

[jira] [Updated] (SPARK-9730) Sort Merge Join for Full Outer Join

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9730: --- Assignee: (was: Josh Rosen) Sort Merge Join for Full Outer Join

[jira] [Updated] (SPARK-9730) Sort Merge Join for Full Outer Join

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9730: --- Target Version/s: 1.5.0 Sort Merge Join for Full Outer Join ---

[jira] [Issue Comment Deleted] (SPARK-9829) peakExecutionMemory is not correct

2015-08-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-9829: Comment: was deleted (was: How many tasks? peakExecutionMemory in Web UI is the sum of

[jira] [Updated] (SPARK-9849) DirectParquetOutputCommitter qualified name should be backward compatible

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9849: --- Description: DirectParquetOutputCommitter was moved in SPARK-9763. However, users can explicitly set

[jira] [Updated] (SPARK-9849) DirectParquetOutputCommitter qualified name should be backward compatible

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9849: --- Summary: DirectParquetOutputCommitter qualified name should be backward compatible (was:

[jira] [Updated] (SPARK-9849) DirectParquetOutputCommitter qualified name should be backward compatible

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9849: --- Description: DirectParquetOutputCommitter was moved in SPARK-9763. However, users can explicitly set

[jira] [Assigned] (SPARK-9740) first/last aggregate NULL behavior

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9740: --- Assignee: Yin Huai (was: Apache Spark) first/last aggregate NULL behavior

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692392#comment-14692392 ] Apache Spark commented on SPARK-9740: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-9740) first/last aggregate NULL behavior

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9740: --- Assignee: Apache Spark (was: Yin Huai) first/last aggregate NULL behavior

[jira] [Assigned] (SPARK-9849) DirectParquetOutputCommitter qualified name should be backward compatible

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9849: --- Assignee: Reynold Xin (was: Apache Spark) DirectParquetOutputCommitter qualified name

[jira] [Assigned] (SPARK-9849) DirectParquetOutputCommitter qualified name should be backward compatible

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9849: --- Assignee: Apache Spark (was: Reynold Xin) DirectParquetOutputCommitter qualified name

[jira] [Commented] (SPARK-9849) DirectParquetOutputCommitter qualified name should be backward compatible

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692402#comment-14692402 ] Apache Spark commented on SPARK-9849: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9847) ML Params copyValues should copy default values to default map, not set map

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9847: --- Assignee: Apache Spark (was: Joseph K. Bradley) ML Params copyValues should copy default

[jira] [Assigned] (SPARK-9847) ML Params copyValues should copy default values to default map, not set map

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9847: --- Assignee: Joseph K. Bradley (was: Apache Spark) ML Params copyValues should copy default

[jira] [Commented] (SPARK-9847) ML Params copyValues should copy default values to default map, not set map

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692422#comment-14692422 ] Apache Spark commented on SPARK-9847: - User 'jkbradley' has created a pull request for

[jira] [Commented] (SPARK-7454) Perf test for power iteration clustering (PIC)

2015-08-11 Thread Stephen Boesch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692437#comment-14692437 ] Stephen Boesch commented on SPARK-7454: --- Hi, I had intended to clean this up in the

[jira] [Commented] (SPARK-9827) Too many open files in TungstenExchange

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692441#comment-14692441 ] Apache Spark commented on SPARK-9827: - User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-9640) Do not run Python Kinesis tests when the Kinesis assembly JAR has not been generated

2015-08-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9640. -- Resolution: Fixed Fix Version/s: 1.5.0 Do not run Python Kinesis tests when the Kinesis

[jira] [Comment Edited] (SPARK-8824) Support Parquet logical types TIMESTAMP_MILLIS and TIMESTAMP_MICROS

2015-08-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681331#comment-14681331 ] Cheng Lian edited comment on SPARK-8824 at 8/11/15 6:55 AM: Oh

[jira] [Commented] (SPARK-8824) Support Parquet logical types TIMESTAMP_MILLIS and TIMESTAMP_MICROS

2015-08-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681331#comment-14681331 ] Cheng Lian commented on SPARK-8824: --- Oh sorry, I mistook your request for

[jira] [Resolved] (SPARK-9802) spark configuration page should mention spark.executor.cores yarn property

2015-08-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9802. -- Resolution: Not A Problem It's documented already, but in the latest docs:

[jira] [Resolved] (SPARK-9727) Make the Kinesis project SBT name and consistent with other streaming projects

2015-08-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9727. -- Resolution: Fixed Fix Version/s: 1.5.0 Make the Kinesis project SBT name and consistent

[jira] [Assigned] (SPARK-9818) Revert 6136, use docker to test JDBC datasources

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9818: --- Assignee: Apache Spark Revert 6136, use docker to test JDBC datasources

[jira] [Assigned] (SPARK-9814) EqualNotNull not passing to data sources

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9814: --- Assignee: (was: Apache Spark) EqualNotNull not passing to data sources

[jira] [Issue Comment Deleted] (SPARK-9814) EqualNotNull not passing to data sources

2015-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-9814: Comment: was deleted (was: I just made it. https://github.com/apache/spark/pull/8096)

[jira] [Commented] (SPARK-9814) EqualNotNull not passing to data sources

2015-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681294#comment-14681294 ] Hyukjin Kwon commented on SPARK-9814: - I just made it :) EqualNotNull not passing to

[jira] [Updated] (SPARK-8757) Check missing and add user guide for MLlib Python API

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-8757: --- Description: Some MLlib algorithm missing user guide for Python, we need to check and add them. The

[jira] [Commented] (SPARK-9818) Revert 6136, use docker to test JDBC datasources

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681560#comment-14681560 ] Apache Spark commented on SPARK-9818: - User 'yjshen' has created a pull request for

[jira] [Commented] (SPARK-6136) Docker client library introduces Guava 17.0, which causes runtime binary incompatibilities

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681561#comment-14681561 ] Apache Spark commented on SPARK-6136: - User 'yjshen' has created a pull request for

[jira] [Assigned] (SPARK-9818) Revert 6136, use docker to test JDBC datasources

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9818: --- Assignee: (was: Apache Spark) Revert 6136, use docker to test JDBC datasources

[jira] [Assigned] (SPARK-9814) EqualNotNull not passing to data sources

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9814: --- Assignee: Apache Spark EqualNotNull not passing to data sources

[jira] [Commented] (SPARK-9814) EqualNotNull not passing to data sources

2015-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681293#comment-14681293 ] Hyukjin Kwon commented on SPARK-9814: - I just made it.

[jira] [Commented] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681493#comment-14681493 ] Yanbo Liang commented on SPARK-9663: [~josephkb] I have finished the check, link the

[jira] [Updated] (SPARK-9818) Revert 6136, use docker to test JDBC datasources

2015-08-11 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijie Shen updated SPARK-9818: -- Description: (was: https://issues.apache.org/jira/browse/SPARK-6136) Revert 6136, use docker to

[jira] [Updated] (SPARK-9818) Revert 6136, use docker to test JDBC datasources

2015-08-11 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijie Shen updated SPARK-9818: -- External issue ID: (was: 6136) Revert 6136, use docker to test JDBC datasources

[jira] [Updated] (SPARK-9818) Revert 6136, use docker to test JDBC datasources

2015-08-11 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijie Shen updated SPARK-9818: -- External issue ID: 6136 Revert 6136, use docker to test JDBC datasources

[jira] [Resolved] (SPARK-9810) Remove individual commit messages from the squash commit message

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9810. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 (was: 1.6.0)

[jira] [Created] (SPARK-9817) Improve the container placement strategy by considering the localities of pending container requests

2015-08-11 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-9817: -- Summary: Improve the container placement strategy by considering the localities of pending container requests Key: SPARK-9817 URL: https://issues.apache.org/jira/browse/SPARK-9817

[jira] [Issue Comment Deleted] (SPARK-8757) Check missing and add user guide for MLlib Python API

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-8757: --- Comment: was deleted (was: [~josephkb] Yes, Some of those items do have sections and need updates. I

[jira] [Commented] (SPARK-8757) Check missing and add user guide for MLlib Python API

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681536#comment-14681536 ] Yanbo Liang commented on SPARK-8757: [~josephkb] Yes, Some of those items do have

[jira] [Commented] (SPARK-8757) Check missing and add user guide for MLlib Python API

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681537#comment-14681537 ] Yanbo Liang commented on SPARK-8757: [~josephkb] Yes, Some of those items do have

[jira] [Commented] (SPARK-9814) EqualNotNull not passing to data sources

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681291#comment-14681291 ] Apache Spark commented on SPARK-9814: - User 'HyukjinKwon' has created a pull request

[jira] [Commented] (SPARK-9814) EqualNotNull not passing to data sources

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681289#comment-14681289 ] Reynold Xin commented on SPARK-9814: [~hyukjin.kwon] would you like to submit a patch

[jira] [Comment Edited] (SPARK-9813) Incorrect UNION ALL behavior

2015-08-11 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681326#comment-14681326 ] Simeon Simeonov edited comment on SPARK-9813 at 8/11/15 6:47 AM:

[jira] [Resolved] (SPARK-9076) Improve NaN value handling

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9076. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: (was: ) Improve NaN

[jira] [Closed] (SPARK-3059) Spark internal module interface design

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-3059. -- Resolution: Later Closing this one since I'm not sure whether it is useful to have a long-term JIRA

[jira] [Closed] (SPARK-2456) Scheduler refactoring

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-2456. -- Resolution: Later Closing this one since I'm not sure whether it is useful to have a long-term JIRA

[jira] [Commented] (SPARK-8824) Support Parquet logical types TIMESTAMP_MILLIS and TIMESTAMP_MICROS

2015-08-11 Thread Konstantin Shaposhnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681418#comment-14681418 ] Konstantin Shaposhnikov commented on SPARK-8824: Ok, thank you for the

[jira] [Closed] (SPARK-9770) Add Python API for ml.feature.DCT

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang closed SPARK-9770. -- Resolution: Duplicate Add Python API for ml.feature.DCT -

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Created] (SPARK-9816) Support BinaryType in Concat

2015-08-11 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-9816: --- Summary: Support BinaryType in Concat Key: SPARK-9816 URL: https://issues.apache.org/jira/browse/SPARK-9816 Project: Spark Issue Type: Improvement

[jira] [Closed] (SPARK-9771) Add Python API for ml.feature.MinMaxScaler

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang closed SPARK-9771. -- Resolution: Duplicate Add Python API for ml.feature.MinMaxScaler

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Updated] (SPARK-9148) User-facing documentation for NaN handling semantics

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9148: --- Parent Issue: SPARK-9565 (was: SPARK-9076) User-facing documentation for NaN handling semantics

[jira] [Commented] (SPARK-8361) Session of ThriftServer is still alive after I exit beeline

2015-08-11 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681525#comment-14681525 ] Weizhong commented on SPARK-8361: - On SparkSQLSessionManager only override the

[jira] [Commented] (SPARK-9816) Support BinaryType in Concat

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681524#comment-14681524 ] Apache Spark commented on SPARK-9816: - User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-9816) Support BinaryType in Concat

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9816: --- Assignee: (was: Apache Spark) Support BinaryType in Concat

[jira] [Assigned] (SPARK-9816) Support BinaryType in Concat

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9816: --- Assignee: Apache Spark Support BinaryType in Concat

[jira] [Updated] (SPARK-9810) Remove individual commit messages from the squash commit message

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9810: --- Target Version/s: 1.6.0 (was: 1.5.0) Fix Version/s: (was: 1.5.0)

[jira] [Commented] (SPARK-9636) Treat $SPARK_HOME as write-only

2015-08-11 Thread Philipp Angerer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681403#comment-14681403 ] Philipp Angerer commented on SPARK-9636: OK, great :) I see why you think my

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681473#comment-14681473 ] Sean Owen commented on SPARK-9776: -- Yeah I see the same. I don't know enough about

[jira] [Commented] (SPARK-9816) Support BinaryType in Concat

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681531#comment-14681531 ] Apache Spark commented on SPARK-9816: - User 'maropu' has created a pull request for

[jira] [Updated] (SPARK-8757) Check missing and add user guide for MLlib Python API

2015-08-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-8757: --- Description: Some MLlib algorithm missing user guide for Python, we need to check and add them. The

[jira] [Assigned] (SPARK-9817) Improve the container placement strategy by considering the localities of pending container requests

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9817: --- Assignee: (was: Apache Spark) Improve the container placement strategy by considering

[jira] [Assigned] (SPARK-9817) Improve the container placement strategy by considering the localities of pending container requests

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9817: --- Assignee: Apache Spark Improve the container placement strategy by considering the

[jira] [Commented] (SPARK-9817) Improve the container placement strategy by considering the localities of pending container requests

2015-08-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681556#comment-14681556 ] Apache Spark commented on SPARK-9817: - User 'jerryshao' has created a pull request for

[jira] [Updated] (SPARK-9809) Task crashes because the internal accumulators are not properly initialized

2015-08-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9809: --- Description: When a stage failed and another stage was resubmitted with only part of partitions to

[jira] [Commented] (SPARK-9813) Incorrect UNION ALL behavior

2015-08-11 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681326#comment-14681326 ] Simeon Simeonov commented on SPARK-9813: [~hvanhovell] Oracle requires the number

[jira] [Comment Edited] (SPARK-9813) Incorrect UNION ALL behavior

2015-08-11 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681326#comment-14681326 ] Simeon Simeonov edited comment on SPARK-9813 at 8/11/15 6:46 AM:

[jira] [Commented] (SPARK-8724) Need documentation on how to deploy or use SparkR in Spark 1.4.0+

2015-08-11 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681427#comment-14681427 ] Vincent Warmerdam commented on SPARK-8724: -- [~shivaram] [~felixcheung] does this

  1   2   3   4   >