[jira] [Updated] (SPARK-9493) Chain logistic regression with isotonic regression under the pipeline API

2015-08-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9493: - Shepherd: Joseph K. Bradley Chain logistic regression with isotonic regression under the

[jira] [Resolved] (SPARK-9540) Optimize PrefixSpan implementation

2015-08-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9540. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7937

[jira] [Updated] (SPARK-8231) complex function: array_contains

2015-08-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8231: -- Assignee: (was: Cheng Hao) complex function: array_contains

[jira] [Resolved] (SPARK-8231) complex function: array_contains

2015-08-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8231. --- Resolution: Fixed Assignee: Pedro Rodriguez Fix Version/s: 1.5.0 complex function:

[jira] [Updated] (SPARK-9427) Add expression functions in SparkR

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9427: --- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-8159) Add expression functions in

[jira] [Updated] (SPARK-9541) DateTimeUtils cleanup

2015-08-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9541: -- Assignee: Yijie Shen DateTimeUtils cleanup - Key: SPARK-9541

[jira] [Updated] (SPARK-9427) Add expression functions in SparkR

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9427: --- Issue Type: New Feature (was: Bug) Add expression functions in SparkR

[jira] [Updated] (SPARK-9208) Audit DataFrame expression API for 1.5 release

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9208: --- Parent Issue: SPARK-9565 (was: SPARK-8159) Audit DataFrame expression API for 1.5 release

[jira] [Updated] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9526: --- Parent Issue: SPARK-9565 (was: SPARK-8159) Utilize randomized tests to reveal potential bugs in sql

[jira] [Resolved] (SPARK-8159) Improve expression function coverage (Spark 1.5)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8159. Resolution: Fixed Fix Version/s: 1.5.0 Improve expression function coverage (Spark 1.5)

[jira] [Updated] (SPARK-9565) Spark SQL 1.5.0 QA/testing umbrella

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9565: --- Summary: Spark SQL 1.5.0 QA/testing umbrella (was: Spark SQL 1.5.0 testing umbrella) Spark SQL

[jira] [Updated] (SPARK-6591) Python data source load options should auto convert common types into strings

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6591: --- Sprint: Spark 1.5 release Python data source load options should auto convert common types into

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket (Spark 1.5)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6116: --- Sprint: Spark 1.5 release DataFrame API improvement umbrella ticket (Spark 1.5)

[jira] [Updated] (SPARK-6906) Improve Hive integration support

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6906: --- Issue Type: Story (was: Bug) Improve Hive integration support

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket (Spark 1.5)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6116: --- Sprint: Spark 1.5 doc/QA sprint (was: Spark 1.5 release) DataFrame API improvement umbrella ticket

[jira] [Updated] (SPARK-6906) Improve Hive integration support

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6906: --- Issue Type: Epic (was: Story) Improve Hive integration support

[jira] [Updated] (SPARK-9131) Python UDFs change data values

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9131: --- Sprint: Spark 1.5 doc/QA sprint Python UDFs change data values --

[jira] [Closed] (SPARK-9131) Python UDFs change data values

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9131. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 (was: 1.4.2, 1.5.0)

[jira] [Updated] (SPARK-9131) Python UDFs change data values

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9131: --- Sprint: Spark 1.5 release (was: Spark 1.5 doc/QA sprint) Python UDFs change data values

[jira] [Updated] (SPARK-9424) Document recent Parquet changes in Spark 1.5

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9424: --- Sprint: Spark 1.5 doc/QA sprint Document recent Parquet changes in Spark 1.5

[jira] [Updated] (SPARK-9581) Add test for JSON UDTs

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9581: --- Sprint: Spark 1.5 release Add test for JSON UDTs -- Key:

[jira] [Updated] (SPARK-9616) Erroneous result in Frequent Items (SQL) when merging FrequentItemCounters

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9616: --- Sprint: Spark 1.5 release Erroneous result in Frequent Items (SQL) when merging FrequentItemCounters

[jira] [Updated] (SPARK-9616) Erroneous result in Frequent Items (SQL) when merging FrequentItemCounters

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9616: --- Assignee: Burak Yavuz Erroneous result in Frequent Items (SQL) when merging FrequentItemCounters

[jira] [Updated] (SPARK-8108) Build Hive module by default (i.e. remove -Phive profile)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8108: --- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-6906) Build Hive module by default

[jira] [Updated] (SPARK-8108) Build Hive module by default (i.e. remove -Phive profile)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8108: --- Priority: Major (was: Blocker) Build Hive module by default (i.e. remove -Phive profile)

[jira] [Updated] (SPARK-8108) Build Hive module by default (i.e. remove -Phive profile)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8108: --- Issue Type: Improvement (was: Bug) Build Hive module by default (i.e. remove -Phive profile)

[jira] [Updated] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9486: --- Sprint: Spark 1.5 release Add aliasing to data sources to allow external packages to register

[jira] [Updated] (SPARK-6906) Improve Hive integration support

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6906: --- Epic Name: test Issue Type: Umbrella (was: Epic) Improve Hive integration support

[jira] [Updated] (SPARK-6906) Improve Hive integration support

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6906: --- Issue Type: Story (was: Umbrella) Improve Hive integration support

[jira] [Updated] (SPARK-9412) Support records larger than a page size

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9412: --- Target Version/s: 1.6.0 (was: 1.5.0) Support records larger than a page size

[jira] [Resolved] (SPARK-7119) ScriptTransform doesn't consider the output data type

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7119. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6638

[jira] [Updated] (SPARK-7178) Improve DataFrame documentation and code samples

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7178: --- Sprint: Spark 1.5 doc/QA sprint Improve DataFrame documentation and code samples

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket (Spark 1.5)

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6116: Sprint: (was: Spark 1.5 doc/QA sprint) DataFrame API improvement umbrella ticket (Spark

[jira] [Updated] (SPARK-6831) Document how to use external data sources

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6831: --- Sprint: Spark 1.5 doc/QA sprint Document how to use external data sources

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket (Spark 1.5)

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6116: Sprint: Spark 1.5 doc/QA sprint DataFrame API improvement umbrella ticket (Spark 1.5)

[jira] [Created] (SPARK-9624) Make RateControllerSuite faster and more robust

2015-08-04 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9624: Summary: Make RateControllerSuite faster and more robust Key: SPARK-9624 URL: https://issues.apache.org/jira/browse/SPARK-9624 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9453) Support records larger than default page size in UnsafeExternalShuffleSorter

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9453: --- Target Version/s: 1.6.0 Support records larger than default page size in UnsafeExternalShuffleSorter

[jira] [Updated] (SPARK-9208) Audit DataFrame expression API for 1.5 release

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9208: Issue Type: Technical task (was: Sub-task) Audit DataFrame expression API for 1.5 release

[jira] [Updated] (SPARK-6831) Document how to use external data sources

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6831: Issue Type: Documentation (was: Improvement) Document how to use external data sources

[jira] [Resolved] (SPARK-6923) Spark SQL CLI does not read Data Source schema correctly

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6923. - Resolution: Duplicate Spark SQL CLI does not read Data Source schema correctly

[jira] [Assigned] (SPARK-9624) Make RateControllerSuite faster and more robust

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9624: --- Assignee: Apache Spark (was: Tathagata Das) Make RateControllerSuite faster and more

[jira] [Assigned] (SPARK-9624) Make RateControllerSuite faster and more robust

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9624: --- Assignee: Tathagata Das (was: Apache Spark) Make RateControllerSuite faster and more

[jira] [Commented] (SPARK-9624) Make RateControllerSuite faster and more robust

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654728#comment-14654728 ] Apache Spark commented on SPARK-9624: - User 'tdas' has created a pull request for this

[jira] [Commented] (SPARK-9604) Unsafe ArrayData and MapData is very very slow

2015-08-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654696#comment-14654696 ] Wenchen Fan commented on SPARK-9604: there is a known issue:

[jira] [Updated] (SPARK-9619) BlockGenerator should not receive data even after it has been stopped

2015-08-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9619: - Summary: BlockGenerator should not receive data even after it has been stopped (was: Restarting

[jira] [Updated] (SPARK-9046) Decimal type support improvement and bug fix

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9046: --- Sprint: Spark 1.5 release Decimal type support improvement and bug fix

[jira] [Updated] (SPARK-9619) Rename Receiver.executor to Receiver.supervisor

2015-08-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9619: - Summary: Rename Receiver.executor to Receiver.supervisor (was: BlockGenerator should not

[jira] [Updated] (SPARK-9046) Decimal type support improvement and bug fix

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9046: --- Assignee: Davies Liu Decimal type support improvement and bug fix

[jira] [Updated] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7550: Sprint: Spark 1.5 release Support setting the right schema serde when writing to Hive

[jira] [Updated] (SPARK-6923) Spark SQL CLI does not read Data Source schema correctly

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6923: Sprint: Spark 1.5 release Spark SQL CLI does not read Data Source schema correctly

[jira] [Created] (SPARK-9615) Use rdd.aggregate in FrequentItems

2015-08-04 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-9615: -- Summary: Use rdd.aggregate in FrequentItems Key: SPARK-9615 URL: https://issues.apache.org/jira/browse/SPARK-9615 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9567) Setup branch-1.5 testing on Jenkins

2015-08-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654381#comment-14654381 ] Josh Rosen commented on SPARK-9567: --- Technically I suppose that we also need to setup

[jira] [Created] (SPARK-9619) Restarting the receiver's BlockGenerator does clear previous data

2015-08-04 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9619: Summary: Restarting the receiver's BlockGenerator does clear previous data Key: SPARK-9619 URL: https://issues.apache.org/jira/browse/SPARK-9619 Project: Spark

[jira] [Created] (SPARK-9623) RandomForestRegressor: provide variance of predictions

2015-08-04 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9623: Summary: RandomForestRegressor: provide variance of predictions Key: SPARK-9623 URL: https://issues.apache.org/jira/browse/SPARK-9623 Project: Spark

[jira] [Assigned] (SPARK-9608) Incorrect zinc -status check in build/mvn

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9608: --- Assignee: (was: Apache Spark) Incorrect zinc -status check in build/mvn

[jira] [Assigned] (SPARK-9608) Incorrect zinc -status check in build/mvn

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9608: --- Assignee: Apache Spark Incorrect zinc -status check in build/mvn

[jira] [Created] (SPARK-9618) SQLContext.read.schema().parquet() ignores the supplied schema

2015-08-04 Thread Nathan Howell (JIRA)
Nathan Howell created SPARK-9618: Summary: SQLContext.read.schema().parquet() ignores the supplied schema Key: SPARK-9618 URL: https://issues.apache.org/jira/browse/SPARK-9618 Project: Spark

[jira] [Updated] (SPARK-9611) UnsafeFixedWidthAggregationMap.destructAndCreateExternalSorter will add an empty entry to if the map is empty.

2015-08-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9611: Description: There are two corner cases related to the destructAndCreateExternalSorter (class

[jira] [Updated] (SPARK-7210) Test matrix decompositions for speed vs. numerical stability for Gaussians

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7210: - Assignee: Feynman Liang Test matrix decompositions for speed vs. numerical stability for

[jira] [Commented] (SPARK-7210) Test matrix decompositions for speed vs. numerical stability for Gaussians

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654516#comment-14654516 ] Joseph K. Bradley commented on SPARK-7210: -- For record-keeping, I'm going to

[jira] [Updated] (SPARK-6485) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

2015-08-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6485: - Assignee: Mike Dusenberry Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

[jira] [Resolved] (SPARK-6485) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

2015-08-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6485. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7554

[jira] [Created] (SPARK-9614) InternalRow representation during executionPlan.toRdd.aggregete possibly problematic

2015-08-04 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-9614: -- Summary: InternalRow representation during executionPlan.toRdd.aggregete possibly problematic Key: SPARK-9614 URL: https://issues.apache.org/jira/browse/SPARK-9614

[jira] [Assigned] (SPARK-9567) Setup branch-1.5 testing on Jenkins

2015-08-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-9567: - Assignee: Josh Rosen Setup branch-1.5 testing on Jenkins ---

[jira] [Resolved] (SPARK-9567) Setup branch-1.5 testing on Jenkins

2015-08-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9567. --- Resolution: Fixed Setup branch-1.5 testing on Jenkins ---

[jira] [Commented] (SPARK-9567) Setup branch-1.5 testing on Jenkins

2015-08-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654378#comment-14654378 ] Josh Rosen commented on SPARK-9567: --- This is done: *Compile builders* Pre-yarn:

[jira] [Updated] (SPARK-9602) Remove 'Actor' from the comments

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9602: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-5293 Remove 'Actor' from the comments

[jira] [Assigned] (SPARK-9617) Implement json_tuple

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9617: --- Assignee: Apache Spark Implement json_tuple Key:

[jira] [Assigned] (SPARK-9617) Implement json_tuple

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9617: --- Assignee: (was: Apache Spark) Implement json_tuple

[jira] [Commented] (SPARK-9617) Implement json_tuple

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654429#comment-14654429 ] Apache Spark commented on SPARK-9617: - User 'NathanHowell' has created a pull request

[jira] [Assigned] (SPARK-9618) SQLContext.read.schema().parquet() ignores the supplied schema

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9618: --- Assignee: Apache Spark SQLContext.read.schema().parquet() ignores the supplied schema

[jira] [Commented] (SPARK-9618) SQLContext.read.schema().parquet() ignores the supplied schema

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654465#comment-14654465 ] Apache Spark commented on SPARK-9618: - User 'NathanHowell' has created a pull request

[jira] [Assigned] (SPARK-9618) SQLContext.read.schema().parquet() ignores the supplied schema

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9618: --- Assignee: (was: Apache Spark) SQLContext.read.schema().parquet() ignores the supplied

[jira] [Resolved] (SPARK-9582) LDA cleanups

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9582. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7916

[jira] [Created] (SPARK-9620) generated UnsafeProjection does not support many columns or large exressions

2015-08-04 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9620: - Summary: generated UnsafeProjection does not support many columns or large exressions Key: SPARK-9620 URL: https://issues.apache.org/jira/browse/SPARK-9620 Project: Spark

[jira] [Assigned] (SPARK-9611) UnsafeFixedWidthAggregationMap.destructAndCreateExternalSorter will add an empty entry to if the map is empty.

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9611: --- Assignee: Apache Spark (was: Yin Huai)

[jira] [Updated] (SPARK-8514) LU factorization on BlockMatrix

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8514: - Target Version/s: 1.6.0 (was: 1.5.0) LU factorization on BlockMatrix

[jira] [Resolved] (SPARK-9598) do not expose generic getter in internal row

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9598. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 do not expose generic

[jira] [Commented] (SPARK-9357) Remove JoinedRow

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654350#comment-14654350 ] Apache Spark commented on SPARK-9357: - User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9482: --- Assignee: Apache Spark (was: Davies Liu) flaky test:

[jira] [Assigned] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9482: --- Assignee: Davies Liu (was: Apache Spark) flaky test:

[jira] [Commented] (SPARK-9608) Incorrect zinc -status check in build/mvn

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654386#comment-14654386 ] Apache Spark commented on SPARK-9608: - User 'ryan-williams' has created a pull request

[jira] [Assigned] (SPARK-9607) Incorrect zinc check in build/mvn

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9607: --- Assignee: Apache Spark Incorrect zinc check in build/mvn -

[jira] [Commented] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654385#comment-14654385 ] Apache Spark commented on SPARK-9482: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-9607) Incorrect zinc check in build/mvn

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654384#comment-14654384 ] Apache Spark commented on SPARK-9607: - User 'ryan-williams' has created a pull request

[jira] [Assigned] (SPARK-9607) Incorrect zinc check in build/mvn

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9607: --- Assignee: (was: Apache Spark) Incorrect zinc check in build/mvn

[jira] [Updated] (SPARK-9609) Spelling error in Strategy.defaultStrategy

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9609: - Shepherd: Joseph K. Bradley Assignee: Feynman Liang Component/s: (was:

[jira] [Assigned] (SPARK-9611) UnsafeFixedWidthAggregationMap.destructAndCreateExternalSorter will add an empty entry to if the map is empty.

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9611: --- Assignee: Yin Huai (was: Apache Spark)

[jira] [Commented] (SPARK-9611) UnsafeFixedWidthAggregationMap.destructAndCreateExternalSorter will add an empty entry to if the map is empty.

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654490#comment-14654490 ] Apache Spark commented on SPARK-9611: - User 'yhuai' has created a pull request for

[jira] [Updated] (SPARK-9619) Restarting the receiver's BlockGenerator does not clear previously buffered data

2015-08-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9619: - Summary: Restarting the receiver's BlockGenerator does not clear previously buffered data (was:

[jira] [Updated] (SPARK-5989) Model import/export for LDAModel

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5989: - Description: Add save/load for LDAModel and its local and distributed variants. LDA

[jira] [Assigned] (SPARK-9357) Remove JoinedRow

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9357: --- Assignee: (was: Apache Spark) Remove JoinedRow Key:

[jira] [Commented] (SPARK-9439) ExternalShuffleService should be robust to NodeManager restarts in yarn

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654376#comment-14654376 ] Apache Spark commented on SPARK-9439: - User 'squito' has created a pull request for

[jira] [Commented] (SPARK-9614) InternalRow representation during executionPlan.toRdd.aggregete possibly problematic

2015-08-04 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654402#comment-14654402 ] Burak Yavuz commented on SPARK-9614: cc [~joshrosen] InternalRow representation

[jira] [Commented] (SPARK-9569) Spark streaming 1.5.0 testing umbrella

2015-08-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654404#comment-14654404 ] Josh Rosen commented on SPARK-9569: --- We should make sure to include the memory leak

[jira] [Resolved] (SPARK-9452) Support records larger than default page size in UnsafeExternalSorter

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9452. Resolution: Fixed Fix Version/s: 1.5.0 Support records larger than default page size in

[jira] [Commented] (SPARK-8231) complex function: array_contains

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654508#comment-14654508 ] Apache Spark commented on SPARK-8231: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-9621) Closure inside RDD doesn't properly close over environment

2015-08-04 Thread Joe Near (JIRA)
Joe Near created SPARK-9621: --- Summary: Closure inside RDD doesn't properly close over environment Key: SPARK-9621 URL: https://issues.apache.org/jira/browse/SPARK-9621 Project: Spark Issue Type:

[jira] [Created] (SPARK-9622) DecisionTreeRegressor: provide variance of prediction

2015-08-04 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9622: Summary: DecisionTreeRegressor: provide variance of prediction Key: SPARK-9622 URL: https://issues.apache.org/jira/browse/SPARK-9622 Project: Spark

[jira] [Assigned] (SPARK-9357) Remove JoinedRow

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9357: --- Assignee: Apache Spark Remove JoinedRow Key: SPARK-9357

<    1   2   3   >