[jira] [Created] (SPARK-12904) Strength reduction for integer/decimal comparisons

Reynold Xin created SPARK-12904: --- Summary: Strength reduction for integer/decimal comparisons Key: SPARK-12904 URL: https://issues.apache.org/jira/browse/SPARK-12904 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12904) Strength reduction for integer/decimal comparisons

[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106436#comment-15106436 ] Reynold Xin commented on SPARK-12904: - [~viirya] maybe you can add this when you have a chance.

[jira] [Updated] (SPARK-12905) PCAModel return eigenvalues for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12905: Priority: Minor (was: Trivial) > PCAModel return eigenvalues for PySpark >

[jira] [Updated] (SPARK-12905) PCAModel return eigenvalues for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12905: Priority: Trivial (was: Minor) > PCAModel return eigenvalues for PySpark >

[jira] [Created] (SPARK-12905) PCAModel return eigenvalues for PySpark

Yanbo Liang created SPARK-12905: --- Summary: PCAModel return eigenvalues for PySpark Key: SPARK-12905 URL: https://issues.apache.org/jira/browse/SPARK-12905 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12905) PCAModel return eigenvalues for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12905: Assignee: (was: Apache Spark) > PCAModel return eigenvalues for PySpark >

[jira] [Commented] (SPARK-12905) PCAModel return eigenvalues for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106444#comment-15106444 ] Apache Spark commented on SPARK-12905: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12905) PCAModel return eigenvalues for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12905: Assignee: Apache Spark > PCAModel return eigenvalues for PySpark >

[jira] [Commented] (SPARK-12897) spark ui with tachyon show all Stream Blocks

[ https://issues.apache.org/jira/browse/SPARK-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106458#comment-15106458 ] Sean Owen commented on SPARK-12897: --- It's not clear what you're describing. Can you say more? I am also

[jira] [Resolved] (SPARK-12876) Race condition when driver rapidly shutdown after started.

[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12876. --- Resolution: Duplicate > Race condition when driver rapidly shutdown after started. >

[jira] [Updated] (SPARK-12848) Parse number as decimal rather than doubles

[ https://issues.apache.org/jira/browse/SPARK-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12848: Summary: Parse number as decimal rather than doubles (was: Parse number as decimal) > Parse

[jira] [Updated] (SPARK-12848) Parse numbers as decimals rather than doubles

[ https://issues.apache.org/jira/browse/SPARK-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12848: Summary: Parse numbers as decimals rather than doubles (was: Parse number as decimal rather than

[jira] [Updated] (SPARK-12904) Strength reduction for integer/decimal comparisons

[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12904: Description: We can do the following strength reduction for comparisons between an integral

[jira] [Commented] (SPARK-12892) Support plugging in Spark scheduler

[ https://issues.apache.org/jira/browse/SPARK-12892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106471#comment-15106471 ] Sean Owen commented on SPARK-12892: --- Do you intend some of the same stuff described in

[jira] [Commented] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106548#comment-15106548 ] Sasi commented on SPARK-12906: -- Hi, I'm running endless script that does query on my table using SqlSpark. I

[jira] [Assigned] (SPARK-12903) Add covar_samp and covar_pop for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12903: Assignee: Apache Spark > Add covar_samp and covar_pop for SparkR >

[jira] [Commented] (SPARK-12903) Add covar_samp and covar_pop for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106422#comment-15106422 ] Apache Spark commented on SPARK-12903: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12903) Add covar_samp and covar_pop for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12903: Assignee: (was: Apache Spark) > Add covar_samp and covar_pop for SparkR >

[jira] [Created] (SPARK-12903) Add covar_samp and covar_pop for SparkR

Yanbo Liang created SPARK-12903: --- Summary: Add covar_samp and covar_pop for SparkR Key: SPARK-12903 URL: https://issues.apache.org/jira/browse/SPARK-12903 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12904) Strength reduction for integer/decimal comparisons

[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106491#comment-15106491 ] Liang-Chi Hsieh commented on SPARK-12904: - Yeah. I would like to do. Thanks! > Strength

[jira] [Assigned] (SPARK-7683) Confusing behavior of fold function of RDD in pyspark

[ https://issues.apache.org/jira/browse/SPARK-7683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-7683: Assignee: Sean Owen > Confusing behavior of fold function of RDD in pyspark >

[jira] [Resolved] (SPARK-7683) Confusing behavior of fold function of RDD in pyspark

[ https://issues.apache.org/jira/browse/SPARK-7683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7683. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10771

[jira] [Created] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

Sasi created SPARK-12906: Summary: LongSQLMetricValue cause memory leak on Spark 1.5.1 Key: SPARK-12906 URL: https://issues.apache.org/jira/browse/SPARK-12906 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sasi updated SPARK-12906: - Attachment: screenshot-1.png > LongSQLMetricValue cause memory leak on Spark 1.5.1 >

[jira] [Commented] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106498#comment-15106498 ] Sean Owen commented on SPARK-12906: --- Please provide more detail. What leads you to think there's a

[jira] [Commented] (SPARK-9976) create function do not work

[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106517#comment-15106517 ] ocean commented on SPARK-9976: -- the second problem I just found that only function can not describe, but

[jira] [Commented] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106596#comment-15106596 ] Sasi commented on SPARK-12906: -- added dumps > LongSQLMetricValue cause memory leak on Spark 1.5.1 >

[jira] [Updated] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sasi updated SPARK-12906: - Attachment: dump1.PNG After GC. > LongSQLMetricValue cause memory leak on Spark 1.5.1 >

[jira] [Issue Comment Deleted] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sasi updated SPARK-12906: - Comment: was deleted (was: added dumps ) > LongSQLMetricValue cause memory leak on Spark 1.5.1 >

[jira] [Comment Edited] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106599#comment-15106599 ] Sasi edited comment on SPARK-12906 at 1/19/16 11:14 AM: added dump After GC.

[jira] [Comment Edited] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106599#comment-15106599 ] Sasi edited comment on SPARK-12906 at 1/19/16 11:12 AM: added dump After GC.

[jira] [Resolved] (SPARK-12560) SqlTestUtils.stripSparkFilter needs to copy utf8strings

[ https://issues.apache.org/jira/browse/SPARK-12560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12560. Resolution: Fixed Assignee: Imran Rashid Resolved by

[jira] [Assigned] (SPARK-12910) Support for specifying version of R to use while creating sparkR libraries

[ https://issues.apache.org/jira/browse/SPARK-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12910: Assignee: (was: Apache Spark) > Support for specifying version of R to use while

[jira] [Updated] (SPARK-12560) SqlTestUtils.stripSparkFilter needs to copy utf8strings

[ https://issues.apache.org/jira/browse/SPARK-12560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12560: --- Fix Version/s: 2.0.0 > SqlTestUtils.stripSparkFilter needs to copy utf8strings >

[jira] [Assigned] (SPARK-12910) Support for specifying version of R to use while creating sparkR libraries

[ https://issues.apache.org/jira/browse/SPARK-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12910: Assignee: Apache Spark > Support for specifying version of R to use while creating sparkR

[jira] [Commented] (SPARK-12910) Support for specifying version of R to use while creating sparkR libraries

[ https://issues.apache.org/jira/browse/SPARK-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107370#comment-15107370 ] Shubhanshu Mishra commented on SPARK-12910: --- I have created a pull request at

[jira] [Commented] (SPARK-12869) Optimize conversion from BlockMatrix to IndexedRowMatrix

[ https://issues.apache.org/jira/browse/SPARK-12869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107534#comment-15107534 ] Apache Spark commented on SPARK-12869: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12869) Optimize conversion from BlockMatrix to IndexedRowMatrix

[ https://issues.apache.org/jira/browse/SPARK-12869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12869: Assignee: (was: Apache Spark) > Optimize conversion from BlockMatrix to

[jira] [Commented] (SPARK-12869) Optimize conversion from BlockMatrix to IndexedRowMatrix

[ https://issues.apache.org/jira/browse/SPARK-12869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107533#comment-15107533 ] Fokko Driesprong commented on SPARK-12869: -- Hi guys, I've implemented an improved version of

[jira] [Assigned] (SPARK-12869) Optimize conversion from BlockMatrix to IndexedRowMatrix

[ https://issues.apache.org/jira/browse/SPARK-12869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12869: Assignee: Apache Spark > Optimize conversion from BlockMatrix to IndexedRowMatrix >

[jira] [Assigned] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12479: Assignee: (was: Apache Spark) > sparkR collect on GroupedData throws R error

[jira] [Assigned] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12479: Assignee: Apache Spark > sparkR collect on GroupedData throws R error "missing value

[jira] [Updated] (SPARK-11295) Add packages to JUnit output for Python tests

[ https://issues.apache.org/jira/browse/SPARK-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11295: -- Assignee: Gabor Liptak > Add packages to JUnit output for Python tests >

[jira] [Updated] (SPARK-11295) Add packages to JUnit output for Python tests

[ https://issues.apache.org/jira/browse/SPARK-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11295: -- Target Version/s: 2.0.0 > Add packages to JUnit output for Python tests >

[jira] [Updated] (SPARK-11295) Add packages to JUnit output for Python tests

[ https://issues.apache.org/jira/browse/SPARK-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11295: -- Component/s: PySpark > Add packages to JUnit output for Python tests >

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107526#comment-15107526 ] Apache Spark commented on SPARK-6166: - User 'redsanket' has created a pull request for this issue:

[jira] [Commented] (SPARK-12845) During join Spark should pushdown predicates on joining column to both tables

[ https://issues.apache.org/jira/browse/SPARK-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107603#comment-15107603 ] Xiao Li commented on SPARK-12845: - Let me know if you hit any bug. Thanks! > During join Spark should

[jira] [Commented] (SPARK-12910) Support for specifying version of R to use while creating sparkR libraries

[ https://issues.apache.org/jira/browse/SPARK-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107369#comment-15107369 ] Apache Spark commented on SPARK-12910: -- User 'napsternxg' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10777) order by fails when column is aliased and projection includes windowed aggregate

[ https://issues.apache.org/jira/browse/SPARK-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10777: Assignee: Apache Spark > order by fails when column is aliased and projection includes

[jira] [Assigned] (SPARK-10777) order by fails when column is aliased and projection includes windowed aggregate

[ https://issues.apache.org/jira/browse/SPARK-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10777: Assignee: (was: Apache Spark) > order by fails when column is aliased and projection

[jira] [Commented] (SPARK-10777) order by fails when column is aliased and projection includes windowed aggregate

[ https://issues.apache.org/jira/browse/SPARK-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107434#comment-15107434 ] Apache Spark commented on SPARK-10777: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Resolved] (SPARK-9716) BinaryClassificationEvaluator should accept Double prediction column

[ https://issues.apache.org/jira/browse/SPARK-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9716. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10472

[jira] [Updated] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-6166: - Assignee: (was: Shixiong Zhu) > Add config to limit number of concurrent outbound connections

[jira] [Created] (SPARK-12912) Add test suite for EliminateSubQueries

Reynold Xin created SPARK-12912: --- Summary: Add test suite for EliminateSubQueries Key: SPARK-12912 URL: https://issues.apache.org/jira/browse/SPARK-12912 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12912) Add test suite for EliminateSubQueries

[ https://issues.apache.org/jira/browse/SPARK-12912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107606#comment-15107606 ] Apache Spark commented on SPARK-12912: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12912) Add test suite for EliminateSubQueries

[ https://issues.apache.org/jira/browse/SPARK-12912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12912: Assignee: Reynold Xin (was: Apache Spark) > Add test suite for EliminateSubQueries >

[jira] [Assigned] (SPARK-12912) Add test suite for EliminateSubQueries

[ https://issues.apache.org/jira/browse/SPARK-12912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12912: Assignee: Apache Spark (was: Reynold Xin) > Add test suite for EliminateSubQueries >

[jira] [Resolved] (SPARK-2750) Add Https support for Web UI

[ https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-2750. --- Resolution: Fixed Assignee: Fei Wang Fix Version/s: 2.0.0 > Add Https support

[jira] [Resolved] (SPARK-11295) Add packages to JUnit output for Python tests

[ https://issues.apache.org/jira/browse/SPARK-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11295. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9263

[jira] [Commented] (SPARK-12845) During join Spark should pushdown predicates on joining column to both tables

[ https://issues.apache.org/jira/browse/SPARK-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107600#comment-15107600 ] Xiao Li commented on SPARK-12845: - I think the following PR resolves your issue:

[jira] [Created] (SPARK-12910) Support for specifying version of R to use while creating sparkR libraries

Shubhanshu Mishra created SPARK-12910: - Summary: Support for specifying version of R to use while creating sparkR libraries Key: SPARK-12910 URL: https://issues.apache.org/jira/browse/SPARK-12910

[jira] [Resolved] (SPARK-12816) Schema generation for type aliases does not work

[ https://issues.apache.org/jira/browse/SPARK-12816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12816. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10749

[jira] [Created] (SPARK-12911) Cacheing a dataframe causes array comparisons to fail (in filter / where) after 1.6

Jesse English created SPARK-12911: - Summary: Cacheing a dataframe causes array comparisons to fail (in filter / where) after 1.6 Key: SPARK-12911 URL: https://issues.apache.org/jira/browse/SPARK-12911

[jira] [Updated] (SPARK-12790) Remove HistoryServer old multiple files format

[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12790: -- Assignee: Felix Cheung > Remove HistoryServer old multiple files format >

[jira] [Commented] (SPARK-12790) Remove HistoryServer old multiple files format

[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107167#comment-15107167 ] Andrew Or commented on SPARK-12790: --- also updating all the tests that rely on the old format. If you

[jira] [Commented] (SPARK-12790) Remove HistoryServer old multiple files format

[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107169#comment-15107169 ] Andrew Or commented on SPARK-12790: --- I've assigned this to you. > Remove HistoryServer old multiple

[jira] [Assigned] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12907: Assignee: (was: Apache Spark) > Use BitSet to represent null fields in ColumnVector >

[jira] [Assigned] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12907: Assignee: Apache Spark > Use BitSet to represent null fields in ColumnVector >

[jira] [Resolved] (SPARK-12887) Do not expose var's in TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-12887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12887. --- Resolution: Fixed Fix Version/s: 2.0.0 > Do not expose var's in TaskMetrics >

[jira] [Commented] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107200#comment-15107200 ] Apache Spark commented on SPARK-12907: -- User 'kiszk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12804) ml.classification.LogisticRegression fails when FitIntercept with same-label dataset

[ https://issues.apache.org/jira/browse/SPARK-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-12804. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10743

[jira] [Assigned] (SPARK-12895) Implement TaskMetrics using accumulators

[ https://issues.apache.org/jira/browse/SPARK-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12895: Assignee: Apache Spark (was: Andrew Or) > Implement TaskMetrics using accumulators >

[jira] [Assigned] (SPARK-12895) Implement TaskMetrics using accumulators

[ https://issues.apache.org/jira/browse/SPARK-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12895: Assignee: Andrew Or (was: Apache Spark) > Implement TaskMetrics using accumulators >

[jira] [Resolved] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11944. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10150

[jira] [Commented] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107151#comment-15107151 ] Andrew Or commented on SPARK-12485: --- [~srowen] to answer your question no I don't feel super strongly

[jira] [Resolved] (SPARK-12870) better format bucket id in file name

[ https://issues.apache.org/jira/browse/SPARK-12870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12870. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10799

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107267#comment-15107267 ] Mark Grover commented on SPARK-12177: - Thanks Mario! bq. We should also have a

[jira] [Created] (SPARK-12907) Use BitSet to represent null fields in ColumnVector

Kazuaki Ishizaki created SPARK-12907: Summary: Use BitSet to represent null fields in ColumnVector Key: SPARK-12907 URL: https://issues.apache.org/jira/browse/SPARK-12907 Project: Spark

[jira] [Commented] (SPARK-12906) LongSQLMetricValue cause memory leak on Spark 1.5.1

[ https://issues.apache.org/jira/browse/SPARK-12906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107203#comment-15107203 ] Josh Rosen commented on SPARK-12906: Ping [~zsxwing], since I know you've looked into similar leaks

[jira] [Commented] (SPARK-12895) Implement TaskMetrics using accumulators

[ https://issues.apache.org/jira/browse/SPARK-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107358#comment-15107358 ] Apache Spark commented on SPARK-12895: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Updated] (SPARK-12870) better format bucket id in file name

[ https://issues.apache.org/jira/browse/SPARK-12870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12870: - Assignee: Wenchen Fan > better format bucket id in file name > > >

[jira] [Closed] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12485. --- Resolution: Won't Fix I talked to Andrew more offline. Looks like this name isn't so bad that we

[jira] [Created] (SPARK-12908) Add tests to make sure that ml.classification.LogisticRegression returns meaningful result when labels are the same without intercept

DB Tsai created SPARK-12908: --- Summary: Add tests to make sure that ml.classification.LogisticRegression returns meaningful result when labels are the same without intercept Key: SPARK-12908 URL:

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107061#comment-15107061 ] John Vines commented on SPARK-12650: SPARK_SUBMIT_OPTS seems to work. -Xmx256m changed the heap

[jira] [Commented] (SPARK-12783) Dataset map serialization error

[ https://issues.apache.org/jira/browse/SPARK-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107178#comment-15107178 ] Wenchen Fan commented on SPARK-12783: - hi [~babloo80], can you move `MyMap` and `TestCaseClass` to

[jira] [Updated] (SPARK-12908) Add tests to make sure that ml.classification.LogisticRegression returns meaningful result when labels are the same without intercept

[ https://issues.apache.org/jira/browse/SPARK-12908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-12908: Description: This will be only adding new tests as followup PR to

[jira] [Commented] (SPARK-12883) 1.6 Dynamic allocation document for removing executors with cached data differs in different sections

[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107085#comment-15107085 ] Saisai Shao commented on SPARK-12883: - I get your point now. But I think these two descriptions are

[jira] [Commented] (SPARK-12883) 1.6 Dynamic allocation document for removing executors with cached data differs in different sections

[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107057#comment-15107057 ] Manoj Samel commented on SPARK-12883: - Updated Jira subject for more accurate reflection of the issue

[jira] [Updated] (SPARK-12826) Spark Workers do not attempt reconnect or exit on connection failure.

[ https://issues.apache.org/jira/browse/SPARK-12826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-12826: - Priority: Critical (was: Major) > Spark Workers do not attempt reconnect or exit on

[jira] [Commented] (SPARK-12546) Writing to partitioned parquet table can fail with OOM

[ https://issues.apache.org/jira/browse/SPARK-12546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107258#comment-15107258 ] Nong Li commented on SPARK-12546: - A better workaround might be to figure the max number of concurrent

[jira] [Resolved] (SPARK-12867) Nullability of Intersect can be stricter

[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12867. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10812

[jira] [Created] (SPARK-12909) Spark on Mesos accessing Secured HDFS w/Kerberos

Greg Senia created SPARK-12909: -- Summary: Spark on Mesos accessing Secured HDFS w/Kerberos Key: SPARK-12909 URL: https://issues.apache.org/jira/browse/SPARK-12909 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-12797) Aggregation without grouping keys

[ https://issues.apache.org/jira/browse/SPARK-12797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12797: Assignee: Apache Spark > Aggregation without grouping keys >

[jira] [Resolved] (SPARK-12770) Implement rules for branch elimination for CaseWhen in SimplifyConditionals

[ https://issues.apache.org/jira/browse/SPARK-12770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12770. - Resolution: Fixed Fix Version/s: 2.0.0 > Implement rules for branch elimination for

[jira] [Updated] (SPARK-12168) Need test for conflicted function in R

[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12168: -- Assignee: Felix Cheung > Need test for conflicted function in R >

[jira] [Resolved] (SPARK-12168) Need test for conflicted function in R

[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12168. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12898) Consider having dummyCallSite for HiveTableScan

[ https://issues.apache.org/jira/browse/SPARK-12898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-12898: - Attachment: callsiteProf.png > Consider having dummyCallSite for HiveTableScan >

[jira] [Commented] (SPARK-12864) initialize executorIdCounter after ApplicationMaster killed for max number of executor failures reached

[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107859#comment-15107859 ] iward commented on SPARK-12864: --- The important point of the idea is to fix this conflict executor id. As

[jira] [Commented] (SPARK-12669) Organize options for default values

[ https://issues.apache.org/jira/browse/SPARK-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107887#comment-15107887 ] Mohit Jaggi commented on SPARK-12669: - hmm...wouldn't it be good to have a typesafe API as well in

[jira] [Created] (SPARK-12913) Reimplement all builtin aggregate functions as declarative function

Davies Liu created SPARK-12913: -- Summary: Reimplement all builtin aggregate functions as declarative function Key: SPARK-12913 URL: https://issues.apache.org/jira/browse/SPARK-12913 Project: Spark

  1   2   >