[jira] [Commented] (SPARK-25464) Dropping database can remove the hive warehouse directory contents

[ https://issues.apache.org/jira/browse/SPARK-25464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624467#comment-16624467 ] sandeep katta commented on SPARK-25464: --- Yes I agree 2 database should not point to same

[jira] [Updated] (SPARK-25511) Map with "null" key not working in spark 2.3

[ https://issues.apache.org/jira/browse/SPARK-25511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Shankar updated SPARK-25511: - Description: I had a use case where i was creating a histogram of column values through a UDAF

[jira] [Commented] (SPARK-25351) Handle Pandas category type when converting from Python with Arrow

[ https://issues.apache.org/jira/browse/SPARK-25351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624323#comment-16624323 ] Pooja Gadige commented on SPARK-25351: -- Hello! I'm working on this issue. Should we handle the

[jira] [Created] (SPARK-25511) Map with "null" key not working in spark 2.3

Ravi Shankar created SPARK-25511: Summary: Map with "null" key not working in spark 2.3 Key: SPARK-25511 URL: https://issues.apache.org/jira/browse/SPARK-25511 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-24523) InterruptedException when closing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624231#comment-16624231 ] Ankur Gupta commented on SPARK-24523: - That is concerning actually. You should also see the

[jira] [Comment Edited] (SPARK-24523) InterruptedException when closing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624202#comment-16624202 ] Umayr Hassan edited comment on SPARK-24523 at 9/21/18 9:30 PM: --- [~irashid]

[jira] [Commented] (SPARK-24523) InterruptedException when closing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624202#comment-16624202 ] Umayr Hassan commented on SPARK-24523: -- [~irashid] The event logs are written to HDFS. 

[jira] [Updated] (SPARK-25322) ML, Graph 2.4 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25322: -- Priority: Critical (was: Blocker) > ML, Graph 2.4 QA: API: Experimental, DeveloperApi,

[jira] [Commented] (SPARK-25319) Spark MLlib, GraphX 2.4 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-25319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624124#comment-16624124 ] Xiangrui Meng commented on SPARK-25319: --- [~WeichenXu123] Could you check the OPEN subtasks and see

[jira] [Assigned] (SPARK-25326) ML, Graph 2.4 QA: Programming guide update and migration guide

[ https://issues.apache.org/jira/browse/SPARK-25326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25326: - Assignee: (was: Nick Pentreath) > ML, Graph 2.4 QA: Programming guide update and

[jira] [Assigned] (SPARK-25325) ML, Graph 2.4 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-25325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25325: - Assignee: (was: Nick Pentreath) > ML, Graph 2.4 QA: Update user guide for new

[jira] [Assigned] (SPARK-25327) Update MLlib, GraphX websites for 2.4

[ https://issues.apache.org/jira/browse/SPARK-25327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25327: - Assignee: (was: Nick Pentreath) > Update MLlib, GraphX websites for 2.4 >

[jira] [Resolved] (SPARK-25327) Update MLlib, GraphX websites for 2.4

[ https://issues.apache.org/jira/browse/SPARK-25327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-25327. --- Resolution: Won't Do > Update MLlib, GraphX websites for 2.4 >

[jira] [Assigned] (SPARK-25322) ML, Graph 2.4 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25322: - Assignee: (was: Nick Pentreath) > ML, Graph 2.4 QA: API: Experimental,

[jira] [Commented] (SPARK-25323) ML 2.4 QA: API: Python API coverage

[ https://issues.apache.org/jira/browse/SPARK-25323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624123#comment-16624123 ] Xiangrui Meng commented on SPARK-25323: --- [~WeichenXu123] anyone is working on this? I reduced the

[jira] [Updated] (SPARK-25323) ML 2.4 QA: API: Python API coverage

[ https://issues.apache.org/jira/browse/SPARK-25323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25323: -- Priority: Critical (was: Blocker) > ML 2.4 QA: API: Python API coverage >

[jira] [Assigned] (SPARK-25323) ML 2.4 QA: API: Python API coverage

[ https://issues.apache.org/jira/browse/SPARK-25323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25323: - Assignee: (was: Bryan Cutler) > ML 2.4 QA: API: Python API coverage >

[jira] [Resolved] (SPARK-25324) ML 2.4 QA: API: Java compatibility, docs

[ https://issues.apache.org/jira/browse/SPARK-25324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-25324. --- Resolution: Done > ML 2.4 QA: API: Java compatibility, docs >

[jira] [Commented] (SPARK-25324) ML 2.4 QA: API: Java compatibility, docs

[ https://issues.apache.org/jira/browse/SPARK-25324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624122#comment-16624122 ] Xiangrui Meng commented on SPARK-25324: --- See discussion in

[jira] [Assigned] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-25321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25321: - Assignee: Weichen Xu (was: Yanbo Liang) > ML, Graph 2.4 QA: API: New Scala APIs, docs

[jira] [Assigned] (SPARK-25320) ML, Graph 2.4 QA: API: Binary incompatible changes

[ https://issues.apache.org/jira/browse/SPARK-25320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25320: - Assignee: Weichen Xu (was: Bago Amirbekian) > ML, Graph 2.4 QA: API: Binary

[jira] [Commented] (SPARK-25320) ML, Graph 2.4 QA: API: Binary incompatible changes

[ https://issues.apache.org/jira/browse/SPARK-25320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624116#comment-16624116 ] Xiangrui Meng commented on SPARK-25320: --- We will keep "predict()" change because it only breaks

[jira] [Resolved] (SPARK-25320) ML, Graph 2.4 QA: API: Binary incompatible changes

[ https://issues.apache.org/jira/browse/SPARK-25320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-25320. --- Resolution: Fixed > ML, Graph 2.4 QA: API: Binary incompatible changes >

[jira] [Commented] (SPARK-25320) ML, Graph 2.4 QA: API: Binary incompatible changes

[ https://issues.apache.org/jira/browse/SPARK-25320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624115#comment-16624115 ] Xiangrui Meng commented on SPARK-25320: --- We revert the tree Node incompatible change and one LDA

[jira] [Resolved] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-25321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-25321. --- Resolution: Fixed Issue resolved by pull request 22510

[jira] [Assigned] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-25321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25321: Assignee: Apache Spark (was: Yanbo Liang) > ML, Graph 2.4 QA: API: New Scala APIs, docs

[jira] [Assigned] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-25321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25321: Assignee: Yanbo Liang (was: Apache Spark) > ML, Graph 2.4 QA: API: New Scala APIs, docs

[jira] [Reopened] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-25321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reopened SPARK-25321: --- > ML, Graph 2.4 QA: API: New Scala APIs, docs > --- > >

[jira] [Resolved] (SPARK-25321) ML, Graph 2.4 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-25321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-25321. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22492

[jira] [Commented] (SPARK-24523) InterruptedException when closing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624046#comment-16624046 ] Ankur Gupta commented on SPARK-24523: - You are correct [~irashid], it seems

[jira] [Assigned] (SPARK-25510) Create new trait replace BenchmarkWithCodegen

[ https://issues.apache.org/jira/browse/SPARK-25510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25510: Assignee: Apache Spark > Create new trait replace BenchmarkWithCodegen >

[jira] [Assigned] (SPARK-25510) Create new trait replace BenchmarkWithCodegen

[ https://issues.apache.org/jira/browse/SPARK-25510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25510: Assignee: (was: Apache Spark) > Create new trait replace BenchmarkWithCodegen >

[jira] [Commented] (SPARK-25510) Create new trait replace BenchmarkWithCodegen

[ https://issues.apache.org/jira/browse/SPARK-25510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623962#comment-16623962 ] Apache Spark commented on SPARK-25510: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-25510) Create new trait replace BenchmarkWithCodegen

[ https://issues.apache.org/jira/browse/SPARK-25510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25510: Summary: Create new trait replace BenchmarkWithCodegen (was: Create new BenchmarkWithCodegen

[jira] [Created] (SPARK-25510) Create new BenchmarkWithCodegen trait doesn't extends SparkFunSuite

Yuming Wang created SPARK-25510: --- Summary: Create new BenchmarkWithCodegen trait doesn't extends SparkFunSuite Key: SPARK-25510 URL: https://issues.apache.org/jira/browse/SPARK-25510 Project: Spark

[jira] [Commented] (SPARK-24519) MapStatus has 2000 hardcoded

[ https://issues.apache.org/jira/browse/SPARK-24519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623924#comment-16623924 ] Apache Spark commented on SPARK-24519: -- User 'rxin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications.

[ https://issues.apache.org/jira/browse/SPARK-25409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Tang resolved SPARK-25409. --- Resolution: Won't Fix > Speed up Spark History at start if there are tens of thousands of >

[jira] [Commented] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications.

[ https://issues.apache.org/jira/browse/SPARK-25409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623919#comment-16623919 ] Rong Tang commented on SPARK-25409: --- Close this JIRA. As  

[jira] [Commented] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support.

[ https://issues.apache.org/jira/browse/SPARK-25509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623898#comment-16623898 ] Apache Spark commented on SPARK-25509: -- User 'jianjianjiao' has created a pull request for this

[jira] [Assigned] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support.

[ https://issues.apache.org/jira/browse/SPARK-25509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25509: Assignee: Apache Spark > SHS V2 cannot enabled in Windows, because POSIX permissions is

[jira] [Assigned] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support.

[ https://issues.apache.org/jira/browse/SPARK-25509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25509: Assignee: (was: Apache Spark) > SHS V2 cannot enabled in Windows, because POSIX

[jira] [Commented] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support.

[ https://issues.apache.org/jira/browse/SPARK-25509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623896#comment-16623896 ] Apache Spark commented on SPARK-25509: -- User 'jianjianjiao' has created a pull request for this

[jira] [Updated] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support.

[ https://issues.apache.org/jira/browse/SPARK-25509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Tang updated SPARK-25509: -- Description: SHS V2 cannot enabled in Windoes, because windows doesn't support POSIX permission. 

[jira] [Created] (SPARK-25509) SHS V2 cannot enabled in Windows, because POSIX permissions is not support.

Rong Tang created SPARK-25509: - Summary: SHS V2 cannot enabled in Windows, because POSIX permissions is not support. Key: SPARK-25509 URL: https://issues.apache.org/jira/browse/SPARK-25509 Project: Spark

[jira] [Assigned] (SPARK-25477) “INSERT OVERWRITE LOCAL DIRECTORY”， the data files allocated on the non-driver node will not be written to the specified output directory

[ https://issues.apache.org/jira/browse/SPARK-25477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25477: Assignee: Apache Spark > “INSERT OVERWRITE LOCAL DIRECTORY”， the data files allocated on

[jira] [Assigned] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25374: Assignee: (was: Apache Spark) > SafeProjection supports fallback to an interpreted

[jira] [Assigned] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25374: Assignee: Apache Spark > SafeProjection supports fallback to an interpreted mode >

[jira] [Assigned] (SPARK-25477) “INSERT OVERWRITE LOCAL DIRECTORY”， the data files allocated on the non-driver node will not be written to the specified output directory

[ https://issues.apache.org/jira/browse/SPARK-25477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25477: Assignee: (was: Apache Spark) > “INSERT OVERWRITE LOCAL DIRECTORY”， the data files

[jira] [Commented] (SPARK-25449) Don't send zero accumulators in heartbeats

[ https://issues.apache.org/jira/browse/SPARK-25449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623876#comment-16623876 ] Apache Spark commented on SPARK-25449: -- User 'mukulmurthy' has created a pull request for this

[jira] [Commented] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623878#comment-16623878 ] Apache Spark commented on SPARK-25374: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-25477) “INSERT OVERWRITE LOCAL DIRECTORY”， the data files allocated on the non-driver node will not be written to the specified output directory

[ https://issues.apache.org/jira/browse/SPARK-25477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623877#comment-16623877 ] Apache Spark commented on SPARK-25477: -- User 'httfighter' has created a pull request for this

[jira] [Assigned] (SPARK-25449) Don't send zero accumulators in heartbeats

[ https://issues.apache.org/jira/browse/SPARK-25449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25449: Assignee: (was: Apache Spark) > Don't send zero accumulators in heartbeats >

[jira] [Assigned] (SPARK-25449) Don't send zero accumulators in heartbeats

[ https://issues.apache.org/jira/browse/SPARK-25449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25449: Assignee: Apache Spark > Don't send zero accumulators in heartbeats >

[jira] [Assigned] (SPARK-25483) Refactor UnsafeArrayDataBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25483: Assignee: (was: Apache Spark) > Refactor UnsafeArrayDataBenchmark to use main method

[jira] [Assigned] (SPARK-25476) Refactor AggregateBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25476: Assignee: Apache Spark > Refactor AggregateBenchmark to use main method >

[jira] [Assigned] (SPARK-25492) Refactor WideSchemaBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25492: Assignee: (was: Apache Spark) > Refactor WideSchemaBenchmark to use main method >

[jira] [Commented] (SPARK-25417) ArrayContains function may return incorrect result when right expression is implicitly down casted

[ https://issues.apache.org/jira/browse/SPARK-25417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623875#comment-16623875 ] Apache Spark commented on SPARK-25417: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications.

[ https://issues.apache.org/jira/browse/SPARK-25409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25409: Assignee: (was: Apache Spark) > Speed up Spark History at start if there are tens of

[jira] [Assigned] (SPARK-25478) Refactor CompressionSchemeBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25478: Assignee: (was: Apache Spark) > Refactor CompressionSchemeBenchmark to use main

[jira] [Commented] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications.

[ https://issues.apache.org/jira/browse/SPARK-25409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623874#comment-16623874 ] Apache Spark commented on SPARK-25409: -- User 'jianjianjiao' has created a pull request for this

[jira] [Assigned] (SPARK-25409) Speed up Spark History at start if there are tens of thousands of applications.

[ https://issues.apache.org/jira/browse/SPARK-25409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25409: Assignee: Apache Spark > Speed up Spark History at start if there are tens of thousands

[jira] [Assigned] (SPARK-25483) Refactor UnsafeArrayDataBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25483: Assignee: Apache Spark > Refactor UnsafeArrayDataBenchmark to use main method >

[jira] [Assigned] (SPARK-25476) Refactor AggregateBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25476: Assignee: (was: Apache Spark) > Refactor AggregateBenchmark to use main method >

[jira] [Assigned] (SPARK-25478) Refactor CompressionSchemeBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25478: Assignee: Apache Spark > Refactor CompressionSchemeBenchmark to use main method >

[jira] [Assigned] (SPARK-25492) Refactor WideSchemaBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25492: Assignee: Apache Spark > Refactor WideSchemaBenchmark to use main method >

[jira] [Assigned] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20937: Assignee: Apache Spark > Describe spark.sql.parquet.writeLegacyFormat property in Spark

[jira] [Assigned] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20937: Assignee: (was: Apache Spark) > Describe spark.sql.parquet.writeLegacyFormat

[jira] [Commented] (SPARK-23779) TaskMemoryManager and UnsafeSorter use MemoryBlock

[ https://issues.apache.org/jira/browse/SPARK-23779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623869#comment-16623869 ] Apache Spark commented on SPARK-23779: -- User 'kiszk' has created a pull request for this issue:

[jira] [Commented] (SPARK-23763) OffHeapColumnVector uses MemoryBlock

[ https://issues.apache.org/jira/browse/SPARK-23763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623867#comment-16623867 ] Apache Spark commented on SPARK-23763: -- User 'kiszk' has created a pull request for this issue:

[jira] [Commented] (SPARK-25425) Extra options must overwrite sessions options

[ https://issues.apache.org/jira/browse/SPARK-25425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623834#comment-16623834 ] Apache Spark commented on SPARK-25425: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-25508) Refactor OrcReadBenchmark to use main method

yucai created SPARK-25508: - Summary: Refactor OrcReadBenchmark to use main method Key: SPARK-25508 URL: https://issues.apache.org/jira/browse/SPARK-25508 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-18082) Locality Sensitive Hashing (LSH) - SignRandomProjection

[ https://issues.apache.org/jira/browse/SPARK-18082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623832#comment-16623832 ] Sean Owen commented on SPARK-18082: --- >From the linked JIRA, is this talking about LSH that

[jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623799#comment-16623799 ] Xiao Li commented on SPARK-24499: - ping [~XuanYuan] Any update? > Documentation improvement of Spark

[jira] [Updated] (SPARK-25179) Document the features that require Pyarrow 0.10

[ https://issues.apache.org/jira/browse/SPARK-25179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25179: Issue Type: Sub-task (was: Documentation) Parent: SPARK-25507 > Document the features that

[jira] [Created] (SPARK-25507) Update documents for the new features in 2.4 release

Xiao Li created SPARK-25507: --- Summary: Update documents for the new features in 2.4 release Key: SPARK-25507 URL: https://issues.apache.org/jira/browse/SPARK-25507 Project: Spark Issue Type:

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623788#comment-16623788 ] Nicholas Chammas commented on SPARK-25150: -- Given that Spark appears to provide incorrect

[jira] [Assigned] (SPARK-25485) Refactor UnsafeProjectionBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25485: Assignee: Apache Spark > Refactor UnsafeProjectionBenchmark to use main method >

[jira] [Assigned] (SPARK-25485) Refactor UnsafeProjectionBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25485: Assignee: (was: Apache Spark) > Refactor UnsafeProjectionBenchmark to use main

[jira] [Commented] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623785#comment-16623785 ] Apache Spark commented on SPARK-25505: -- User 'maryannxue' has created a pull request for this

[jira] [Assigned] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25505: Assignee: (was: Apache Spark) > The output order of grouping columns in Pivot is

[jira] [Commented] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623784#comment-16623784 ] Apache Spark commented on SPARK-25505: -- User 'maryannxue' has created a pull request for this

[jira] [Assigned] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25505: Assignee: Apache Spark > The output order of grouping columns in Pivot is different from

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623749#comment-16623749 ] Jungtaek Lim edited comment on SPARK-10816 at 9/21/18 3:25 PM: ---

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623749#comment-16623749 ] Jungtaek Lim edited comment on SPARK-10816 at 9/21/18 3:24 PM: ---

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623749#comment-16623749 ] Jungtaek Lim edited comment on SPARK-10816 at 9/21/18 3:13 PM: ---

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623749#comment-16623749 ] Jungtaek Lim edited comment on SPARK-10816 at 9/21/18 3:10 PM: ---

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623749#comment-16623749 ] Jungtaek Lim edited comment on SPARK-10816 at 9/21/18 3:09 PM: ---

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623749#comment-16623749 ] Jungtaek Lim commented on SPARK-10816: -- [~msukmanowsky] Thanks for showing your interest on this!

[jira] [Created] (SPARK-25506) Spark CSV multiline with CRLF

eugen yushin created SPARK-25506: Summary: Spark CSV multiline with CRLF Key: SPARK-25506 URL: https://issues.apache.org/jira/browse/SPARK-25506 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24523) InterruptedException when closing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623712#comment-16623712 ] Imran Rashid commented on SPARK-24523: -- Wait, are you writing event logs to S3? I thought the

[jira] [Commented] (SPARK-25454) Division between operands with negative scale can cause precision loss

[ https://issues.apache.org/jira/browse/SPARK-25454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623710#comment-16623710 ] Apache Spark commented on SPARK-25454: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

Maryann Xue created SPARK-25505: --- Summary: The output order of grouping columns in Pivot is different from the input order Key: SPARK-25505 URL: https://issues.apache.org/jira/browse/SPARK-25505

[jira] [Assigned] (SPARK-25499) Refactor BenchmarkBase and Benchmark

[ https://issues.apache.org/jira/browse/SPARK-25499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25499: --- Assignee: Gengliang Wang > Refactor BenchmarkBase and Benchmark >

[jira] [Resolved] (SPARK-25499) Refactor BenchmarkBase and Benchmark

[ https://issues.apache.org/jira/browse/SPARK-25499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25499. - Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22513

[jira] [Commented] (SPARK-22739) Additional Expression Support for Objects

[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623672#comment-16623672 ] Wenchen Fan commented on SPARK-22739: - Here it is: https://issues.apache.org/jira/browse/SPARK-24768

[jira] [Comment Edited] (SPARK-22739) Additional Expression Support for Objects

[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623665#comment-16623665 ] Aleksander Eskilson edited comment on SPARK-22739 at 9/21/18 2:10 PM:

[jira] [Commented] (SPARK-22739) Additional Expression Support for Objects

[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623665#comment-16623665 ] Aleksander Eskilson commented on SPARK-22739: - [~cloud_fan], could you perhaps link here the

[jira] [Assigned] (SPARK-24355) Improve Spark shuffle server responsiveness to non-ChunkFetch requests

[ https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-24355: - Assignee: Sanket Chintapalli > Improve Spark shuffle server responsiveness to

[jira] [Commented] (SPARK-24355) Improve Spark shuffle server responsiveness to non-ChunkFetch requests

[ https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623660#comment-16623660 ] Thomas Graves commented on SPARK-24355: --- pr that got merged didn't get linked properly: 

[jira] [Resolved] (SPARK-24355) Improve Spark shuffle server responsiveness to non-ChunkFetch requests

[ https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-24355. --- Resolution: Fixed Fix Version/s: 2.5.0 > Improve Spark shuffle server responsiveness

  1   2   >