[jira] [Updated] (SPARK-23116) CLONE - SparkR 2.2 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-23116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23116: -- Target Version/s: (was: 2.2.0) > CLONE - SparkR 2.2 QA: Update user guide for new fea

[jira] [Updated] (SPARK-23116) CLONE - SparkR 2.2 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-23116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23116: -- Fix Version/s: (was: 2.2.0) > CLONE - SparkR 2.2 QA: Update user guide for new feat

[jira] [Updated] (SPARK-23115) SparkR 2.3 QA: New R APIs and API docs

[ https://issues.apache.org/jira/browse/SPARK-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23115: -- Target Version/s: (was: 2.2.0) > SparkR 2.3 QA: New R APIs and API docs > ---

[jira] [Updated] (SPARK-23115) SparkR 2.3 QA: New R APIs and API docs

[ https://issues.apache.org/jira/browse/SPARK-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23115: -- Fix Version/s: (was: 2.2.0) > SparkR 2.3 QA: New R APIs and API docs >

[jira] [Updated] (SPARK-23115) SparkR 2.3 QA: New R APIs and API docs

[ https://issues.apache.org/jira/browse/SPARK-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23115: -- Summary: SparkR 2.3 QA: New R APIs and API docs (was: CLONE - SparkR 2.2 QA: New R API

[jira] [Updated] (SPARK-23105) Spark MLlib, GraphX 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23105: -- Fix Version/s: (was: 2.2.0) > Spark MLlib, GraphX 2.3 QA umbrella > ---

[jira] [Updated] (SPARK-23105) Spark MLlib, GraphX 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23105: -- Target Version/s: 2.3.0 (was: 2.2.0) > Spark MLlib, GraphX 2.3 QA umbrella > -

[jira] [Updated] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23114: -- Target Version/s: 2.3.0 (was: 2.2.0) > Spark R 2.3 QA umbrella > -

[jira] [Updated] (SPARK-23105) Spark MLlib, GraphX 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23105: -- Description: This JIRA lists tasks for the next Spark release's QA period for MLlib and

[jira] [Updated] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23114: -- Fix Version/s: (was: 2.2.0) > Spark R 2.3 QA umbrella > --- > >

[jira] [Created] (SPARK-23117) CLONE - SparkR 2.2 QA: Check for new R APIs requiring example code

Joseph K. Bradley created SPARK-23117: - Summary: CLONE - SparkR 2.2 QA: Check for new R APIs requiring example code Key: SPARK-23117 URL: https://issues.apache.org/jira/browse/SPARK-23117 Project:

[jira] [Created] (SPARK-23118) CLONE - SparkR 2.2 QA: Programming guide, migration guide, vignettes updates

Joseph K. Bradley created SPARK-23118: - Summary: CLONE - SparkR 2.2 QA: Programming guide, migration guide, vignettes updates Key: SPARK-23118 URL: https://issues.apache.org/jira/browse/SPARK-23118

[jira] [Created] (SPARK-23107) CLONE - ML, Graph 2.2 QA: API: New Scala APIs, docs

Joseph K. Bradley created SPARK-23107: - Summary: CLONE - ML, Graph 2.2 QA: API: New Scala APIs, docs Key: SPARK-23107 URL: https://issues.apache.org/jira/browse/SPARK-23107 Project: Spark

[jira] [Created] (SPARK-23116) CLONE - SparkR 2.2 QA: Update user guide for new features & APIs

Joseph K. Bradley created SPARK-23116: - Summary: CLONE - SparkR 2.2 QA: Update user guide for new features & APIs Key: SPARK-23116 URL: https://issues.apache.org/jira/browse/SPARK-23116 Project: S

[jira] [Created] (SPARK-23108) CLONE - ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit

Joseph K. Bradley created SPARK-23108: - Summary: CLONE - ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit Key: SPARK-23108 URL: https://issues.apache.org/jira/browse/SPARK-23108

[jira] [Created] (SPARK-23105) Spark MLlib, GraphX 2.3 QA umbrella

Joseph K. Bradley created SPARK-23105: - Summary: Spark MLlib, GraphX 2.3 QA umbrella Key: SPARK-23105 URL: https://issues.apache.org/jira/browse/SPARK-23105 Project: Spark Issue Type: Umb

[jira] [Created] (SPARK-23115) CLONE - SparkR 2.2 QA: New R APIs and API docs

Joseph K. Bradley created SPARK-23115: - Summary: CLONE - SparkR 2.2 QA: New R APIs and API docs Key: SPARK-23115 URL: https://issues.apache.org/jira/browse/SPARK-23115 Project: Spark Issu

[jira] [Created] (SPARK-23111) CLONE - ML, Graph 2.2 QA: Update user guide for new features & APIs

Joseph K. Bradley created SPARK-23111: - Summary: CLONE - ML, Graph 2.2 QA: Update user guide for new features & APIs Key: SPARK-23111 URL: https://issues.apache.org/jira/browse/SPARK-23111 Project

[jira] [Created] (SPARK-23110) CLONE - ML 2.2 QA: API: Java compatibility, docs

Joseph K. Bradley created SPARK-23110: - Summary: CLONE - ML 2.2 QA: API: Java compatibility, docs Key: SPARK-23110 URL: https://issues.apache.org/jira/browse/SPARK-23110 Project: Spark Is

[jira] [Created] (SPARK-23106) CLONE - ML, Graph 2.2 QA: API: Binary incompatible changes

Joseph K. Bradley created SPARK-23106: - Summary: CLONE - ML, Graph 2.2 QA: API: Binary incompatible changes Key: SPARK-23106 URL: https://issues.apache.org/jira/browse/SPARK-23106 Project: Spark

[jira] [Created] (SPARK-23114) Spark R 2.3 QA umbrella

Joseph K. Bradley created SPARK-23114: - Summary: Spark R 2.3 QA umbrella Key: SPARK-23114 URL: https://issues.apache.org/jira/browse/SPARK-23114 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-23113) CLONE - Update MLlib, GraphX websites for 2.2

Joseph K. Bradley created SPARK-23113: - Summary: CLONE - Update MLlib, GraphX websites for 2.2 Key: SPARK-23113 URL: https://issues.apache.org/jira/browse/SPARK-23113 Project: Spark Issue

[jira] [Created] (SPARK-23109) CLONE - ML 2.2 QA: API: Python API coverage

Joseph K. Bradley created SPARK-23109: - Summary: CLONE - ML 2.2 QA: API: Python API coverage Key: SPARK-23109 URL: https://issues.apache.org/jira/browse/SPARK-23109 Project: Spark Issue T

[jira] [Created] (SPARK-23112) CLONE - ML, Graph 2.2 QA: Programming guide update and migration guide

Joseph K. Bradley created SPARK-23112: - Summary: CLONE - ML, Graph 2.2 QA: Programming guide update and migration guide Key: SPARK-23112 URL: https://issues.apache.org/jira/browse/SPARK-23112 Proj

[jira] [Resolved] (SPARK-23031) Merge script should allow arbitrary assignees

[ https://issues.apache.org/jira/browse/SPARK-23031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23031. Resolution: Fixed Assignee: Imran Rashid Fix Version/s: 2.4.0 Fixed with pa

[jira] [Resolved] (SPARK-23044) merge script has bug when assigning jiras to non-contributors

[ https://issues.apache.org/jira/browse/SPARK-23044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23044. Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20236 [https:/

[jira] [Assigned] (SPARK-23044) merge script has bug when assigning jiras to non-contributors

[ https://issues.apache.org/jira/browse/SPARK-23044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23044: -- Assignee: Imran Rashid > merge script has bug when assigning jiras to non-contributors

[jira] [Comment Edited] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16328028#comment-16328028 ] Takeshi Yamamuro edited comment on SPARK-21274 at 1/17/18 12:05 AM: ---

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16328028#comment-16328028 ] Takeshi Yamamuro commented on SPARK-21274: -- yea, I tried though, I couldn't find

[jira] [Created] (SPARK-23104) Document that kubernetes is still "experimental"

Marcelo Vanzin created SPARK-23104: -- Summary: Document that kubernetes is still "experimental" Key: SPARK-23104 URL: https://issues.apache.org/jira/browse/SPARK-23104 Project: Spark Issue Ty

[jira] [Commented] (SPARK-23103) LevelDB store not iterating correctly when indexed value has negative value

[ https://issues.apache.org/jira/browse/SPARK-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327960#comment-16327960 ] Apache Spark commented on SPARK-23103: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-23103) LevelDB store not iterating correctly when indexed value has negative value

[ https://issues.apache.org/jira/browse/SPARK-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23103: Assignee: (was: Apache Spark) > LevelDB store not iterating correctly when indexed val

[jira] [Assigned] (SPARK-23103) LevelDB store not iterating correctly when indexed value has negative value

[ https://issues.apache.org/jira/browse/SPARK-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23103: Assignee: Apache Spark > LevelDB store not iterating correctly when indexed value has nega

[jira] [Created] (SPARK-23103) LevelDB store not iterating correctly when indexed value has negative value

Marcelo Vanzin created SPARK-23103: -- Summary: LevelDB store not iterating correctly when indexed value has negative value Key: SPARK-23103 URL: https://issues.apache.org/jira/browse/SPARK-23103 Proje

[jira] [Commented] (SPARK-22923) Non-equi join(theta join) should use sort merge join

[ https://issues.apache.org/jira/browse/SPARK-22923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327881#comment-16327881 ] Herman van Hovell commented on SPARK-22923: --- You cannot use a shuffling join fo

[jira] [Created] (SPARK-23102) Migrate kafka sink

Jose Torres created SPARK-23102: --- Summary: Migrate kafka sink Key: SPARK-23102 URL: https://issues.apache.org/jira/browse/SPARK-23102 Project: Spark Issue Type: Sub-task Components: S

[jira] [Created] (SPARK-23101) Migrate unit test sinks

Jose Torres created SPARK-23101: --- Summary: Migrate unit test sinks Key: SPARK-23101 URL: https://issues.apache.org/jira/browse/SPARK-23101 Project: Spark Issue Type: Sub-task Componen

[jira] [Assigned] (SPARK-23095) Decorrelation of scalar subquery fails with java.util.NoSuchElementException.

[ https://issues.apache.org/jira/browse/SPARK-23095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23095: Assignee: (was: Apache Spark) > Decorrelation of scalar subquery fails with java.util.

[jira] [Commented] (SPARK-23095) Decorrelation of scalar subquery fails with java.util.NoSuchElementException.

[ https://issues.apache.org/jira/browse/SPARK-23095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327845#comment-16327845 ] Apache Spark commented on SPARK-23095: -- User 'dilipbiswal' has created a pull reques

[jira] [Assigned] (SPARK-23095) Decorrelation of scalar subquery fails with java.util.NoSuchElementException.

[ https://issues.apache.org/jira/browse/SPARK-23095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23095: Assignee: Apache Spark > Decorrelation of scalar subquery fails with java.util.NoSuchEleme

[jira] [Created] (SPARK-23100) Migrate unit test sources

Jose Torres created SPARK-23100: --- Summary: Migrate unit test sources Key: SPARK-23100 URL: https://issues.apache.org/jira/browse/SPARK-23100 Project: Spark Issue Type: Sub-task Compon

[jira] [Created] (SPARK-23099) Migrate foreach sink

Jose Torres created SPARK-23099: --- Summary: Migrate foreach sink Key: SPARK-23099 URL: https://issues.apache.org/jira/browse/SPARK-23099 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-23098) Migrate kafka source

Jose Torres created SPARK-23098: --- Summary: Migrate kafka source Key: SPARK-23098 URL: https://issues.apache.org/jira/browse/SPARK-23098 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-23096) Migrate rate source to v2

Jose Torres created SPARK-23096: --- Summary: Migrate rate source to v2 Key: SPARK-23096 URL: https://issues.apache.org/jira/browse/SPARK-23096 Project: Spark Issue Type: Sub-task Compon

[jira] [Created] (SPARK-23097) Migrate text socket source

Jose Torres created SPARK-23097: --- Summary: Migrate text socket source Key: SPARK-23097 URL: https://issues.apache.org/jira/browse/SPARK-23097 Project: Spark Issue Type: Sub-task Compo

[jira] [Updated] (SPARK-23095) Decorrelation of scalar subquery fails with java.util.NoSuchElementException.

[ https://issues.apache.org/jira/browse/SPARK-23095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-23095: - Description: The following SQL involving scalar correlated query returns a map exception. {code:j

[jira] [Updated] (SPARK-23095) Decorrelation of scalar subquery fails with java.util.NoSuchElementException.

[ https://issues.apache.org/jira/browse/SPARK-23095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-23095: - Description: The following SQL involving scalar correlated query returns a map exception. {code:j

[jira] [Created] (SPARK-23095) Decorrelation of scalar subquery fails with java.util.NoSuchElementException.

Dilip Biswal created SPARK-23095: Summary: Decorrelation of scalar subquery fails with java.util.NoSuchElementException. Key: SPARK-23095 URL: https://issues.apache.org/jira/browse/SPARK-23095 Project

[jira] [Updated] (SPARK-21996) Streaming ignores files with spaces in the file names

[ https://issues.apache.org/jira/browse/SPARK-21996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-21996: - Component/s: (was: SQL) Structured Streaming > Streaming ignores files with

[jira] [Assigned] (SPARK-23037) RFormula should not use deprecated OneHotEncoder and should include VectorSizeHint in pipeline

[ https://issues.apache.org/jira/browse/SPARK-23037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-23037: - Assignee: Bago Amirbekian > RFormula should not use deprecated OneHotEncoder and

[jira] [Resolved] (SPARK-23037) RFormula should not use deprecated OneHotEncoder and should include VectorSizeHint in pipeline

[ https://issues.apache.org/jira/browse/SPARK-23037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-23037. --- Resolution: Fixed Fix Version/s: 2.3.0 > RFormula should not use deprecated On

[jira] [Resolved] (SPARK-23045) Have RFormula use OneHoEncoderEstimator

[ https://issues.apache.org/jira/browse/SPARK-23045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-23045. --- Resolution: Fixed Fix Version/s: 2.3.0 Resolved by [https://github.com/apache/

[jira] [Created] (SPARK-23094) Json Readers choose wrong encoding when bad records are present and fail

Burak Yavuz created SPARK-23094: --- Summary: Json Readers choose wrong encoding when bad records are present and fail Key: SPARK-23094 URL: https://issues.apache.org/jira/browse/SPARK-23094 Project: Spark

[jira] [Assigned] (SPARK-23093) don't modify run id

[ https://issues.apache.org/jira/browse/SPARK-23093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23093: Assignee: (was: Apache Spark) > don't modify run id > --- > >

[jira] [Assigned] (SPARK-23093) don't modify run id

[ https://issues.apache.org/jira/browse/SPARK-23093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23093: Assignee: Apache Spark > don't modify run id > --- > > Key

[jira] [Commented] (SPARK-23093) don't modify run id

[ https://issues.apache.org/jira/browse/SPARK-23093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327776#comment-16327776 ] Apache Spark commented on SPARK-23093: -- User 'jose-torres' has created a pull reques

[jira] [Assigned] (SPARK-23045) Have RFormula use OneHoEncoderEstimator

[ https://issues.apache.org/jira/browse/SPARK-23045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-23045: - Assignee: Bago Amirbekian > Have RFormula use OneHoEncoderEstimator > --

[jira] [Created] (SPARK-23093) don't modify run id

Jose Torres created SPARK-23093: --- Summary: don't modify run id Key: SPARK-23093 URL: https://issues.apache.org/jira/browse/SPARK-23093 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-23033) disable task-level retry for continuous execution

[ https://issues.apache.org/jira/browse/SPARK-23033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Torres updated SPARK-23033: Target Version/s: 2.3.0 > disable task-level retry for continuous execution > -

[jira] [Assigned] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

[ https://issues.apache.org/jira/browse/SPARK-23089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23089: Assignee: Apache Spark > "Unable to create operation log session directory" when parent di

[jira] [Commented] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

[ https://issues.apache.org/jira/browse/SPARK-23089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327674#comment-16327674 ] Apache Spark commented on SPARK-23089: -- User 'mgaido91' has created a pull request f

[jira] [Assigned] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

[ https://issues.apache.org/jira/browse/SPARK-23089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23089: Assignee: (was: Apache Spark) > "Unable to create operation log session directory" whe

[jira] [Resolved] (SPARK-16139) Audit tests for leaked threads

[ https://issues.apache.org/jira/browse/SPARK-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16139. Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 19893 [https:/

[jira] [Assigned] (SPARK-16139) Audit tests for leaked threads

[ https://issues.apache.org/jira/browse/SPARK-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-16139: -- Assignee: Gabor Somogyi > Audit tests for leaked threads > ---

[jira] [Commented] (SPARK-22232) Row objects in pyspark created using the `Row(**kwars)` syntax do not get serialized/deserialized properly

[ https://issues.apache.org/jira/browse/SPARK-22232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327661#comment-16327661 ] Apache Spark commented on SPARK-22232: -- User 'BryanCutler' has created a pull reques

[jira] [Assigned] (SPARK-22232) Row objects in pyspark created using the `Row(**kwars)` syntax do not get serialized/deserialized properly

[ https://issues.apache.org/jira/browse/SPARK-22232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22232: Assignee: (was: Apache Spark) > Row objects in pyspark created using the `Row(**kwars)

[jira] [Assigned] (SPARK-22232) Row objects in pyspark created using the `Row(**kwars)` syntax do not get serialized/deserialized properly

[ https://issues.apache.org/jira/browse/SPARK-22232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22232: Assignee: Apache Spark > Row objects in pyspark created using the `Row(**kwars)` syntax do

[jira] [Updated] (SPARK-23091) Incorrect unit test for approxQuantile

[ https://issues.apache.org/jira/browse/SPARK-23091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23091: -- Environment: Agree, go ahead with a PR. Priority: Minor (was: Major) Component/s: Tests > I

[jira] [Updated] (SPARK-23091) Incorrect unit test for approxQuantile

[ https://issues.apache.org/jira/browse/SPARK-23091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23091: -- Environment: (was: Agree, go ahead with a PR.) Agree, go ahead with a PR. > Incorrect unit test fo

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327649#comment-16327649 ] Steve Loughran commented on SPARK-23050: {quote} Is there an API to detect S3 lik

[jira] [Commented] (SPARK-23092) Migrate MemoryStream to DataSource V2

[ https://issues.apache.org/jira/browse/SPARK-23092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327637#comment-16327637 ] Apache Spark commented on SPARK-23092: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-23092) Migrate MemoryStream to DataSource V2

[ https://issues.apache.org/jira/browse/SPARK-23092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23092: Assignee: Apache Spark > Migrate MemoryStream to DataSource V2 > -

[jira] [Assigned] (SPARK-23092) Migrate MemoryStream to DataSource V2

[ https://issues.apache.org/jira/browse/SPARK-23092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23092: Assignee: (was: Apache Spark) > Migrate MemoryStream to DataSource V2 > --

[jira] [Created] (SPARK-23092) Migrate MemoryStream to DataSource V2

Burak Yavuz created SPARK-23092: --- Summary: Migrate MemoryStream to DataSource V2 Key: SPARK-23092 URL: https://issues.apache.org/jira/browse/SPARK-23092 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327632#comment-16327632 ] Shixiong Zhu commented on SPARK-23050: -- [~ste...@apache.org] Yeah, that's a good imp

[jira] [Created] (SPARK-23091) Incorrect unit test for approxQuantile

Kuang Chen created SPARK-23091: -- Summary: Incorrect unit test for approxQuantile Key: SPARK-23091 URL: https://issues.apache.org/jira/browse/SPARK-23091 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-12297: Assignee: Imran Rashid (was: Marcelo Vanzin) > Add work-around for Parquet/Hive int96 tim

[jira] [Assigned] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-12297: Assignee: Marcelo Vanzin (was: Imran Rashid) > Add work-around for Parquet/Hive int96 tim

[jira] [Assigned] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-12297: Assignee: Imran Rashid (was: Marcelo Vanzin) > Add work-around for Parquet/Hive int96 tim

[jira] [Assigned] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-12297: Assignee: Marcelo Vanzin (was: Imran Rashid) > Add work-around for Parquet/Hive int96 tim

[jira] [Assigned] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-12297: Assignee: Imran Rashid (was: Marcelo Vanzin) > Add work-around for Parquet/Hive int96 tim

[jira] [Assigned] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-12297: Assignee: Marcelo Vanzin (was: Imran Rashid) > Add work-around for Parquet/Hive int96 tim

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327553#comment-16327553 ] Maciej Bryński commented on SPARK-16534: [~rxin] I tested this patch with 2.2.1

[jira] [Commented] (SPARK-23081) Add colRegex API to PySpark

[ https://issues.apache.org/jira/browse/SPARK-23081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327472#comment-16327472 ] Huaxin Gao commented on SPARK-23081: Hi Sean, are you going to work on this? If not,

[jira] [Commented] (SPARK-23084) Add unboundedPreceding(), unboundedFollowing() and currentRow() to PySpark

[ https://issues.apache.org/jira/browse/SPARK-23084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327473#comment-16327473 ] Huaxin Gao commented on SPARK-23084: Hi Sean, are you going to work on this? If not,

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327453#comment-16327453 ] Reynold Xin commented on SPARK-21274: - Can't we rewrite this as two aggregates and a

[jira] [Commented] (SPARK-23079) Fix query constraints propagation with aliases

[ https://issues.apache.org/jira/browse/SPARK-23079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327398#comment-16327398 ] Apache Spark commented on SPARK-23079: -- User 'gengliangwang' has created a pull requ

[jira] [Updated] (SPARK-23016) Spark UI access and documentation

[ https://issues.apache.org/jira/browse/SPARK-23016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-23016: --- Priority: Minor (was: Major) > Spark UI access and documentation > -

[jira] [Assigned] (SPARK-23090) polish ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-23090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23090: Assignee: Apache Spark (was: Wenchen Fan) > polish ColumnVector > --- > >

[jira] [Assigned] (SPARK-23090) polish ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-23090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23090: Assignee: Wenchen Fan (was: Apache Spark) > polish ColumnVector > --- > >

[jira] [Commented] (SPARK-23090) polish ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-23090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327356#comment-16327356 ] Apache Spark commented on SPARK-23090: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-23090) polish ColumnVector

Wenchen Fan created SPARK-23090: --- Summary: polish ColumnVector Key: SPARK-23090 URL: https://issues.apache.org/jira/browse/SPARK-23090 Project: Spark Issue Type: Improvement Component

[jira] [Updated] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

[ https://issues.apache.org/jira/browse/SPARK-23089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Roberts updated SPARK-23089: - Environment: /usr/hdp/2.6.3.0-235/spark2/jars/spark-hive-thriftserver_2.11-2.2.0.2.6.3.0-235.jar

[jira] [Updated] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

[ https://issues.apache.org/jira/browse/SPARK-23089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Roberts updated SPARK-23089: - Description: When creating a session directory, Thrift should create the parent directory _(i.e.

[jira] [Updated] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

[ https://issues.apache.org/jira/browse/SPARK-23089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Roberts updated SPARK-23089: - Environment: (was: When creating a session directory, Thrift should create the parent directo

[jira] [Updated] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

[ https://issues.apache.org/jira/browse/SPARK-23089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Roberts updated SPARK-23089: - Description: When creating a session directory, Thrift should create the parent directory _(i.e.

[jira] [Created] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

Sean Roberts created SPARK-23089: Summary: "Unable to create operation log session directory" when parent directory not present Key: SPARK-23089 URL: https://issues.apache.org/jira/browse/SPARK-23089

[jira] [Updated] (SPARK-23011) Support alternative function form with group aggregate pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-23011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-23011: --- Description: The current semantics of groupby apply is that the output schema of groupby apply is the same a

[jira] [Updated] (SPARK-23011) Support alternative function form with group aggregate pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-23011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-23011: --- Description: The current semantics of groupby apply is that the output schema of groupby apply is the same a

[jira] [Updated] (SPARK-23011) Support alternative function form with group aggregate pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-23011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-23011: --- Description: The current semantics of groupby apply is that the output schema of groupby apply is the same a

<    1   2   3   >