[jira] [Commented] (SPARK-22882) ML test for StructuredStreaming: spark.ml.classification

[ https://issues.apache.org/jira/browse/SPARK-22882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306685#comment-16306685 ] Apache Spark commented on SPARK-22882: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-22882) ML test for StructuredStreaming: spark.ml.classification

[ https://issues.apache.org/jira/browse/SPARK-22882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22882: Assignee: (was: Apache Spark) > ML test for StructuredStreaming:

[jira] [Resolved] (SPARK-22927) ML test for structured streaming: ml.classification

[ https://issues.apache.org/jira/browse/SPARK-22927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-22927. Resolution: Duplicate > ML test for structured streaming: ml.classification >

[jira] [Assigned] (SPARK-22882) ML test for StructuredStreaming: spark.ml.classification

[ https://issues.apache.org/jira/browse/SPARK-22882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22882: Assignee: Apache Spark > ML test for StructuredStreaming: spark.ml.classification >

[jira] [Assigned] (SPARK-22927) ML test for structured streaming: ml.classification

[ https://issues.apache.org/jira/browse/SPARK-22927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22927: Assignee: Apache Spark > ML test for structured streaming: ml.classification >

[jira] [Commented] (SPARK-22927) ML test for structured streaming: ml.classification

[ https://issues.apache.org/jira/browse/SPARK-22927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306681#comment-16306681 ] Apache Spark commented on SPARK-22927: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-22927) ML test for structured streaming: ml.classification

[ https://issues.apache.org/jira/browse/SPARK-22927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22927: Assignee: (was: Apache Spark) > ML test for structured streaming: ml.classification >

[jira] [Updated] (SPARK-22927) ML test for structured streaming: ml.classification

[ https://issues.apache.org/jira/browse/SPARK-22927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-22927: --- Description: Task for adding Structured Streaming tests for all Models/Transformers in

[jira] [Created] (SPARK-22927) ML test for structured streaming: ml.classification

Weichen Xu created SPARK-22927: -- Summary: ML test for structured streaming: ml.classification Key: SPARK-22927 URL: https://issues.apache.org/jira/browse/SPARK-22927 Project: Spark Issue Type:

[jira] [Updated] (SPARK-21475) Change the usage of FileInputStream/OutputStream to Files.newInput/OutputStream in the critical path

[ https://issues.apache.org/jira/browse/SPARK-21475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-21475: - Fix Version/s: (was: 2.3.0) > Change the usage of FileInputStream/OutputStream to >

[jira] [Resolved] (SPARK-22771) SQL concat for binary

[ https://issues.apache.org/jira/browse/SPARK-22771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22771. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0 > SQL concat for

[jira] [Commented] (SPARK-22926) Respect table-level conf compression codec `Compression` in multiple scenarios

[ https://issues.apache.org/jira/browse/SPARK-22926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306664#comment-16306664 ] Apache Spark commented on SPARK-22926: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22926) Respect table-level conf compression codec `Compression` in multiple scenarios

[ https://issues.apache.org/jira/browse/SPARK-22926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22926: Assignee: Xiao Li (was: Apache Spark) > Respect table-level conf compression codec

[jira] [Assigned] (SPARK-22926) Respect table-level conf compression codec `Compression` in multiple scenarios

[ https://issues.apache.org/jira/browse/SPARK-22926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22926: Assignee: Apache Spark (was: Xiao Li) > Respect table-level conf compression codec

[jira] [Created] (SPARK-22926) Respect table-level conf compression codec `Compression` in multiple scenarios

Xiao Li created SPARK-22926: --- Summary: Respect table-level conf compression codec `Compression` in multiple scenarios Key: SPARK-22926 URL: https://issues.apache.org/jira/browse/SPARK-22926 Project: Spark

[jira] [Resolved] (SPARK-22881) ML test for StructuredStreaming: spark.ml.regression

[ https://issues.apache.org/jira/browse/SPARK-22881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-22881. --- Resolution: Fixed Fix Version/s: 2.3.0 Resolved by

[jira] [Resolved] (SPARK-22734) VectorSizeHint Python API

[ https://issues.apache.org/jira/browse/SPARK-22734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-22734. --- Resolution: Fixed Fix Version/s: 2.3.0 Resolved by

[jira] [Updated] (SPARK-22734) VectorSizeHint Python API

[ https://issues.apache.org/jira/browse/SPARK-22734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22734: -- Issue Type: New Feature (was: Improvement) > VectorSizeHint Python API >

[jira] [Resolved] (SPARK-22863) Make MicroBatchExecution also support MicroBatchRead/WriteSupport

[ https://issues.apache.org/jira/browse/SPARK-22863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22863. -- Resolution: Duplicate > Make MicroBatchExecution also support MicroBatchRead/WriteSupport >

[jira] [Assigned] (SPARK-22922) Python API for fitMultiple

[ https://issues.apache.org/jira/browse/SPARK-22922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-22922: - Assignee: Bago Amirbekian > Python API for fitMultiple >

[jira] [Resolved] (SPARK-22922) Python API for fitMultiple

[ https://issues.apache.org/jira/browse/SPARK-22922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-22922. --- Resolution: Fixed Fix Version/s: 2.3.0 Resolved by

[jira] [Commented] (SPARK-22921) Merge script should prompt for assigning jiras

[ https://issues.apache.org/jira/browse/SPARK-22921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306597#comment-16306597 ] Imran Rashid commented on SPARK-22921: -- merged https://github.com/apache/spark/pull/20117, which

[jira] [Assigned] (SPARK-21475) Change the usage of FileInputStream/OutputStream to Files.newInput/OutputStream in the critical path

[ https://issues.apache.org/jira/browse/SPARK-21475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21475: Assignee: Saisai Shao (was: Apache Spark) > Change the usage of

[jira] [Assigned] (SPARK-21475) Change the usage of FileInputStream/OutputStream to Files.newInput/OutputStream in the critical path

[ https://issues.apache.org/jira/browse/SPARK-21475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21475: Assignee: Apache Spark (was: Saisai Shao) > Change the usage of

[jira] [Commented] (SPARK-21475) Change the usage of FileInputStream/OutputStream to Files.newInput/OutputStream in the critical path

[ https://issues.apache.org/jira/browse/SPARK-21475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306589#comment-16306589 ] Apache Spark commented on SPARK-21475: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Reopened] (SPARK-21475) Change the usage of FileInputStream/OutputStream to Files.newInput/OutputStream in the critical path

[ https://issues.apache.org/jira/browse/SPARK-21475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reopened SPARK-21475: -- I sent https://github.com/apache/spark/pull/20119 to revert this due to a performance regression.

[jira] [Commented] (SPARK-22903) AlreadyBeingCreatedException in stage retry caused by wrong attemptNumber

[ https://issues.apache.org/jira/browse/SPARK-22903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306583#comment-16306583 ] Mridul Muralidharan commented on SPARK-22903: - [~imranr] I agree that SPARK-22162 has

[jira] [Commented] (SPARK-22897) Expose stageAttemptId in TaskContext

[ https://issues.apache.org/jira/browse/SPARK-22897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306573#comment-16306573 ] Imran Rashid commented on SPARK-22897: -- +1 > Expose stageAttemptId in TaskContext >

[jira] [Commented] (SPARK-22903) AlreadyBeingCreatedException in stage retry caused by wrong attemptNumber

[ https://issues.apache.org/jira/browse/SPARK-22903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306563#comment-16306563 ] Imran Rashid commented on SPARK-22903: -- hmmm ... this may be related to SPARK-22162 and the

[jira] [Updated] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22925: - Description: Today in when calling model.save(), some ML models we do makeRDD(data, 1) or

[jira] [Updated] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22925: - Description: Today in when calling model.save(), some ML models we do makeRDD(data, 1) or

[jira] [Updated] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22925: - Issue Type: Improvement (was: Bug) > ml model persistence creates a lot of small files >

[jira] [Updated] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22925: - Description: Today in when calling model.save(), some ML models we do makeRDD(data, 1) or

[jira] [Commented] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306520#comment-16306520 ] Felix Cheung commented on SPARK-22925: --

[jira] [Created] (SPARK-22925) ml model persistence creates a lot of small files

Felix Cheung created SPARK-22925: Summary: ml model persistence creates a lot of small files Key: SPARK-22925 URL: https://issues.apache.org/jira/browse/SPARK-22925 Project: Spark Issue

[jira] [Assigned] (SPARK-22924) R DataFrame API for sortWithinPartitions

[ https://issues.apache.org/jira/browse/SPARK-22924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22924: Assignee: (was: Apache Spark) > R DataFrame API for sortWithinPartitions >

[jira] [Assigned] (SPARK-22924) R DataFrame API for sortWithinPartitions

[ https://issues.apache.org/jira/browse/SPARK-22924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22924: Assignee: Apache Spark > R DataFrame API for sortWithinPartitions >

[jira] [Commented] (SPARK-22924) R DataFrame API for sortWithinPartitions

[ https://issues.apache.org/jira/browse/SPARK-22924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306501#comment-16306501 ] Apache Spark commented on SPARK-22924: -- User 'felixcheung' has created a pull request for this

[jira] [Created] (SPARK-22924) R DataFrame API for sortWithinPartitions

Felix Cheung created SPARK-22924: Summary: R DataFrame API for sortWithinPartitions Key: SPARK-22924 URL: https://issues.apache.org/jira/browse/SPARK-22924 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-22920) R sql functions for current_date, current_timestamp, rtrim/ltrim/trim with trimString

[ https://issues.apache.org/jira/browse/SPARK-22920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22920. -- Resolution: Fixed Assignee: Felix Cheung > R sql functions for current_date,

[jira] [Updated] (SPARK-22920) R sql functions for current_date, current_timestamp, rtrim/ltrim/trim with trimString

[ https://issues.apache.org/jira/browse/SPARK-22920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22920: - Target Version/s: 2.3.0 Fix Version/s: 2.3.0 > R sql functions for current_date,

[jira] [Assigned] (SPARK-22734) VectorSizeHint Python API

[ https://issues.apache.org/jira/browse/SPARK-22734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-22734: - Assignee: Bago Amirbekian > VectorSizeHint Python API >

[jira] [Updated] (SPARK-22734) VectorSizeHint Python API

[ https://issues.apache.org/jira/browse/SPARK-22734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22734: -- Shepherd: Joseph K. Bradley > VectorSizeHint Python API > - >

[jira] [Updated] (SPARK-22734) VectorSizeHint Python API

[ https://issues.apache.org/jira/browse/SPARK-22734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22734: -- Summary: VectorSizeHint Python API (was: Create Python API for VectorSizeHint) >

[jira] [Commented] (SPARK-22905) Fix ChiSqSelectorModel, GaussianMixtureModel save implementation for Row order issues

[ https://issues.apache.org/jira/browse/SPARK-22905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306431#comment-16306431 ] Joseph K. Bradley commented on SPARK-22905: --- Merged https://github.com/apache/spark/pull/20113

[jira] [Updated] (SPARK-22905) Fix ChiSqSelectorModel, GaussianMixtureModel save implementation for Row order issues

[ https://issues.apache.org/jira/browse/SPARK-22905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22905: -- Summary: Fix ChiSqSelectorModel, GaussianMixtureModel save implementation for Row

[jira] [Commented] (SPARK-22404) Provide an option to use unmanaged AM in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-22404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306392#comment-16306392 ] Imran Rashid commented on SPARK-22404: -- can you provide a little more explanation for the point of

[jira] [Commented] (SPARK-22921) Merge script should prompt for assigning jiras

[ https://issues.apache.org/jira/browse/SPARK-22921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306375#comment-16306375 ] Apache Spark commented on SPARK-22921: -- User 'squito' has created a pull request for this issue:

[jira] [Resolved] (SPARK-22864) Flaky test: ExecutorAllocationManagerSuite "cancel pending executors when no longer needed"

[ https://issues.apache.org/jira/browse/SPARK-22864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-22864. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20050

[jira] [Assigned] (SPARK-22864) Flaky test: ExecutorAllocationManagerSuite "cancel pending executors when no longer needed"

[ https://issues.apache.org/jira/browse/SPARK-22864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-22864: Assignee: Marcelo Vanzin > Flaky test: ExecutorAllocationManagerSuite "cancel pending

[jira] [Assigned] (SPARK-20654) Add controls for how much disk the SHS can use

[ https://issues.apache.org/jira/browse/SPARK-20654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-20654: Assignee: Marcelo Vanzin > Add controls for how much disk the SHS can use >

[jira] [Resolved] (SPARK-20654) Add controls for how much disk the SHS can use

[ https://issues.apache.org/jira/browse/SPARK-20654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-20654. -- Resolution: Fixed Fix Version/s: 2.3.0 Resolved by

[jira] [Commented] (SPARK-21657) Spark has exponential time complexity to explode(array of structs)

[ https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306361#comment-16306361 ] Ruslan Dautkhanov commented on SPARK-21657: --- Thank you everyone involved. It would be the most

[jira] [Assigned] (SPARK-21071) make WritableColumnVector public

[ https://issues.apache.org/jira/browse/SPARK-21071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21071: --- Assignee: (was: Wenchen Fan) > make WritableColumnVector public >

[jira] [Updated] (SPARK-21071) make WritableColumnVector public

[ https://issues.apache.org/jira/browse/SPARK-21071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21071: Issue Type: New Feature (was: Sub-task) Parent: (was: SPARK-20960) > make

[jira] [Updated] (SPARK-21071) make WritableColumnVector public

[ https://issues.apache.org/jira/browse/SPARK-21071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21071: Summary: make WritableColumnVector public (was: remove append APIs and simplify array writing

[jira] [Assigned] (SPARK-20960) make ColumnVector public

[ https://issues.apache.org/jira/browse/SPARK-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20960: Assignee: Apache Spark > make ColumnVector public > > >

[jira] [Assigned] (SPARK-20960) make ColumnVector public

[ https://issues.apache.org/jira/browse/SPARK-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20960: Assignee: (was: Apache Spark) > make ColumnVector public > >

[jira] [Commented] (SPARK-20960) make ColumnVector public

[ https://issues.apache.org/jira/browse/SPARK-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306358#comment-16306358 ] Apache Spark commented on SPARK-20960: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engi

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306316#comment-16306316 ] Damian Momot edited comment on SPARK-22918 at 12/29/17 2:56 PM: As a

[jira] [Commented] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engine",

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306316#comment-16306316 ] Damian Momot commented on SPARK-22918: -- As a quick workaround following can be used in tests just

[jira] [Comment Edited] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engi

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306316#comment-16306316 ] Damian Momot edited comment on SPARK-22918 at 12/29/17 2:49 PM: As a

[jira] [Comment Edited] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engi

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306297#comment-16306297 ] Damian Momot edited comment on SPARK-22918 at 12/29/17 2:01 PM: Spark

[jira] [Assigned] (SPARK-21657) Spark has exponential time complexity to explode(array of structs)

[ https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21657: --- Assignee: Ohad Raviv > Spark has exponential time complexity to explode(array of structs) >

[jira] [Commented] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engine",

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306297#comment-16306297 ] Damian Momot commented on SPARK-22918: -- Spark uses derby for local (test) runs - for metastore etc.

[jira] [Commented] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engine",

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306287#comment-16306287 ] Sean Owen commented on SPARK-22918: --- This does suggest a SecurityManager is enabled though. I'm not

[jira] [Resolved] (SPARK-22921) Merge script should prompt for assigning jiras

[ https://issues.apache.org/jira/browse/SPARK-22921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22921. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20107

[jira] [Assigned] (SPARK-22921) Merge script should prompt for assigning jiras

[ https://issues.apache.org/jira/browse/SPARK-22921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22921: - Assignee: Imran Rashid > Merge script should prompt for assigning jiras >

[jira] [Resolved] (SPARK-21657) Spark has exponential time complexity to explode(array of structs)

[ https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21657. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19683

[jira] [Updated] (SPARK-22923) Non-equi join(theta join) should use sort merge join

[ https://issues.apache.org/jira/browse/SPARK-22923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juhong Jung updated SPARK-22923: Description: I found this issue during self join for retrieving same key last record problem.

[jira] [Updated] (SPARK-22923) Non-equi join(theta join) should use sort merge join

[ https://issues.apache.org/jira/browse/SPARK-22923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juhong Jung updated SPARK-22923: Description: I found this issue during self join for retrieving same key last record problem.

[jira] [Updated] (SPARK-22923) Non-equi join(theta join) should use sort merge join

[ https://issues.apache.org/jira/browse/SPARK-22923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juhong Jung updated SPARK-22923: Description: I found this issue during self join for retrieving same key last record problem.

[jira] [Commented] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306244#comment-16306244 ] Kazuaki Ishizaki commented on SPARK-22500: -- Thank you for your report. I think that this is the

[jira] [Created] (SPARK-22923) Non-equi join(theta join) should use sort merge join

Juhong Jung created SPARK-22923: --- Summary: Non-equi join(theta join) should use sort merge join Key: SPARK-22923 URL: https://issues.apache.org/jira/browse/SPARK-22923 Project: Spark Issue

[jira] [Comment Edited] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306197#comment-16306197 ] Łukasz Żukowski edited comment on SPARK-22500 at 12/29/17 10:56 AM:

[jira] [Comment Edited] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306197#comment-16306197 ] Łukasz Żukowski edited comment on SPARK-22500 at 12/29/17 10:55 AM:

[jira] [Commented] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306197#comment-16306197 ] Łukasz Żukowski commented on SPARK-22500: - Hmm Below still make 64k exception. Maybe it can be

[jira] [Resolved] (SPARK-22916) shouldn't bias towards build right if user does not specify

[ https://issues.apache.org/jira/browse/SPARK-22916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22916. - Resolution: Fixed Assignee: Feng Liu Fix Version/s: 2.3.0 > shouldn't bias towards build

[jira] [Commented] (SPARK-11248) Spark hivethriftserver is using the wrong user to while getting HDFS permissions

[ https://issues.apache.org/jira/browse/SPARK-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306158#comment-16306158 ] mvpanswer7 commented on SPARK-11248: +1 spark2.2 have same issue with HUE > Spark hivethriftserver

[jira] [Commented] (SPARK-22370) Config values should be captured in Driver.

[ https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306143#comment-16306143 ] Apache Spark commented on SPARK-22370: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engine", "u

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Momot updated SPARK-22918: - Description: After upgrading 2.2.0 -> 2.2.1 sbt test command in one of my projects started to

[jira] [Commented] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engine",

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306074#comment-16306074 ] Damian Momot commented on SPARK-22918: -- Nope, everything is working fine on Spark 2.2.0 - no