[jira] [Commented] (SPARK-26836) Columns get switched in Spark SQL using Avro backed Hive table if schema evolves

[ https://issues.apache.org/jira/browse/SPARK-26836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764719#comment-16764719 ] Gengliang Wang commented on SPARK-26836: [~dongjoon]I don't think the issue is related to

[jira] [Commented] (SPARK-23408) Flaky test: StreamingOuterJoinSuite.left outer early state exclusion on right

[ https://issues.apache.org/jira/browse/SPARK-23408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764712#comment-16764712 ] Apache Spark commented on SPARK-23408: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764675#comment-16764675 ] Hyukjin Kwon commented on SPARK-26855: -- But I think it's tricky to fix IMHO .. Should be awesome if

[jira] [Commented] (SPARK-26800) JDBC - MySQL nullable option is ignored

[ https://issues.apache.org/jira/browse/SPARK-26800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764665#comment-16764665 ] Maxim Gekk commented on SPARK-26800: Using NOT NULL for TIMESTAMP by default is non-standard

[jira] [Comment Edited] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764662#comment-16764662 ] Takeshi Yamamuro edited comment on SPARK-26855 at 2/11/19 4:47 AM: ---

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764662#comment-16764662 ] Takeshi Yamamuro commented on SPARK-26855: -- Aha, good catch. I always run the tests after

[jira] [Resolved] (SPARK-26525) Fast release memory of ShuffleBlockFetcherIterator

[ https://issues.apache.org/jira/browse/SPARK-26525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26525. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23438

[jira] [Resolved] (SPARK-22826) [SQL] findWiderTypeForTwo Fails over StructField of Array

[ https://issues.apache.org/jira/browse/SPARK-22826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22826. -- Resolution: Cannot Reproduce It's fixed somewhere. Please link the Jira if anyone identifies.

[jira] [Updated] (SPARK-26759) Arrow optimization in SparkR's interoperability

[ https://issues.apache.org/jira/browse/SPARK-26759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26759: - Description: Arrow 0.12.0 is release and it contains R API. We could optimize Spark DaraFrame

[jira] [Resolved] (SPARK-26578) Synchronize putBytes's memory allocation and putting block on memoryManager

[ https://issues.apache.org/jira/browse/SPARK-26578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SongYadong resolved SPARK-26578. Resolution: Won't Fix This may not be a big problem that must be fixed. so won't fix. >

[jira] [Commented] (SPARK-26578) Synchronize putBytes's memory allocation and putting block on memoryManager

[ https://issues.apache.org/jira/browse/SPARK-26578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764609#comment-16764609 ] SongYadong commented on SPARK-26578: This may not be a big problem that must be fixed.  >

[jira] [Resolved] (SPARK-26843) Use ConfigEntry for hardcoded configs for "mesos" resource manager

[ https://issues.apache.org/jira/browse/SPARK-26843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26843. --- Resolution: Fixed Assignee: Jungtaek Lim Fix Version/s: 3.0.0 This is

[jira] [Assigned] (SPARK-24211) Flaky test: StreamingOuterJoinSuite

[ https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24211: Assignee: Apache Spark > Flaky test: StreamingOuterJoinSuite >

[jira] [Assigned] (SPARK-24211) Flaky test: StreamingOuterJoinSuite

[ https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24211: Assignee: (was: Apache Spark) > Flaky test: StreamingOuterJoinSuite >

[jira] [Commented] (SPARK-24239) Flaky test: KafkaContinuousSourceSuite.subscribing topic by name from earliest offsets

[ https://issues.apache.org/jira/browse/SPARK-24239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764603#comment-16764603 ] Apache Spark commented on SPARK-24239: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-24239) Flaky test: KafkaContinuousSourceSuite.subscribing topic by name from earliest offsets

[ https://issues.apache.org/jira/browse/SPARK-24239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24239: Assignee: Apache Spark > Flaky test: KafkaContinuousSourceSuite.subscribing topic by

[jira] [Assigned] (SPARK-24239) Flaky test: KafkaContinuousSourceSuite.subscribing topic by name from earliest offsets

[ https://issues.apache.org/jira/browse/SPARK-24239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24239: Assignee: (was: Apache Spark) > Flaky test: KafkaContinuousSourceSuite.subscribing

[jira] [Commented] (SPARK-24211) Flaky test: StreamingOuterJoinSuite

[ https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764601#comment-16764601 ] Apache Spark commented on SPARK-24211: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Resolved] (SPARK-26816) Add Benchmark for XORShiftRandom

[ https://issues.apache.org/jira/browse/SPARK-26816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26816. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 This is

[jira] [Closed] (SPARK-26684) Add logs when allocating large memory for PooledByteBufAllocator

[ https://issues.apache.org/jira/browse/SPARK-26684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-26684. - > Add logs when allocating large memory for PooledByteBufAllocator >

[jira] [Commented] (SPARK-26684) Add logs when allocating large memory for PooledByteBufAllocator

[ https://issues.apache.org/jira/browse/SPARK-26684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764558#comment-16764558 ] Dongjoon Hyun commented on SPARK-26684: --- Hi, [~liupengcheng]. As I commented on your PR, please 

[jira] [Resolved] (SPARK-26684) Add logs when allocating large memory for PooledByteBufAllocator

[ https://issues.apache.org/jira/browse/SPARK-26684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26684. --- Resolution: Invalid > Add logs when allocating large memory for PooledByteBufAllocator >

[jira] [Commented] (SPARK-26783) Kafka parameter documentation doesn't match with the reality (upper/lowercase)

[ https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764553#comment-16764553 ] Dongjoon Hyun commented on SPARK-26783: --- Hi, [~gsomogyi]. Is this still valid? Could you update

[jira] [Updated] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26855: -- Affects Version/s: 2.4.0 > SparkSubmitSuite fails on a clean build >

[jira] [Comment Edited] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764538#comment-16764538 ] Dongjoon Hyun edited comment on SPARK-26855 at 2/10/19 8:15 PM: +1 for

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764538#comment-16764538 ] Dongjoon Hyun commented on SPARK-26855: --- IIRC, not only this, there was another instances which

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764537#comment-16764537 ] Sean Owen commented on SPARK-26855: --- I think this should be improved, but even I am not sure how much

[jira] [Updated] (SPARK-26840) Avoid cost-based join reorder in presence of join hints

[ https://issues.apache.org/jira/browse/SPARK-26840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maryann Xue updated SPARK-26840: Description: This is a fix for

[jira] [Assigned] (SPARK-26840) Avoid cost-based join reorder in presence of join hints

[ https://issues.apache.org/jira/browse/SPARK-26840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26840: Assignee: (was: Apache Spark) > Avoid cost-based join reorder in presence of join

[jira] [Assigned] (SPARK-26840) Avoid cost-based join reorder in presence of join hints

[ https://issues.apache.org/jira/browse/SPARK-26840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26840: Assignee: Apache Spark > Avoid cost-based join reorder in presence of join hints >

[jira] [Updated] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26855: - Description: SparkSubmitSuite "include an external JAR in SparkR" fails consistently but the

[jira] [Created] (SPARK-26855) SparkSubmitSuite fails on a clean build

Felix Cheung created SPARK-26855: Summary: SparkSubmitSuite fails on a clean build Key: SPARK-26855 URL: https://issues.apache.org/jira/browse/SPARK-26855 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-17454) Use Mesos disk resources

[ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764454#comment-16764454 ] Clément Michaud edited comment on SPARK-17454 at 2/10/19 3:41 PM: --

[jira] [Assigned] (SPARK-17454) Use Mesos disk resources

[ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17454: Assignee: (was: Apache Spark) > Use Mesos disk resources >

[jira] [Commented] (SPARK-17454) Use Mesos disk resources

[ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764454#comment-16764454 ] Clément Michaud commented on SPARK-17454: - Hello, I've added a way for executors to reserve

[jira] [Assigned] (SPARK-17454) Use Mesos disk resources

[ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17454: Assignee: Apache Spark > Use Mesos disk resources > > >

[jira] [Created] (SPARK-26854) Support ANY subquery

Mingcong Han created SPARK-26854: Summary: Support ANY subquery Key: SPARK-26854 URL: https://issues.apache.org/jira/browse/SPARK-26854 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-26829) In place standard scaler so the column remains same after transformation

[ https://issues.apache.org/jira/browse/SPARK-26829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santokh Singh updated SPARK-26829: -- Description: Standard scaler and some similar transformations takes input column name and

[jira] [Updated] (SPARK-26829) In place standard scaler so the column remains same after transformation

[ https://issues.apache.org/jira/browse/SPARK-26829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santokh Singh updated SPARK-26829: -- Description: (was: Standard scaler and some similar transformations) > In place standard

[jira] [Updated] (SPARK-26829) In place standard scaler so the column remains same after transformation

[ https://issues.apache.org/jira/browse/SPARK-26829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santokh Singh updated SPARK-26829: -- Description: Standard scaler and some similar transformations > In place standard scaler so