[jira] [Comment Edited] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread peng bo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834322#comment-16834322 ] peng bo edited comment on SPARK-27638 at 5/7/19 5:47 AM: - [~maxg

[jira] [Created] (SPARK-27647) Metric Gauge not threadsafe

2019-05-06 Thread bettermouse (JIRA)
bettermouse created SPARK-27647: --- Summary: Metric Gauge not threadsafe Key: SPARK-27647 URL: https://issues.apache.org/jira/browse/SPARK-27647 Project: Spark Issue Type: Bug Component

[jira] [Commented] (SPARK-27643) Add supported Hive version list in doc

2019-05-06 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834333#comment-16834333 ] Yuming Wang commented on SPARK-27643: - Do you mean {{spark.sql.hive.metastore.versio

[jira] [Updated] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards

2019-05-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24935: Fix Version/s: 2.3.4 > Problem with Executing Hive UDF's from Spark 2.2 Onwards >

[jira] [Updated] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread peng bo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peng bo updated SPARK-27638: Description: The below example works with both Mysql and Hive, however not with spark. {code:java} mysql>

[jira] [Commented] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread peng bo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834322#comment-16834322 ] peng bo commented on SPARK-27638: - [~maxgekk] I'd love propose a PR for this. However

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834276#comment-16834276 ] Apache Spark commented on SPARK-18406: -- User 'jiangxb1987' has created a pull reque

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834277#comment-16834277 ] Apache Spark commented on SPARK-18406: -- User 'jiangxb1987' has created a pull reque

[jira] [Assigned] (SPARK-25139) PythonRunner#WriterThread released block after TaskRunner finally block which invoke BlockManager#releaseAllLocksForTask

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25139: Assignee: (was: Apache Spark) > PythonRunner#WriterThread released block after TaskRu

[jira] [Assigned] (SPARK-25139) PythonRunner#WriterThread released block after TaskRunner finally block which invoke BlockManager#releaseAllLocksForTask

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25139: Assignee: Apache Spark > PythonRunner#WriterThread released block after TaskRunner finall

[jira] [Commented] (SPARK-27466) LEAD function with 'ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING' causes exception in Spark

2019-05-06 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834258#comment-16834258 ] Bruce Robbins commented on SPARK-27466: --- This _seems_ to be intentional, according

[jira] [Assigned] (SPARK-27646) Required refactoring for bytecode analysis

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27646: Assignee: (was: Apache Spark) > Required refactoring for bytecode analysis >

[jira] [Assigned] (SPARK-27646) Required refactoring for bytecode analysis

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27646: Assignee: Apache Spark > Required refactoring for bytecode analysis > ---

[jira] [Updated] (SPARK-27646) Required refactoring for bytecode analysis

2019-05-06 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-27646: Summary: Required refactoring for bytecode analysis (was: Required refactoring for bytecode analysis work

[jira] [Created] (SPARK-27646) Required refactoring for bytecode analysis work

2019-05-06 Thread DB Tsai (JIRA)
DB Tsai created SPARK-27646: --- Summary: Required refactoring for bytecode analysis work Key: SPARK-27646 URL: https://issues.apache.org/jira/browse/SPARK-27646 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834214#comment-16834214 ] Maxim Gekk commented on SPARK-27638: [~pengbo] Are you going to propose a PR for tha

[jira] [Commented] (SPARK-26555) Thread safety issue causes createDataset to fail with misleading errors

2019-05-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834203#comment-16834203 ] Josh Rosen commented on SPARK-26555: I won't be able to tackle a backport for at lea

[jira] [Created] (SPARK-27645) Cache result of count function to that RDD

2019-05-06 Thread Seungmin Lee (JIRA)
Seungmin Lee created SPARK-27645: Summary: Cache result of count function to that RDD Key: SPARK-27645 URL: https://issues.apache.org/jira/browse/SPARK-27645 Project: Spark Issue Type: New Fe

[jira] [Updated] (SPARK-27644) Enable spark.sql.optimizer.nestedSchemaPruning.enabled by default

2019-05-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27644: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-25556 > Enable spark.sql.optimi

[jira] [Updated] (SPARK-27622) Avoid network communication when block manager fetches disk persisted RDD blocks from the same host

2019-05-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoid network communication when block manager fetches disk persisted RDD b

[jira] [Updated] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

2019-05-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoid the network when block manager fetches disk persisted RDD blocks from

[jira] [Created] (SPARK-27644) Enable spark.sql.optimizer.nestedSchemaPruning.enabled by default

2019-05-06 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-27644: - Summary: Enable spark.sql.optimizer.nestedSchemaPruning.enabled by default Key: SPARK-27644 URL: https://issues.apache.org/jira/browse/SPARK-27644 Project: Spark

[jira] [Comment Edited] (SPARK-27622) Avoid network communication when block manger fetches from the same host

2019-05-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831553#comment-16831553 ] Attila Zsolt Piros edited comment on SPARK-27622 at 5/6/19 6:22 PM: --

[jira] [Commented] (SPARK-26555) Thread safety issue causes createDataset to fail with misleading errors

2019-05-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834055#comment-16834055 ] Sean Owen commented on SPARK-26555: --- I personally think it's OK to backport -- do you

[jira] [Commented] (SPARK-26555) Thread safety issue causes createDataset to fail with misleading errors

2019-05-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834025#comment-16834025 ] Josh Rosen commented on SPARK-26555: [~cloud_fan] [~srowen], could we backport this

[jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC

2019-05-06 Thread Darshan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834024#comment-16834024 ] Darshan commented on SPARK-19335: - For some row level access related issue, our organisa

[jira] [Resolved] (SPARK-23299) __repr__ broken for Rows instantiated with *args

2019-05-06 Thread Holden Karau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-23299. -- Resolution: Fixed Fix Version/s: 3.0.0 Merged a fix for this for 3, we can continue the

[jira] [Commented] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833999#comment-16833999 ] Wenchen Fan commented on SPARK-27638: - I think it should be changed. When comapring

[jira] [Commented] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833992#comment-16833992 ] Sean Owen commented on SPARK-27638: --- Are you saying that's intended behavior or should

[jira] [Commented] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards

2019-05-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833982#comment-16833982 ] Wenchen Fan commented on SPARK-24935: - I have sent https://github.com/apache/spark/p

[jira] [Updated] (SPARK-24935) Problem with Executing Hive UDF's from Spark 2.2 Onwards

2019-05-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24935: Fix Version/s: (was: 2.4.1) 2.4.3 > Problem with Executing Hive UDF's from

[jira] [Comment Edited] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833957#comment-16833957 ] Maxim Gekk edited comment on SPARK-27638 at 5/6/19 4:10 PM:

[jira] [Commented] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833957#comment-16833957 ] Maxim Gekk commented on SPARK-27638: It works with explicit to_date: {code:scala} sc

[jira] [Comment Edited] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833949#comment-16833949 ] Maxim Gekk edited comment on SPARK-27638 at 5/6/19 3:57 PM:

[jira] [Commented] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833949#comment-16833949 ] Maxim Gekk commented on SPARK-27638: [~srowen] The date literal should be casted to

[jira] [Assigned] (SPARK-27642) make v1 offset extends v2 offset

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27642: Assignee: Wenchen Fan (was: Apache Spark) > make v1 offset extends v2 offset > -

[jira] [Assigned] (SPARK-27642) make v1 offset extends v2 offset

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27642: Assignee: Apache Spark (was: Wenchen Fan) > make v1 offset extends v2 offset > -

[jira] [Commented] (SPARK-26839) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-05-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833932#comment-16833932 ] Sean Owen commented on SPARK-26839: --- Right now it seems to be an issue with datanucleu

[jira] [Commented] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833931#comment-16833931 ] Sean Owen commented on SPARK-27638: --- CC [~maxgekk] but isn't the issue that your date

[jira] [Updated] (SPARK-27643) Add supported Hive version list in doc

2019-05-06 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-27643: --- Description: Add supported Hive version list for each spark version in doc. (was: Add suppo

[jira] [Created] (SPARK-27643) Add supported Hive version in doc

2019-05-06 Thread Zhichao Zhang (JIRA)
Zhichao Zhang created SPARK-27643: -- Summary: Add supported Hive version in doc Key: SPARK-27643 URL: https://issues.apache.org/jira/browse/SPARK-27643 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-27643) Add supported Hive version list in doc

2019-05-06 Thread Zhichao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated SPARK-27643: --- Summary: Add supported Hive version list in doc (was: Add supported Hive version in doc) >

[jira] [Created] (SPARK-27642) make v1 offset extends v2 offset

2019-05-06 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-27642: --- Summary: make v1 offset extends v2 offset Key: SPARK-27642 URL: https://issues.apache.org/jira/browse/SPARK-27642 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-27641) Unregistering a single Metrics Source with no metrics leads to removing all the metrics from other sources with the same name

2019-05-06 Thread Sergey Zhemzhitsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Zhemzhitsky updated SPARK-27641: --- Summary: Unregistering a single Metrics Source with no metrics leads to removing all

[jira] [Created] (SPARK-27641) Unregistering a single Metrics Source with no metrics leads to removing all the from other sources with the same name

2019-05-06 Thread Sergey Zhemzhitsky (JIRA)
Sergey Zhemzhitsky created SPARK-27641: -- Summary: Unregistering a single Metrics Source with no metrics leads to removing all the from other sources with the same name Key: SPARK-27641 URL: https://issues.apa

[jira] [Assigned] (SPARK-23887) update query progress

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23887: Assignee: (was: Apache Spark) > update query progress > - > >

[jira] [Assigned] (SPARK-23887) update query progress

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23887: Assignee: Apache Spark > update query progress > - > >

[jira] [Resolved] (SPARK-27579) remove BaseStreamingSource and BaseStreamingSink

2019-05-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27579. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24471 [https://gith

[jira] [Commented] (SPARK-26839) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-05-06 Thread Mihaly Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833784#comment-16833784 ] Mihaly Toth commented on SPARK-26839: - Hmm, sorry, I overlooked something. I only ha

[jira] [Commented] (SPARK-26839) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-05-06 Thread Mihaly Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833763#comment-16833763 ] Mihaly Toth commented on SPARK-26839: - [~srowen], I was facing CNFE and I have a pot

[jira] [Comment Edited] (SPARK-27634) deleteCheckpointOnStop should be configurable

2019-05-06 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833743#comment-16833743 ] Gabor Somogyi edited comment on SPARK-27634 at 5/6/19 12:08 PM: --

[jira] [Commented] (SPARK-27634) deleteCheckpointOnStop should be configurable

2019-05-06 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833743#comment-16833743 ] Gabor Somogyi commented on SPARK-27634: --- [~yuwang0...@gmail.com] I think one shoul

[jira] [Assigned] (SPARK-27640) Avoid duplicate lookups for datasource through provider

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27640: Assignee: (was: Apache Spark) > Avoid duplicate lookups for datasource through provid

[jira] [Assigned] (SPARK-27640) Avoid duplicate lookups for datasource through provider

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27640: Assignee: Apache Spark > Avoid duplicate lookups for datasource through provider > --

[jira] [Updated] (SPARK-27640) Avoid duplicate lookups for datasource through provider

2019-05-06 Thread jiaan.geng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-27640: --- Component/s: Structured Streaming > Avoid duplicate lookups for datasource through provider > --

[jira] [Created] (SPARK-27640) Avoid duplicate lookups for datasource through provider

2019-05-06 Thread jiaan.geng (JIRA)
jiaan.geng created SPARK-27640: -- Summary: Avoid duplicate lookups for datasource through provider Key: SPARK-27640 URL: https://issues.apache.org/jira/browse/SPARK-27640 Project: Spark Issue Typ

[jira] [Updated] (SPARK-27622) Avoid network communication when block manger fetches from the same host

2019-05-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoid network communication when block manger fetches from the same host (

[jira] [Updated] (SPARK-27622) Avoiding network communication when block manger fetching from the same host

2019-05-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoiding network communication when block manger fetching from the same hos

[jira] [Updated] (SPARK-27622) Avoiding network communication when block mangers are running on the same host

2019-05-06 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27622: --- Summary: Avoiding network communication when block mangers are running on the same h

[jira] [Commented] (SPARK-5594) SparkException: Failed to get broadcast (TorrentBroadcast)

2019-05-06 Thread Jeffrey(Xilang) Yan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833632#comment-16833632 ] Jeffrey(Xilang) Yan commented on SPARK-5594: There is a bug before 2.2.3/2.3.

[jira] [Updated] (SPARK-27639) InMemoryTableScan should show the table name on UI

2019-05-06 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27639: Description: It only shows InMemoryTableScan when scanning InMemoryTable. When there are many InMe

[jira] [Updated] (SPARK-27638) date format yyyy-M-dd string comparison not handled properly

2019-05-06 Thread peng bo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peng bo updated SPARK-27638: Summary: date format -M-dd string comparison not handled properly (was: date format -M-dd compar

[jira] [Updated] (SPARK-27638) date format yyyy-M-dd comparison not handled properly

2019-05-06 Thread peng bo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peng bo updated SPARK-27638: Summary: date format -M-dd comparison not handled properly (was: date format -M-dd comparison is

[jira] [Assigned] (SPARK-27639) InMemoryTableScan should show the table name on UI

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27639: Assignee: (was: Apache Spark) > InMemoryTableScan should show the table name on UI >

[jira] [Assigned] (SPARK-27639) InMemoryTableScan should show the table name on UI

2019-05-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27639: Assignee: Apache Spark > InMemoryTableScan should show the table name on UI > ---

[jira] [Commented] (SPARK-27638) date format yyyy-M-dd comparison isn't handled properly

2019-05-06 Thread peng bo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833584#comment-16833584 ] peng bo commented on SPARK-27638: - [~cloud_fan] [~srowen] Your opinion will be appreciat

[jira] [Created] (SPARK-27639) InMemoryTableScan should show the table name on UI

2019-05-06 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-27639: --- Summary: InMemoryTableScan should show the table name on UI Key: SPARK-27639 URL: https://issues.apache.org/jira/browse/SPARK-27639 Project: Spark Issue Type:

[jira] [Updated] (SPARK-27638) date format yyyy-M-dd comparison isn't handled properly

2019-05-06 Thread peng bo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peng bo updated SPARK-27638: Description: The below example works with both Mysql and Hive, however not with spark. {code:java} mysql>

[jira] [Updated] (SPARK-27638) date format yyyy-M-dd comparison isn't handled properly

2019-05-06 Thread peng bo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peng bo updated SPARK-27638: Description: The below example works with both Mysql and Hive, however not with spark. {code:java} mysql>

[jira] [Created] (SPARK-27638) date format yyyy-M-dd comparison isn't handled properly

2019-05-06 Thread peng bo (JIRA)
peng bo created SPARK-27638: --- Summary: date format -M-dd comparison isn't handled properly Key: SPARK-27638 URL: https://issues.apache.org/jira/browse/SPARK-27638 Project: Spark Issue Type: Bu

[jira] [Comment Edited] (SPARK-27227) Spark Runtime Filter

2019-05-06 Thread Song Jun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833558#comment-16833558 ] Song Jun edited comment on SPARK-27227 at 5/6/19 7:32 AM: -- [~cl

[jira] [Commented] (SPARK-27227) Spark Runtime Filter

2019-05-06 Thread Song Jun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833558#comment-16833558 ] Song Jun commented on SPARK-27227: -- [~cloud_fan] [~LI,Xiao] could you please help to re

[jira] [Updated] (SPARK-27227) Spark Runtime Filter

2019-05-06 Thread Song Jun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Song Jun updated SPARK-27227: - Description: When we equi-join one big table with a smaller table, we can collect some statistics from