[jira] [Commented] (SPARK-31170) Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089274#comment-17089274 ] Wenchen Fan commented on SPARK-31170: - Yea it's a long-standing bug, but the fix is non-trivial,

[jira] [Created] (SPARK-31515) Canonicalize Cast should consider the value of needTimeZone

2020-04-21 Thread Yuanjian Li (Jira)
Yuanjian Li created SPARK-31515: --- Summary: Canonicalize Cast should consider the value of needTimeZone Key: SPARK-31515 URL: https://issues.apache.org/jira/browse/SPARK-31515 Project: Spark

[jira] [Commented] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

2020-04-21 Thread Zhou Jiashuai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089245#comment-17089245 ] Zhou Jiashuai commented on SPARK-26385: --- I also use spark structured streaming with Kafka. After I

[jira] [Updated] (SPARK-31514) Kerberos: Spark UGI credentials are not getting passed down to Hive

2020-04-21 Thread Sanchay Javeria (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanchay Javeria updated SPARK-31514: Description: I'm using Spark-2.4, I have a Kerberos enabled cluster where I'm trying to

[jira] [Created] (SPARK-31514) Kerberos: Spark UGI credentials are not getting passed down to Hive

2020-04-21 Thread Sanchay Javeria (Jira)
Sanchay Javeria created SPARK-31514: --- Summary: Kerberos: Spark UGI credentials are not getting passed down to Hive Key: SPARK-31514 URL: https://issues.apache.org/jira/browse/SPARK-31514 Project:

[jira] [Updated] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31509: - Affects Version/s: (was: 3.1.0) 2.4.0 > Recommend user to disable delay scheduling

[jira] [Updated] (SPARK-31507) Remove millennium, century, decade, millisecond, microsecond and epoch from extract fucntion

2020-04-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31507: Description: Extracting millennium, century, decade, millisecond, microsecond and epoch from

[jira] [Resolved] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31511. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28286

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2020-04-21 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089190#comment-17089190 ] Marcelo Masiero Vanzin commented on SPARK-1537: --- Well, the only thing to start with is the

[jira] [Commented] (SPARK-31418) Blacklisting feature aborts Spark job without retrying for max num retries in case of Dynamic allocation

2020-04-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089179#comment-17089179 ] Erik Krogen commented on SPARK-31418: - PR was posted by [~vsowrirajan] here:

[jira] [Resolved] (SPARK-31349) Document builtin aggregate function

2020-04-21 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31349. -- Fix Version/s: 3.0.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2020-04-21 Thread Daniel Templeton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089159#comment-17089159 ] Daniel Templeton commented on SPARK-1537: - Thanks for the response, [~vanzin]. Yeah, I think we

[jira] [Resolved] (SPARK-31369) Add Documentation for JSON functions

2020-04-21 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31369. -- Fix Version/s: 3.0.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Created] (SPARK-31513) Improve the structure of auto-generated built-in function pages in SQL references

2020-04-21 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-31513: Summary: Improve the structure of auto-generated built-in function pages in SQL references Key: SPARK-31513 URL: https://issues.apache.org/jira/browse/SPARK-31513

[jira] [Created] (SPARK-31512) make window function using order by optional

2020-04-21 Thread philipse (Jira)
philipse created SPARK-31512: Summary: make window function using order by optional Key: SPARK-31512 URL: https://issues.apache.org/jira/browse/SPARK-31512 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2020-04-21 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089137#comment-17089137 ] Marcelo Masiero Vanzin commented on SPARK-1537: --- [~templedf] sorry forgot to reply. ATSv1

[jira] [Updated] (SPARK-31233) Enhance RpcTimeoutException Log Message

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31233: -- Summary: Enhance RpcTimeoutException Log Message (was: TimeoutException contains null

[jira] [Assigned] (SPARK-31233) TimeoutException contains null remoteAddr

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31233: - Assignee: Yi Huang > TimeoutException contains null remoteAddr >

[jira] [Resolved] (SPARK-31233) TimeoutException contains null remoteAddr

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31233. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28002

[jira] [Updated] (SPARK-31233) TimeoutException contains null remoteAddr

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31233: -- Issue Type: Improvement (was: Bug) > TimeoutException contains null remoteAddr >

[jira] [Updated] (SPARK-31233) TimeoutException contains null remoteAddr

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31233: -- Affects Version/s: (was: 2.3.4) 3.1.0 > TimeoutException contains

[jira] [Resolved] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30162. --- Fix Version/s: 3.0.0 Resolution: Fixed Please feel free to reopen this if you are

[jira] [Commented] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089041#comment-17089041 ] Dongjoon Hyun commented on SPARK-30162: --- In 3.0.0-RC1, I can see `number of partitions read: 1`.

[jira] [Updated] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30162: -- Attachment: partition_pruning.png > Add PushedFilters to metadata in Parquet DSv2

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089031#comment-17089031 ] Dongjoon Hyun edited comment on SPARK-30162 at 4/21/20, 8:25 PM: - Hi,

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089037#comment-17089037 ] Dongjoon Hyun edited comment on SPARK-30162 at 4/21/20, 8:18 PM: - Could

[jira] [Commented] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089037#comment-17089037 ] Dongjoon Hyun commented on SPARK-30162: --- Could you try 3.0.0-RC1, [~nasirali]? > Add

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089031#comment-17089031 ] Dongjoon Hyun edited comment on SPARK-30162 at 4/21/20, 8:15 PM: - Hi,

[jira] [Commented] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Nasir Ali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089034#comment-17089034 ] Nasir Ali commented on SPARK-30162: --- [~dongjoon] This bug has not been fixed. Please have a look at my

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089031#comment-17089031 ] Dongjoon Hyun edited comment on SPARK-30162 at 4/21/20, 8:10 PM: - Hi,

[jira] [Commented] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089031#comment-17089031 ] Dongjoon Hyun commented on SPARK-30162: --- Hi, [~sowen]. Is there a reason for you to remove the

[jira] [Created] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-04-21 Thread Jira
Herman van Hövell created SPARK-31511: - Summary: Make BytesToBytesMap iterator() thread-safe Key: SPARK-31511 URL: https://issues.apache.org/jira/browse/SPARK-31511 Project: Spark Issue

[jira] [Commented] (SPARK-31170) Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir

2020-04-21 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088997#comment-17088997 ] Nicholas Chammas commented on SPARK-31170: -- Isn't this also an issue in Spark 2.4.5?

[jira] [Updated] (SPARK-31381) Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-21 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31381: Parent: SPARK-28684 Issue Type: Sub-task (was: Improvement) > Upgrade built-in Hive 2.3.6 to

[jira] [Resolved] (SPARK-31503) fix the SQL string of the TRIM functions

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31503. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28281

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088868#comment-17088868 ] Kushal Yellam commented on SPARK-10925: --- [~aseigneurin] pls help me on above issue. > Exception

[jira] [Commented] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088820#comment-17088820 ] Wenchen Fan commented on SPARK-31474: - Thanks for catching! I've pushed to fix to branch-3.0. >

[jira] [Comment Edited] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088820#comment-17088820 ] Wenchen Fan edited comment on SPARK-31474 at 4/21/20, 4:02 PM: --- Thanks for

[jira] [Created] (SPARK-31510) Set setwd in R documentation build

2020-04-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31510: Summary: Set setwd in R documentation build Key: SPARK-31510 URL: https://issues.apache.org/jira/browse/SPARK-31510 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-31510) Set setwd in R documentation build

2020-04-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31510: - Priority: Trivial (was: Major) > Set setwd in R documentation build >

[jira] [Comment Edited] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

2020-04-21 Thread Rajeev Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088785#comment-17088785 ] Rajeev Kumar edited comment on SPARK-26385 at 4/21/20, 3:31 PM: I am

[jira] [Commented] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

2020-04-21 Thread Rajeev Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088785#comment-17088785 ] Rajeev Kumar commented on SPARK-26385: -- I am also facing the same issue for

[jira] [Resolved] (SPARK-31361) Rebase datetime in parquet/avro according to file metadata

2020-04-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31361. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28137

[jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088714#comment-17088714 ] Kushal Yellam edited comment on SPARK-10925 at 4/21/20, 1:58 PM: - Hi

[jira] [Issue Comment Deleted] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kushal Yellam updated SPARK-10925: -- Comment: was deleted (was: Hi Team ) > Exception when joining DataFrames >

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088715#comment-17088715 ] Kushal Yellam commented on SPARK-10925: --- Hi Team  > Exception when joining DataFrames >

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088714#comment-17088714 ] Kushal Yellam commented on SPARK-10925: --- Hi Team  > Exception when joining DataFrames >

[jira] [Commented] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Jason Darrell Lowe (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088704#comment-17088704 ] Jason Darrell Lowe commented on SPARK-31474: The branch-3.0 build appears to have been

[jira] [Updated] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31509: - Description: Currently, barrier taskset can only be scheduled when all tasks are launched at the same time. As

[jira] [Updated] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31509: - Description: Currently, barrier taskset can only be scheduled when all tasks are launched at the same time. As

[jira] [Updated] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31509: - Description: Currently, barrier taskset can only be scheduled when all tasks are launched at same time. As a

[jira] [Created] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
wuyi created SPARK-31509: Summary: Recommend user to disable delay scheduling for barrier taskset Key: SPARK-31509 URL: https://issues.apache.org/jira/browse/SPARK-31509 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-31504) Output fields in formatted Explain should have determined order.

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31504. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28282

[jira] [Assigned] (SPARK-31504) Output fields in formatted Explain should have determined order.

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31504: --- Assignee: wuyi > Output fields in formatted Explain should have determined order. >

[jira] [Resolved] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31474. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28248

[jira] [Assigned] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31474: --- Assignee: Kent Yao > Consistancy between dayofweek/dow in extract expression and dayofweek

[jira] [Comment Edited] (SPARK-31329) Modify executor monitor to allow for moving shuffle blocks

2020-04-21 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088569#comment-17088569 ] Dale Richardson edited comment on SPARK-31329 at 4/21/20, 11:36 AM:

[jira] [Commented] (SPARK-31329) Modify executor monitor to allow for moving shuffle blocks

2020-04-21 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088569#comment-17088569 ] Dale Richardson commented on SPARK-31329: - Hi Holden, I've been thinking about this issue as

[jira] [Updated] (SPARK-31508) string type compare with numberic cause data inaccurate

2020-04-21 Thread philipse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse updated SPARK-31508: - Summary: string type compare with numberic cause data inaccurate (was: string type compare with

[jira] [Created] (SPARK-31508) string type compare with numberic case data inaccurate

2020-04-21 Thread philipse (Jira)
philipse created SPARK-31508: Summary: string type compare with numberic case data inaccurate Key: SPARK-31508 URL: https://issues.apache.org/jira/browse/SPARK-31508 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28367) Kafka connector infinite wait because metadata never updated

2020-04-21 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088514#comment-17088514 ] Gabor Somogyi commented on SPARK-28367: --- I've taken a look at the possibilities given by the new

[jira] [Updated] (SPARK-31361) Rebase datetime in parquet/avro according to file metadata

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31361: Summary: Rebase datetime in parquet/avro according to file metadata (was: Rebase datetime in

[jira] [Updated] (SPARK-31507) Remove millennium, century, decade, millisecond, microsecond and epoch from extract fucntion

2020-04-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31507: - Summary: Remove millennium, century, decade, millisecond, microsecond and epoch from extract fucntion

[jira] [Created] (SPARK-31507) Remove millennium, century, decade, and epoch from extract fucntion

2020-04-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-31507: Summary: Remove millennium, century, decade, and epoch from extract fucntion Key: SPARK-31507 URL: https://issues.apache.org/jira/browse/SPARK-31507 Project: Spark

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we

[jira] [Created] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
Xiaochang Wu created SPARK-31506: Summary: Sparse BLAS native optimization Key: SPARK-31506 URL: https://issues.apache.org/jira/browse/SPARK-31506 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-31504) Output fields in formatted Explain should have determined order.

2020-04-21 Thread wuyi (Jira)
wuyi created SPARK-31504: Summary: Output fields in formatted Explain should have determined order. Key: SPARK-31504 URL: https://issues.apache.org/jira/browse/SPARK-31504 Project: Spark Issue

[jira] [Created] (SPARK-31505) Single precision floating point support in machine learning

2020-04-21 Thread Xiaochang Wu (Jira)
Xiaochang Wu created SPARK-31505: Summary: Single precision floating point support in machine learning Key: SPARK-31505 URL: https://issues.apache.org/jira/browse/SPARK-31505 Project: Spark

[jira] [Created] (SPARK-31503) fix the SQL string of the TRIM functions

2020-04-21 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31503: --- Summary: fix the SQL string of the TRIM functions Key: SPARK-31503 URL: https://issues.apache.org/jira/browse/SPARK-31503 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-29274) Should not coerce decimal type to double type when it's join column

2020-04-21 Thread jinwensc (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088337#comment-17088337 ] jinwensc edited comment on SPARK-29274 at 4/21/20, 6:29 AM: bigdecimal

[jira] [Commented] (SPARK-29274) Should not coerce decimal type to double type when it's join column

2020-04-21 Thread jinwensc (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088337#comment-17088337 ] jinwensc commented on SPARK-29274: -- bigdecimal compare to string, string should be promote to