[jira] [Commented] (SPARK-31400) The catalogString doesn't distinguish Vectors in ml and mllib

2020-04-21 Thread JinxinTang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089317#comment-17089317 ] JinxinTang commented on SPARK-31400: Thanks for report this issue, this is in progre

[jira] [Commented] (SPARK-31170) Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089274#comment-17089274 ] Wenchen Fan commented on SPARK-31170: - Yea it's a long-standing bug, but the fix is

[jira] [Created] (SPARK-31515) Canonicalize Cast should consider the value of needTimeZone

2020-04-21 Thread Yuanjian Li (Jira)
Yuanjian Li created SPARK-31515: --- Summary: Canonicalize Cast should consider the value of needTimeZone Key: SPARK-31515 URL: https://issues.apache.org/jira/browse/SPARK-31515 Project: Spark Is

[jira] [Commented] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

2020-04-21 Thread Zhou Jiashuai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089245#comment-17089245 ] Zhou Jiashuai commented on SPARK-26385: --- I also use spark structured streaming wit

[jira] [Updated] (SPARK-31514) Kerberos: Spark UGI credentials are not getting passed down to Hive

2020-04-21 Thread Sanchay Javeria (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanchay Javeria updated SPARK-31514: Description: I'm using Spark-2.4, I have a Kerberos enabled cluster where I'm trying to ru

[jira] [Created] (SPARK-31514) Kerberos: Spark UGI credentials are not getting passed down to Hive

2020-04-21 Thread Sanchay Javeria (Jira)
Sanchay Javeria created SPARK-31514: --- Summary: Kerberos: Spark UGI credentials are not getting passed down to Hive Key: SPARK-31514 URL: https://issues.apache.org/jira/browse/SPARK-31514 Project: Sp

[jira] [Updated] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31509: - Affects Version/s: (was: 3.1.0) 2.4.0 > Recommend user to disable delay scheduling fo

[jira] [Updated] (SPARK-31507) Remove millennium, century, decade, millisecond, microsecond and epoch from extract fucntion

2020-04-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31507: Description: Extracting millennium, century, decade, millisecond, microsecond and epoch from date

[jira] [Resolved] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31511. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28286 [https://

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2020-04-21 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089190#comment-17089190 ] Marcelo Masiero Vanzin commented on SPARK-1537: --- Well, the only thing to st

[jira] [Commented] (SPARK-31418) Blacklisting feature aborts Spark job without retrying for max num retries in case of Dynamic allocation

2020-04-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089179#comment-17089179 ] Erik Krogen commented on SPARK-31418: - PR was posted by [~vsowrirajan] here: https:/

[jira] [Resolved] (SPARK-31349) Document builtin aggregate function

2020-04-21 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31349. -- Fix Version/s: 3.0.0 Assignee: Takeshi Yamamuro Resolution: Fixed Fixe

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2020-04-21 Thread Daniel Templeton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089159#comment-17089159 ] Daniel Templeton commented on SPARK-1537: - Thanks for the response, [~vanzin]. Y

[jira] [Resolved] (SPARK-31369) Add Documentation for JSON functions

2020-04-21 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31369. -- Fix Version/s: 3.0.0 Assignee: Takeshi Yamamuro Resolution: Fixed Fixe

[jira] [Created] (SPARK-31513) Improve the structure of auto-generated built-in function pages in SQL references

2020-04-21 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-31513: Summary: Improve the structure of auto-generated built-in function pages in SQL references Key: SPARK-31513 URL: https://issues.apache.org/jira/browse/SPARK-31513

[jira] [Created] (SPARK-31512) make window function using order by optional

2020-04-21 Thread philipse (Jira)
philipse created SPARK-31512: Summary: make window function using order by optional Key: SPARK-31512 URL: https://issues.apache.org/jira/browse/SPARK-31512 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2020-04-21 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089137#comment-17089137 ] Marcelo Masiero Vanzin commented on SPARK-1537: --- [~templedf] sorry forgot t

[jira] [Updated] (SPARK-31233) Enhance RpcTimeoutException Log Message

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31233: -- Summary: Enhance RpcTimeoutException Log Message (was: TimeoutException contains null remoteA

[jira] [Assigned] (SPARK-31233) TimeoutException contains null remoteAddr

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31233: - Assignee: Yi Huang > TimeoutException contains null remoteAddr > --

[jira] [Resolved] (SPARK-31233) TimeoutException contains null remoteAddr

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31233. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28002 [https://

[jira] [Updated] (SPARK-31233) TimeoutException contains null remoteAddr

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31233: -- Issue Type: Improvement (was: Bug) > TimeoutException contains null remoteAddr >

[jira] [Updated] (SPARK-31233) TimeoutException contains null remoteAddr

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31233: -- Affects Version/s: (was: 2.3.4) 3.1.0 > TimeoutException contains n

[jira] [Resolved] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30162. --- Fix Version/s: 3.0.0 Resolution: Fixed Please feel free to reopen this if you are fac

[jira] [Commented] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089041#comment-17089041 ] Dongjoon Hyun commented on SPARK-30162: --- In 3.0.0-RC1, I can see `number of partit

[jira] [Updated] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30162: -- Attachment: partition_pruning.png > Add PushedFilters to metadata in Parquet DSv2 implementati

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089031#comment-17089031 ] Dongjoon Hyun edited comment on SPARK-30162 at 4/21/20, 8:25 PM: -

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089037#comment-17089037 ] Dongjoon Hyun edited comment on SPARK-30162 at 4/21/20, 8:18 PM: -

[jira] [Commented] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089037#comment-17089037 ] Dongjoon Hyun commented on SPARK-30162: --- Could you try 3.0.0-RC1, [~nasirali]? >

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089031#comment-17089031 ] Dongjoon Hyun edited comment on SPARK-30162 at 4/21/20, 8:15 PM: -

[jira] [Commented] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Nasir Ali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089034#comment-17089034 ] Nasir Ali commented on SPARK-30162: --- [~dongjoon] This bug has not been fixed. Please h

[jira] [Comment Edited] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089031#comment-17089031 ] Dongjoon Hyun edited comment on SPARK-30162 at 4/21/20, 8:10 PM: -

[jira] [Commented] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089031#comment-17089031 ] Dongjoon Hyun commented on SPARK-30162: --- Hi, [~sowen]. Is there a reason for you t

[jira] [Created] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-04-21 Thread Jira
Herman van Hövell created SPARK-31511: - Summary: Make BytesToBytesMap iterator() thread-safe Key: SPARK-31511 URL: https://issues.apache.org/jira/browse/SPARK-31511 Project: Spark Issue T

[jira] [Commented] (SPARK-31170) Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir

2020-04-21 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088997#comment-17088997 ] Nicholas Chammas commented on SPARK-31170: -- Isn't this also an issue in Spark 2

[jira] [Updated] (SPARK-31381) Upgrade built-in Hive 2.3.6 to 2.3.7

2020-04-21 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31381: Parent: SPARK-28684 Issue Type: Sub-task (was: Improvement) > Upgrade built-in Hive 2.3.6 to 2.3.

[jira] [Resolved] (SPARK-31503) fix the SQL string of the TRIM functions

2020-04-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31503. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28281 [https://

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088868#comment-17088868 ] Kushal Yellam commented on SPARK-10925: --- [~aseigneurin] pls help me on above issue

[jira] [Commented] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088820#comment-17088820 ] Wenchen Fan commented on SPARK-31474: - Thanks for catching! I've pushed to fix to br

[jira] [Comment Edited] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088820#comment-17088820 ] Wenchen Fan edited comment on SPARK-31474 at 4/21/20, 4:02 PM: ---

[jira] [Created] (SPARK-31510) Set setwd in R documentation build

2020-04-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31510: Summary: Set setwd in R documentation build Key: SPARK-31510 URL: https://issues.apache.org/jira/browse/SPARK-31510 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-31510) Set setwd in R documentation build

2020-04-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31510: - Priority: Trivial (was: Major) > Set setwd in R documentation build > -

[jira] [Comment Edited] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

2020-04-21 Thread Rajeev Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088785#comment-17088785 ] Rajeev Kumar edited comment on SPARK-26385 at 4/21/20, 3:31 PM: --

[jira] [Commented] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

2020-04-21 Thread Rajeev Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088785#comment-17088785 ] Rajeev Kumar commented on SPARK-26385: -- I am also facing the same issue for spark-2

[jira] [Resolved] (SPARK-31361) Rebase datetime in parquet/avro according to file metadata

2020-04-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31361. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28137 [https://gi

[jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088714#comment-17088714 ] Kushal Yellam edited comment on SPARK-10925 at 4/21/20, 1:58 PM: -

[jira] [Issue Comment Deleted] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kushal Yellam updated SPARK-10925: -- Comment: was deleted (was: Hi Team ) > Exception when joining DataFrames > --

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088715#comment-17088715 ] Kushal Yellam commented on SPARK-10925: --- Hi Team  > Exception when joining DataFr

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2020-04-21 Thread Kushal Yellam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088714#comment-17088714 ] Kushal Yellam commented on SPARK-10925: --- Hi Team  > Exception when joining DataFr

[jira] [Commented] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Jason Darrell Lowe (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088704#comment-17088704 ] Jason Darrell Lowe commented on SPARK-31474: The branch-3.0 build appears to

[jira] [Updated] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31509: - Description: Currently, barrier taskset can only be scheduled when all tasks are launched at the same time. As

[jira] [Updated] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31509: - Description: Currently, barrier taskset can only be scheduled when all tasks are launched at the same time. As

[jira] [Updated] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31509: - Description: Currently, barrier taskset can only be scheduled when all tasks are launched at same time. As a re

[jira] [Created] (SPARK-31509) Recommend user to disable delay scheduling for barrier taskset

2020-04-21 Thread wuyi (Jira)
wuyi created SPARK-31509: Summary: Recommend user to disable delay scheduling for barrier taskset Key: SPARK-31509 URL: https://issues.apache.org/jira/browse/SPARK-31509 Project: Spark Issue Type: I

[jira] [Resolved] (SPARK-31504) Output fields in formatted Explain should have determined order.

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31504. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28282 [https://gith

[jira] [Assigned] (SPARK-31504) Output fields in formatted Explain should have determined order.

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31504: --- Assignee: wuyi > Output fields in formatted Explain should have determined order. > ---

[jira] [Resolved] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31474. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28248 [https://gith

[jira] [Assigned] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31474: --- Assignee: Kent Yao > Consistancy between dayofweek/dow in extract expression and dayofweek

[jira] [Comment Edited] (SPARK-31329) Modify executor monitor to allow for moving shuffle blocks

2020-04-21 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088569#comment-17088569 ] Dale Richardson edited comment on SPARK-31329 at 4/21/20, 11:36 AM: --

[jira] [Commented] (SPARK-31329) Modify executor monitor to allow for moving shuffle blocks

2020-04-21 Thread Dale Richardson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088569#comment-17088569 ] Dale Richardson commented on SPARK-31329: - Hi Holden, I've been thinking about

[jira] [Updated] (SPARK-31508) string type compare with numberic cause data inaccurate

2020-04-21 Thread philipse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse updated SPARK-31508: - Summary: string type compare with numberic cause data inaccurate (was: string type compare with numberi

[jira] [Created] (SPARK-31508) string type compare with numberic case data inaccurate

2020-04-21 Thread philipse (Jira)
philipse created SPARK-31508: Summary: string type compare with numberic case data inaccurate Key: SPARK-31508 URL: https://issues.apache.org/jira/browse/SPARK-31508 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-28367) Kafka connector infinite wait because metadata never updated

2020-04-21 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088514#comment-17088514 ] Gabor Somogyi commented on SPARK-28367: --- I've taken a look at the possibilities gi

[jira] [Updated] (SPARK-31361) Rebase datetime in parquet/avro according to file metadata

2020-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31361: Summary: Rebase datetime in parquet/avro according to file metadata (was: Rebase datetime in parq

[jira] [Updated] (SPARK-31507) Remove millennium, century, decade, millisecond, microsecond and epoch from extract fucntion

2020-04-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31507: - Summary: Remove millennium, century, decade, millisecond, microsecond and epoch from extract fucntion (

[jira] [Created] (SPARK-31507) Remove millennium, century, decade, and epoch from extract fucntion

2020-04-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-31507: Summary: Remove millennium, century, decade, and epoch from extract fucntion Key: SPARK-31507 URL: https://issues.apache.org/jira/browse/SPARK-31507 Project: Spark

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we ca

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we ca

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we ca

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we ca

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we ca

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we ca

[jira] [Updated] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochang Wu updated SPARK-31506: - Description: BLAS are highly optimized routines by the industry. If take advantage of it, we ca

[jira] [Created] (SPARK-31506) Sparse BLAS native optimization

2020-04-21 Thread Xiaochang Wu (Jira)
Xiaochang Wu created SPARK-31506: Summary: Sparse BLAS native optimization Key: SPARK-31506 URL: https://issues.apache.org/jira/browse/SPARK-31506 Project: Spark Issue Type: Improvement