[jira] [Commented] (SPARK-20050) Kafka 0.10 DirectStream doesn't commit last processed batch's offset when graceful shutdown

2020-10-04 Thread Aditya Vikram SIngh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207852#comment-17207852 ] Aditya Vikram SIngh commented on SPARK-20050: - [~julian.eberius] , I have fa

[jira] [Commented] (SPARK-33040) Add SparkR API for invoking vector_to_array

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207833#comment-17207833 ] Apache Spark commented on SPARK-33040: -- User 'zero323' has created a pull request f

[jira] [Commented] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-10-04 Thread German Schiavon Matteo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207827#comment-17207827 ] German Schiavon Matteo commented on SPARK-31800: [~drahkar] [~jagadeesh.

[jira] [Resolved] (SPARK-33040) Add SparkR API for invoking vector_to_array

2020-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33040. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29917 [https://gi

[jira] [Assigned] (SPARK-33040) Add SparkR API for invoking vector_to_array

2020-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33040: Assignee: Maciej Szymkiewicz > Add SparkR API for invoking vector_to_array >

[jira] [Commented] (SPARK-33057) Cannot use filter with window operations

2020-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207810#comment-17207810 ] Hyukjin Kwon commented on SPARK-33057: -- The second code adds a projection and I thi

[jira] [Updated] (SPARK-33061) Expose inverse hyperbolic functions through sql.functions API

2020-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33061: - Fix Version/s: (was: 3.02) > Expose inverse hyperbolic functions through sql.functions API >

[jira] [Commented] (SPARK-33064) Spark-shell does not display accented chara

2020-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207809#comment-17207809 ] Hyukjin Kwon commented on SPARK-33064: -- I can't produce this in the current master

[jira] [Resolved] (SPARK-33064) Spark-shell does not display accented chara

2020-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33064. -- Resolution: Cannot Reproduce > Spark-shell does not display accented chara > -

[jira] [Assigned] (SPARK-33017) PySpark Context should have getCheckpointDir() method

2020-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33017: Assignee: Paul Reidy > PySpark Context should have getCheckpointDir() method > --

[jira] [Resolved] (SPARK-33017) PySpark Context should have getCheckpointDir() method

2020-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33017. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29918 [https://gi

[jira] [Updated] (SPARK-32067) Use unique ConfigMap name for executor pod template

2020-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32067: -- Summary: Use unique ConfigMap name for executor pod template (was: Executor pod template Conf

[jira] [Updated] (SPARK-33063) Improve error message for insufficient K8s volume confs

2020-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33063: -- Summary: Improve error message for insufficient K8s volume confs (was: Provide error handling

[jira] [Updated] (SPARK-32067) Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

2020-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32067: -- Priority: Major (was: Minor) > Executor pod template ConfigMap of ongoing submission got inad

[jira] [Resolved] (SPARK-33065) Expand the stack size of a thread in a test in LocalityPlacementStrategySuite for Java 11

2020-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33065. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pul

[jira] [Commented] (SPARK-33065) Expand the stack size of a thread in a test in LocalityPlacementStrategySuite for Java 11

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207781#comment-17207781 ] Apache Spark commented on SPARK-33065: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-33065) Expand the stack size of a thread in a test in LocalityPlacementStrategySuite for Java 11

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33065: Assignee: Apache Spark (was: Kousuke Saruta) > Expand the stack size of a thread in a te

[jira] [Assigned] (SPARK-33065) Expand the stack size of a thread in a test in LocalityPlacementStrategySuite for Java 11

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33065: Assignee: Kousuke Saruta (was: Apache Spark) > Expand the stack size of a thread in a te

[jira] [Assigned] (SPARK-33007) Optimize to_json + named_struct + from_json expression chain

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33007: Assignee: L. C. Hsieh (was: Apache Spark) > Optimize to_json + named_struct + from_json

[jira] [Created] (SPARK-33065) Expand the stack size of a thread in a test in LocalityPlacementStrategySuite for Java 11

2020-10-04 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33065: -- Summary: Expand the stack size of a thread in a test in LocalityPlacementStrategySuite for Java 11 Key: SPARK-33065 URL: https://issues.apache.org/jira/browse/SPARK-33065

[jira] [Commented] (SPARK-33007) Optimize to_json + named_struct + from_json expression chain

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207780#comment-17207780 ] Apache Spark commented on SPARK-33007: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-33007) Optimize to_json + named_struct + from_json expression chain

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33007: Assignee: Apache Spark (was: L. C. Hsieh) > Optimize to_json + named_struct + from_json

[jira] [Updated] (SPARK-32067) Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

2020-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32067: -- Affects Version/s: 2.4.7 3.0.1 > Executor pod template ConfigMap of ong

[jira] [Updated] (SPARK-32067) Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

2020-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32067: -- Affects Version/s: (was: 2.4.7) (was: 3.0.1)

[jira] [Updated] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33063: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Provide error handling

[jira] [Updated] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33063: -- Target Version/s: (was: 3.1.0) > Provide error handling when creating k8s volumes and clear

[jira] [Commented] (SPARK-33057) Cannot use filter with window operations

2020-10-04 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207318#comment-17207318 ] Takeshi Yamamuro commented on SPARK-33057: -- Really the same? In SQL, IIUC predi

[jira] [Updated] (SPARK-33057) Cannot use filter with window operations

2020-10-04 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33057: - Issue Type: Improvement (was: Bug) > Cannot use filter with window operations > ---

[jira] [Commented] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-10-04 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207315#comment-17207315 ] Takeshi Yamamuro commented on SPARK-21117: -- Most databases supporting that feat

[jira] [Updated] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread German Schiavon Matteo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] German Schiavon Matteo updated SPARK-33063: --- Description: Providing error handling when creating k8s volumes and clearer

[jira] [Updated] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread German Schiavon Matteo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] German Schiavon Matteo updated SPARK-33063: --- Description: Providing error handling when creating k8s volumes and clearer

[jira] [Updated] (SPARK-33064) Spark-shell does not display accented chara

2020-10-04 Thread Laurent GUEMAPPE (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent GUEMAPPE updated SPARK-33064: - Docs Text: Café Café +-+ | _c0| +-+ | Caf| |Café| +-+ was: Café C

[jira] [Updated] (SPARK-33064) Spark-shell does not display accented chara

2020-10-04 Thread Laurent GUEMAPPE (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent GUEMAPPE updated SPARK-33064: - Description: It seems to be a duplicate of *FLEX-18425*, which is duplicate of SDK-17398

[jira] [Updated] (SPARK-33064) Spark-shell does not display accented chara

2020-10-04 Thread Laurent GUEMAPPE (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent GUEMAPPE updated SPARK-33064: - Description: It seems to be a duplicate of *FLEX-18425*, which is duplicate of SDK-17398

[jira] [Updated] (SPARK-33064) Spark-shell does not display accented chara

2020-10-04 Thread Laurent GUEMAPPE (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent GUEMAPPE updated SPARK-33064: - Description: It seems to be a duplicate of *FLEX-18425*, which is duplicate of SDK-17398

[jira] [Updated] (SPARK-33064) Spark-shell does not display accented chara

2020-10-04 Thread Laurent GUEMAPPE (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent GUEMAPPE updated SPARK-33064: - Description: It seems to be a duplicate of *FLEX-18425*, which is duplicate of SDK-17398

[jira] [Created] (SPARK-33064) Spark-shell does not display accented chara

2020-10-04 Thread Laurent GUEMAPPE (Jira)
Laurent GUEMAPPE created SPARK-33064: Summary: Spark-shell does not display accented chara Key: SPARK-33064 URL: https://issues.apache.org/jira/browse/SPARK-33064 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33063: Assignee: (was: Apache Spark) > Provide error handling when creating k8s volumes and

[jira] [Assigned] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33063: Assignee: Apache Spark > Provide error handling when creating k8s volumes and clear error

[jira] [Commented] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207296#comment-17207296 ] Apache Spark commented on SPARK-33063: -- User 'Gschiavon' has created a pull request

[jira] [Assigned] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33063: Assignee: Apache Spark > Provide error handling when creating k8s volumes and clear error

[jira] [Updated] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread German Schiavon Matteo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] German Schiavon Matteo updated SPARK-33063: --- Description: Providing error handling when creating k8s volumes and clearer

[jira] [Updated] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread German Schiavon Matteo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] German Schiavon Matteo updated SPARK-33063: --- Description: Providing error handling when creating k8s volumes and clearer

[jira] [Updated] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread German Schiavon Matteo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] German Schiavon Matteo updated SPARK-33063: --- Description: Providing error handling when creating k8s volumes and clearer

[jira] [Created] (SPARK-33063) Provide error handling when creating k8s volumes and clear error messages

2020-10-04 Thread German Schiavon Matteo (Jira)
German Schiavon Matteo created SPARK-33063: -- Summary: Provide error handling when creating k8s volumes and clear error messages Key: SPARK-33063 URL: https://issues.apache.org/jira/browse/SPARK-33063

[jira] [Commented] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-10-04 Thread Richard Penney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207285#comment-17207285 ] Richard Penney commented on SPARK-21117: This looks like a really useful feature