[jira] [Assigned] (SPARK-23874) Upgrade apache/arrow to 0.9.0

[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23874: Assignee: Bryan Cutler (was: Apache Spark) > Upgrade apache/arrow to 0.9.0 >

[jira] [Assigned] (SPARK-23874) Upgrade apache/arrow to 0.9.0

[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23874: Assignee: Apache Spark (was: Bryan Cutler) > Upgrade apache/arrow to 0.9.0 >

[jira] [Assigned] (SPARK-23941) Mesos task failed on specific spark app name

[ https://issues.apache.org/jira/browse/SPARK-23941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23941: Assignee: Apache Spark > Mesos task failed on specific spark app name > --

[jira] [Commented] (SPARK-23941) Mesos task failed on specific spark app name

[ https://issues.apache.org/jira/browse/SPARK-23941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431337#comment-16431337 ] Apache Spark commented on SPARK-23941: -- User 'tiboun' has created a pull request for

[jira] [Assigned] (SPARK-23941) Mesos task failed on specific spark app name

[ https://issues.apache.org/jira/browse/SPARK-23941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23941: Assignee: (was: Apache Spark) > Mesos task failed on specific spark app name > ---

[jira] [Created] (SPARK-23945) Column.isin() should accept a single-column DataFrame as input

Nicholas Chammas created SPARK-23945: Summary: Column.isin() should accept a single-column DataFrame as input Key: SPARK-23945 URL: https://issues.apache.org/jira/browse/SPARK-23945 Project: Spark

[jira] [Assigned] (SPARK-23944) Add Param set functions to LSHModel types

[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23944: Assignee: (was: Apache Spark) > Add Param set functions to LSHModel types > --

[jira] [Commented] (SPARK-23944) Add Param set functions to LSHModel types

[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431388#comment-16431388 ] Apache Spark commented on SPARK-23944: -- User 'ludatabricks' has created a pull reque

[jira] [Assigned] (SPARK-23944) Add Param set functions to LSHModel types

[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23944: Assignee: Apache Spark > Add Param set functions to LSHModel types > -

[jira] [Created] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

Christopher Hoshino-Fish created SPARK-23946: Summary: 2.3.0 and Latest ScalaDocs are linked to the wrong source code Key: SPARK-23946 URL: https://issues.apache.org/jira/browse/SPARK-23946

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431403#comment-16431403 ] Bruce Robbins commented on SPARK-23715: --- I've been convinced this is worth fixing,

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Hoshino-Fish updated SPARK-23946: - Description: Currently the 2.3.0 and Latest scaladocs point towards Samee

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23946: Shepherd: (was: Sameer Agarwal) Target Version/s: 2.3.1 > 2.3.0 and Latest ScalaDocs are link

[jira] [Updated] (SPARK-23945) Column.isin() should accept a single-column DataFrame as input

[ https://issues.apache.org/jira/browse/SPARK-23945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-23945: - Description: In SQL you can filter rows based on the result of a subquery: {code:java} SE

[jira] [Created] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

Kris Mok created SPARK-23947: Summary: Add hashUTF8String convenience method to hasher classes Key: SPARK-23947 URL: https://issues.apache.org/jira/browse/SPARK-23947 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431431#comment-16431431 ] Apache Spark commented on SPARK-23947: -- User 'rednaxelafx' has created a pull reques

[jira] [Assigned] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23947: Assignee: Apache Spark > Add hashUTF8String convenience method to hasher classes > ---

[jira] [Assigned] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23947: Assignee: (was: Apache Spark) > Add hashUTF8String convenience method to hasher classe

[jira] [Updated] (SPARK-23944) Add Param set functions to LSHModel types

[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23944: -- Fix Version/s: (was: 2.4.0) > Add Param set functions to LSHModel types > -

[jira] [Commented] (SPARK-23527) Error with spark-submit and kerberos with TLS-enabled Hadoop cluster

[ https://issues.apache.org/jira/browse/SPARK-23527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431514#comment-16431514 ] Ron Gonzalez commented on SPARK-23527: -- My admin team has resolved it, and now I get

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431555#comment-16431555 ] Yuming Wang commented on SPARK-23946: - You are right. I'm working on this. > 2.3.0 a

[jira] [Updated] (SPARK-23942) PySpark's collect doesn't trigger QueryExecutionListener

[ https://issues.apache.org/jira/browse/SPARK-23942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23942: - Component/s: PySpark > PySpark's collect doesn't trigger QueryExecutionListener > ---

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431573#comment-16431573 ] Hyukjin Kwon commented on SPARK-23946: -- Don't set the target version that's usually

[jira] [Commented] (SPARK-23732) Broken link to scala source code in Spark Scala api Scaladoc

[ https://issues.apache.org/jira/browse/SPARK-23732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431575#comment-16431575 ] Hyukjin Kwon commented on SPARK-23732: -- Let's leave SPARK-23733 resolved as a duplic

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23946: - Target Version/s: (was: 2.3.1) > 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23946: - Fix Version/s: (was: 2.3.1) > 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431576#comment-16431576 ] Hyukjin Kwon commented on SPARK-23946: -- and fix version too which is usually set whe

[jira] [Resolved] (SPARK-23733) Broken link to java source code in Spark Scala api Scaladoc

[ https://issues.apache.org/jira/browse/SPARK-23733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23733. -- Resolution: Duplicate > Broken link to java source code in Spark Scala api Scaladoc > -

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431578#comment-16431578 ] Hyukjin Kwon commented on SPARK-23946: -- and fix version too which is usually set whe

[jira] [Resolved] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23946. -- Resolution: Duplicate Let me leave this resolved as a duplicate but please let me know if I mi

[jira] [Resolved] (SPARK-23737) Scala API documentation leads to nonexistent pages for sources

[ https://issues.apache.org/jira/browse/SPARK-23737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23737. -- Resolution: Duplicate Please don't reopen this. It's resolved as a duplicate. > Scala API docu

[jira] [Commented] (SPARK-23733) Broken link to java source code in Spark Scala api Scaladoc

[ https://issues.apache.org/jira/browse/SPARK-23733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431582#comment-16431582 ] Hyukjin Kwon commented on SPARK-23733: -- Let me leave this resolved as a duplicate bu

[jira] [Commented] (SPARK-23929) pandas_udf schema mapped by position and not by name

[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431584#comment-16431584 ] Hyukjin Kwon commented on SPARK-23929: -- I think we already use positional-based appr

[jira] [Commented] (SPARK-23929) pandas_udf schema mapped by position and not by name

[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431585#comment-16431585 ] Hyukjin Kwon commented on SPARK-23929: -- Unless there's a strong reason for going ahe

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431590#comment-16431590 ] Christopher Hoshino-Fish commented on SPARK-23946: -- [~hyukjin.kwon] than

[jira] [Commented] (SPARK-23732) Broken link to scala source code in Spark Scala api Scaladoc

[ https://issues.apache.org/jira/browse/SPARK-23732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431599#comment-16431599 ] Yogesh Tewari commented on SPARK-23732: --- SPARK-23732 and SPARK-23733 are similar in

[jira] [Commented] (SPARK-23733) Broken link to java source code in Spark Scala api Scaladoc

[ https://issues.apache.org/jira/browse/SPARK-23733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431600#comment-16431600 ] Yogesh Tewari commented on SPARK-23733: --- SPARK-23732 and SPARK-23733 are similar in

[jira] [Commented] (SPARK-23748) Support select from temp tables

[ https://issues.apache.org/jira/browse/SPARK-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431609#comment-16431609 ] Apache Spark commented on SPARK-23748: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-23748) Support select from temp tables

[ https://issues.apache.org/jira/browse/SPARK-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23748: Assignee: (was: Apache Spark) > Support select from temp tables >

[jira] [Assigned] (SPARK-23748) Support select from temp tables

[ https://issues.apache.org/jira/browse/SPARK-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23748: Assignee: Apache Spark > Support select from temp tables > ---

[jira] [Assigned] (SPARK-23880) table cache should be lazy and don't trigger any jobs.

[ https://issues.apache.org/jira/browse/SPARK-23880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23880: Assignee: Apache Spark > table cache should be lazy and don't trigger any jobs. >

[jira] [Commented] (SPARK-23880) table cache should be lazy and don't trigger any jobs.

[ https://issues.apache.org/jira/browse/SPARK-23880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431638#comment-16431638 ] Apache Spark commented on SPARK-23880: -- User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-23880) table cache should be lazy and don't trigger any jobs.

[ https://issues.apache.org/jira/browse/SPARK-23880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23880: Assignee: (was: Apache Spark) > table cache should be lazy and don't trigger any jobs.

[jira] [Created] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

jin xing created SPARK-23948: Summary: Trigger mapstage's job listener in submitMissingTasks Key: SPARK-23948 URL: https://issues.apache.org/jira/browse/SPARK-23948 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

[ https://issues.apache.org/jira/browse/SPARK-23948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23948: Assignee: Apache Spark > Trigger mapstage's job listener in submitMissingTasks > -

[jira] [Assigned] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

[ https://issues.apache.org/jira/browse/SPARK-23948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23948: Assignee: (was: Apache Spark) > Trigger mapstage's job listener in submitMissingTasks

[jira] [Commented] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

[ https://issues.apache.org/jira/browse/SPARK-23948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431665#comment-16431665 ] Apache Spark commented on SPARK-23948: -- User 'jinxing64' has created a pull request

[jira] [Updated] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

[ https://issues.apache.org/jira/browse/SPARK-23948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing updated SPARK-23948: - Description: SparkContext submitted a map stage from "submitMapStage" to DAGScheduler,  "markMapStageJobA

[jira] [Assigned] (SPARK-23772) Provide an option to ignore column of all null values or empty map/array during JSON schema inference

[ https://issues.apache.org/jira/browse/SPARK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-23772: - Assignee: Takeshi Yamamuro > Provide an option to ignore column of all null values or em

[jira] [Resolved] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23947. - Resolution: Fixed Fix Version/s: 2.4.0 > Add hashUTF8String convenience method to hasher classes >

[jira] [Assigned] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23947: --- Assignee: Kris Mok > Add hashUTF8String convenience method to hasher classes > -

[jira] [Resolved] (SPARK-23898) Simplify code generation for Add/Subtract with CalendarIntervals

[ https://issues.apache.org/jira/browse/SPARK-23898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23898. - Resolution: Fixed > Simplify code generation for Add/Subtract with CalendarIntervals > --

[jira] [Commented] (SPARK-10884) Support prediction on single instance for regression and classification related models

[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431765#comment-16431765 ] zhengruifeng commented on SPARK-10884: -- Is there any plan to expose \{{predictRaw}}

[jira] [Commented] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431784#comment-16431784 ] Apache Spark commented on SPARK-23916: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-23921) High-order function: array_sort(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23921: Assignee: Apache Spark > High-order function: array_sort(x) → array >

[jira] [Commented] (SPARK-23921) High-order function: array_sort(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431793#comment-16431793 ] Apache Spark commented on SPARK-23921: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-23921) High-order function: array_sort(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23921: Assignee: (was: Apache Spark) > High-order function: array_sort(x) → array > -

[jira] [Commented] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431795#comment-16431795 ] Kazuaki Ishizaki commented on SPARK-23916: -- Sorry for my mistake regarding a PR

<    1   2