[jira] [Commented] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431795#comment-16431795 ] Kazuaki Ishizaki commented on SPARK-23916: -- Sorry for my mistake regarding a PR

[jira] [Assigned] (SPARK-23921) High-order function: array_sort(x) → array

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23921: Assignee: (was: Apache Spark) > High-order function: array_sort(x) → array > -

[jira] [Commented] (SPARK-23921) High-order function: array_sort(x) → array

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431793#comment-16431793 ] Apache Spark commented on SPARK-23921: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-23921) High-order function: array_sort(x) → array

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23921: Assignee: Apache Spark > High-order function: array_sort(x) → array >

[jira] [Commented] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431784#comment-16431784 ] Apache Spark commented on SPARK-23916: -- User 'kiszk' has created a pull request for

[jira] [Commented] (SPARK-10884) Support prediction on single instance for regression and classification related models

2018-04-09 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431765#comment-16431765 ] zhengruifeng commented on SPARK-10884: -- Is there any plan to expose \{{predictRaw}}

[jira] [Resolved] (SPARK-23898) Simplify code generation for Add/Subtract with CalendarIntervals

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23898. - Resolution: Fixed > Simplify code generation for Add/Subtract with CalendarIntervals > --

[jira] [Assigned] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23947: --- Assignee: Kris Mok > Add hashUTF8String convenience method to hasher classes > -

[jira] [Resolved] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23947. - Resolution: Fixed Fix Version/s: 2.4.0 > Add hashUTF8String convenience method to hasher classes >

[jira] [Assigned] (SPARK-23772) Provide an option to ignore column of all null values or empty map/array during JSON schema inference

2018-04-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-23772: - Assignee: Takeshi Yamamuro > Provide an option to ignore column of all null values or em

[jira] [Updated] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

2018-04-09 Thread jin xing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing updated SPARK-23948: - Description: SparkContext submitted a map stage from "submitMapStage" to DAGScheduler,  "markMapStageJobA

[jira] [Assigned] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23948: Assignee: (was: Apache Spark) > Trigger mapstage's job listener in submitMissingTasks

[jira] [Commented] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431665#comment-16431665 ] Apache Spark commented on SPARK-23948: -- User 'jinxing64' has created a pull request

[jira] [Assigned] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23948: Assignee: Apache Spark > Trigger mapstage's job listener in submitMissingTasks > -

[jira] [Created] (SPARK-23948) Trigger mapstage's job listener in submitMissingTasks

2018-04-09 Thread jin xing (JIRA)
jin xing created SPARK-23948: Summary: Trigger mapstage's job listener in submitMissingTasks Key: SPARK-23948 URL: https://issues.apache.org/jira/browse/SPARK-23948 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-23880) table cache should be lazy and don't trigger any jobs.

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23880: Assignee: (was: Apache Spark) > table cache should be lazy and don't trigger any jobs.

[jira] [Commented] (SPARK-23880) table cache should be lazy and don't trigger any jobs.

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431638#comment-16431638 ] Apache Spark commented on SPARK-23880: -- User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-23880) table cache should be lazy and don't trigger any jobs.

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23880: Assignee: Apache Spark > table cache should be lazy and don't trigger any jobs. >

[jira] [Assigned] (SPARK-23748) Support select from temp tables

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23748: Assignee: Apache Spark > Support select from temp tables > ---

[jira] [Assigned] (SPARK-23748) Support select from temp tables

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23748: Assignee: (was: Apache Spark) > Support select from temp tables >

[jira] [Commented] (SPARK-23748) Support select from temp tables

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431609#comment-16431609 ] Apache Spark commented on SPARK-23748: -- User 'jerryshao' has created a pull request

[jira] [Commented] (SPARK-23733) Broken link to java source code in Spark Scala api Scaladoc

2018-04-09 Thread Yogesh Tewari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431600#comment-16431600 ] Yogesh Tewari commented on SPARK-23733: --- SPARK-23732 and SPARK-23733 are similar in

[jira] [Commented] (SPARK-23732) Broken link to scala source code in Spark Scala api Scaladoc

2018-04-09 Thread Yogesh Tewari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431599#comment-16431599 ] Yogesh Tewari commented on SPARK-23732: --- SPARK-23732 and SPARK-23733 are similar in

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Christopher Hoshino-Fish (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431590#comment-16431590 ] Christopher Hoshino-Fish commented on SPARK-23946: -- [~hyukjin.kwon] than

[jira] [Commented] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431585#comment-16431585 ] Hyukjin Kwon commented on SPARK-23929: -- Unless there's a strong reason for going ahe

[jira] [Commented] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431584#comment-16431584 ] Hyukjin Kwon commented on SPARK-23929: -- I think we already use positional-based appr

[jira] [Commented] (SPARK-23733) Broken link to java source code in Spark Scala api Scaladoc

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431582#comment-16431582 ] Hyukjin Kwon commented on SPARK-23733: -- Let me leave this resolved as a duplicate bu

[jira] [Resolved] (SPARK-23737) Scala API documentation leads to nonexistent pages for sources

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23737. -- Resolution: Duplicate Please don't reopen this. It's resolved as a duplicate. > Scala API docu

[jira] [Resolved] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23946. -- Resolution: Duplicate Let me leave this resolved as a duplicate but please let me know if I mi

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431578#comment-16431578 ] Hyukjin Kwon commented on SPARK-23946: -- and fix version too which is usually set whe

[jira] [Resolved] (SPARK-23733) Broken link to java source code in Spark Scala api Scaladoc

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23733. -- Resolution: Duplicate > Broken link to java source code in Spark Scala api Scaladoc > -

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431576#comment-16431576 ] Hyukjin Kwon commented on SPARK-23946: -- and fix version too which is usually set whe

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23946: - Fix Version/s: (was: 2.3.1) > 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[jira] [Commented] (SPARK-23732) Broken link to scala source code in Spark Scala api Scaladoc

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431575#comment-16431575 ] Hyukjin Kwon commented on SPARK-23732: -- Let's leave SPARK-23733 resolved as a duplic

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23946: - Target Version/s: (was: 2.3.1) > 2.3.0 and Latest ScalaDocs are linked to the wrong source code

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431573#comment-16431573 ] Hyukjin Kwon commented on SPARK-23946: -- Don't set the target version that's usually

[jira] [Updated] (SPARK-23942) PySpark's collect doesn't trigger QueryExecutionListener

2018-04-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23942: - Component/s: PySpark > PySpark's collect doesn't trigger QueryExecutionListener > ---

[jira] [Commented] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431555#comment-16431555 ] Yuming Wang commented on SPARK-23946: - You are right. I'm working on this. > 2.3.0 a

[jira] [Commented] (SPARK-23527) Error with spark-submit and kerberos with TLS-enabled Hadoop cluster

2018-04-09 Thread Ron Gonzalez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431514#comment-16431514 ] Ron Gonzalez commented on SPARK-23527: -- My admin team has resolved it, and now I get

[jira] [Updated] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23944: -- Fix Version/s: (was: 2.4.0) > Add Param set functions to LSHModel types > -

[jira] [Assigned] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23947: Assignee: (was: Apache Spark) > Add hashUTF8String convenience method to hasher classe

[jira] [Assigned] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23947: Assignee: Apache Spark > Add hashUTF8String convenience method to hasher classes > ---

[jira] [Commented] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431431#comment-16431431 ] Apache Spark commented on SPARK-23947: -- User 'rednaxelafx' has created a pull reques

[jira] [Created] (SPARK-23947) Add hashUTF8String convenience method to hasher classes

2018-04-09 Thread Kris Mok (JIRA)
Kris Mok created SPARK-23947: Summary: Add hashUTF8String convenience method to hasher classes Key: SPARK-23947 URL: https://issues.apache.org/jira/browse/SPARK-23947 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-23945) Column.isin() should accept a single-column DataFrame as input

2018-04-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-23945: - Description: In SQL you can filter rows based on the result of a subquery: {code:java} SE

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23946: Shepherd: (was: Sameer Agarwal) Target Version/s: 2.3.1 > 2.3.0 and Latest ScalaDocs are link

[jira] [Updated] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Christopher Hoshino-Fish (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Hoshino-Fish updated SPARK-23946: - Description: Currently the 2.3.0 and Latest scaladocs point towards Samee

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

2018-04-09 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431403#comment-16431403 ] Bruce Robbins commented on SPARK-23715: --- I've been convinced this is worth fixing,

[jira] [Created] (SPARK-23946) 2.3.0 and Latest ScalaDocs are linked to the wrong source code

2018-04-09 Thread Christopher Hoshino-Fish (JIRA)
Christopher Hoshino-Fish created SPARK-23946: Summary: 2.3.0 and Latest ScalaDocs are linked to the wrong source code Key: SPARK-23946 URL: https://issues.apache.org/jira/browse/SPARK-23946

[jira] [Assigned] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23944: Assignee: Apache Spark > Add Param set functions to LSHModel types > -

[jira] [Commented] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431388#comment-16431388 ] Apache Spark commented on SPARK-23944: -- User 'ludatabricks' has created a pull reque

[jira] [Assigned] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23944: Assignee: (was: Apache Spark) > Add Param set functions to LSHModel types > --

[jira] [Created] (SPARK-23945) Column.isin() should accept a single-column DataFrame as input

2018-04-09 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-23945: Summary: Column.isin() should accept a single-column DataFrame as input Key: SPARK-23945 URL: https://issues.apache.org/jira/browse/SPARK-23945 Project: Spark

[jira] [Assigned] (SPARK-23941) Mesos task failed on specific spark app name

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23941: Assignee: (was: Apache Spark) > Mesos task failed on specific spark app name > ---

[jira] [Assigned] (SPARK-23941) Mesos task failed on specific spark app name

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23941: Assignee: Apache Spark > Mesos task failed on specific spark app name > --

[jira] [Commented] (SPARK-23941) Mesos task failed on specific spark app name

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431337#comment-16431337 ] Apache Spark commented on SPARK-23941: -- User 'tiboun' has created a pull request for

[jira] [Assigned] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23874: Assignee: Apache Spark (was: Bryan Cutler) > Upgrade apache/arrow to 0.9.0 >

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431287#comment-16431287 ] Apache Spark commented on SPARK-23874: -- User 'BryanCutler' has created a pull reques

[jira] [Assigned] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23874: Assignee: Bryan Cutler (was: Apache Spark) > Upgrade apache/arrow to 0.9.0 >

[jira] [Commented] (SPARK-22919) Bump Apache httpclient versions

2018-04-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431198#comment-16431198 ] Steve Loughran commented on SPARK-22919: going to highlight this appears to break

[jira] [Comment Edited] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431188#comment-16431188 ] Li Jin edited comment on SPARK-23929 at 4/9/18 8:39 PM: I think t

[jira] [Comment Edited] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431188#comment-16431188 ] Li Jin edited comment on SPARK-23929 at 4/9/18 8:39 PM: I think t

[jira] [Created] (SPARK-23944) Add Param set functions to LSHModel types

2018-04-09 Thread Lu Wang (JIRA)
Lu Wang created SPARK-23944: --- Summary: Add Param set functions to LSHModel types Key: SPARK-23944 URL: https://issues.apache.org/jira/browse/SPARK-23944 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431188#comment-16431188 ] Li Jin commented on SPARK-23929: I think there are pros and cons for both matching by pos

[jira] [Comment Edited] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431099#comment-16431099 ] Andrew Otto edited comment on SPARK-23890 at 4/9/18 7:32 PM: -

[jira] [Commented] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431099#comment-16431099 ] Andrew Otto commented on SPARK-23890: - Hah! As a temporary workaround, we are [instan

[jira] [Comment Edited] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431099#comment-16431099 ] Andrew Otto edited comment on SPARK-23890 at 4/9/18 7:31 PM: -

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

2018-04-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431100#comment-16431100 ] Maciej Bryński commented on SPARK-16996: [~ste...@apache.org] Are you prepared to

[jira] [Comment Edited] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431099#comment-16431099 ] Andrew Otto edited comment on SPARK-23890 at 4/9/18 7:31 PM: -

[jira] [Comment Edited] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431099#comment-16431099 ] Andrew Otto edited comment on SPARK-23890 at 4/9/18 7:31 PM: -

[jira] [Resolved] (SPARK-14681) Provide label/impurity stats for spark.ml decision tree nodes

2018-04-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14681. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20786 [h

[jira] [Assigned] (SPARK-14681) Provide label/impurity stats for spark.ml decision tree nodes

2018-04-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-14681: - Assignee: Weichen Xu > Provide label/impurity stats for spark.ml decision tree n

[jira] [Assigned] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23890: Assignee: Apache Spark > Hive ALTER TABLE CHANGE COLUMN for struct type no longer works >

[jira] [Commented] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431082#comment-16431082 ] Apache Spark commented on SPARK-23890: -- User 'ottomata' has created a pull request f

[jira] [Assigned] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23890: Assignee: (was: Apache Spark) > Hive ALTER TABLE CHANGE COLUMN for struct type no long

[jira] [Updated] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2018-04-09 Thread Andrew Otto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Otto updated SPARK-23890: External issue URL: https://github.com/apache/spark/pull/21012 > Hive ALTER TABLE CHANGE COLUMN for

[jira] [Commented] (SPARK-21005) VectorIndexerModel does not prepare output column field correctly

2018-04-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431079#comment-16431079 ] Joseph K. Bradley commented on SPARK-21005: --- I don't actually see why this is a

[jira] [Resolved] (SPARK-22856) Add wrapper for codegen output and nullability

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22856. - Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.4.0 > Add wrapper for codege

[jira] [Comment Edited] (SPARK-23923) High-order function: cardinality(x) → bigint

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431009#comment-16431009 ] Kazuaki Ishizaki edited comment on SPARK-23923 at 4/9/18 6:36 PM: -

[jira] [Resolved] (SPARK-23816) FetchFailedException when killing speculative task

2018-04-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23816. Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 2.

[jira] [Commented] (SPARK-23921) High-order function: array_sort(x) → array

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431037#comment-16431037 ] Kazuaki Ishizaki commented on SPARK-23921: -- I am working for this > High-order

[jira] [Assigned] (SPARK-23816) FetchFailedException when killing speculative task

2018-04-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23816: -- Assignee: Imran Rashid > FetchFailedException when killing speculative task >

[jira] [Commented] (SPARK-23929) pandas_udf schema mapped by position and not by name

2018-04-09 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431014#comment-16431014 ] Bryan Cutler commented on SPARK-23929: -- cc [~icexelloss] > pandas_udf schema mapped

[jira] [Comment Edited] (SPARK-23919) High-order function: array_position(x, element) → bigint

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431004#comment-16431004 ] Kazuaki Ishizaki edited comment on SPARK-23919 at 4/9/18 6:19 PM: -

[jira] [Commented] (SPARK-23923) High-order function: cardinality(x) → bigint

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431009#comment-16431009 ] Kazuaki Ishizaki commented on SPARK-23923: -- I am working for this. > High-order

[jira] [Commented] (SPARK-23919) High-order function: array_position(x, element) → bigint

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431004#comment-16431004 ] Kazuaki Ishizaki commented on SPARK-23919: -- I am working for this. > High-order

[jira] [Commented] (SPARK-23924) High-order function: element_at

2018-04-09 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431002#comment-16431002 ] Kazuaki Ishizaki commented on SPARK-23924: -- I will work for this. > High-order

[jira] [Resolved] (SPARK-23881) Flaky test: JobCancellationSuite."interruptible iterator of shuffle reader"

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23881. - Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.4.0 2.3.1 >

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-04-09 Thread Edwina Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430922#comment-16430922 ] Edwina Lu commented on SPARK-23206: --- The doc wasn't very clear what the quantile values

[jira] [Assigned] (SPARK-23906) Add UDF trunc(numeric)

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23906: --- Assignee: Yuming Wang > Add UDF trunc(numeric) > -- > > Key: SPA

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-04-09 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430836#comment-16430836 ] Imran Rashid commented on SPARK-23206: -- ah of course, that makes sense -- quantiles

[jira] [Assigned] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23916: Assignee: Apache Spark > High-order function: array_join(x, delimiter, null_replacement) →

[jira] [Commented] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430808#comment-16430808 ] Apache Spark commented on SPARK-23916: -- User 'mgaido91' has created a pull request f

[jira] [Assigned] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar

2018-04-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23916: Assignee: (was: Apache Spark) > High-order function: array_join(x, delimiter, null_rep

[jira] [Issue Comment Deleted] (SPARK-23906) Add UDF trunc(numeric)

2018-04-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23906: Comment: was deleted (was: Duplicate with SPARK-20754's {{TRUNC}}?) > Add UDF trunc(numeric) > ---

[jira] [Commented] (SPARK-23925) High-order function: repeat(element, count) → array

2018-04-09 Thread Florent Pepin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430771#comment-16430771 ] Florent Pepin commented on SPARK-23925: --- Hi, I am new to Spark and I am interested

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-04-09 Thread Edwina Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430765#comment-16430765 ] Edwina Lu commented on SPARK-23206: --- [~irashid], this would be quantile values for peak

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430763#comment-16430763 ] Xiao Li commented on SPARK-23206: - cc [~jiangxb1987] [~Gengliang.Wang]  > Additional Mem

[jira] [Commented] (SPARK-23906) Add UDF trunc(numeric)

2018-04-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430761#comment-16430761 ] Xiao Li commented on SPARK-23906: - [~q79969786] Could you link your PR to this JIRA? > A

[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer/MesosClusterDispatcher

2018-04-09 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] paul mackles updated SPARK-23943: - Description: Two changes: First, a more robust [health-check|[http://mesosphere.github.io/marat

  1   2   >