[jira] [Created] (SPARK-28167) Show global temporary view in database tool

2019-06-25 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28167: --- Summary: Show global temporary view in database tool Key: SPARK-28167 URL: https://issues.apache.org/jira/browse/SPARK-28167 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22340: Assignee: (was: Apache Spark) > pyspark setJobGroup doesn't match java threads >

[jira] [Assigned] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22340: Assignee: Apache Spark > pyspark setJobGroup doesn't match java threads >

[jira] [Reopened] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-22340: -- > pyspark setJobGroup doesn't match java threads > --

[jira] [Updated] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22340: - Labels: (was: bulk-closed) > pyspark setJobGroup doesn't match java threads >

[jira] [Commented] (SPARK-28164) usage description does not match with shell scripts

2019-06-25 Thread Hanna Kan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872873#comment-16872873 ] Hanna Kan commented on SPARK-28164: --- but if you add some options such as "{{sbin/start-slave.sh -c

[jira] [Resolved] (SPARK-27656) Safely register class for GraphX

2019-06-25 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-27656. -- Resolution: Not A Problem > Safely register class for GraphX >

[jira] [Updated] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-06-25 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-28159: - Description: It is a long time since ML was released. However, there are still many TODOs

[jira] [Commented] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2019-06-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872852#comment-16872852 ] Liang-Chi Hsieh commented on SPARK-22340: - [~hyukjin.kwon] Should we reopen this as you are open

[jira] [Resolved] (SPARK-27676) InMemoryFileIndex should hard-fail on missing files instead of logging and continuing

2019-06-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27676. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24668

[jira] [Commented] (SPARK-27802) SparkUI throws NoSuchElementException when inconsistency appears between `ExecutorStageSummaryWrapper`s and `ExecutorSummaryWrapper`s

2019-06-25 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872740#comment-16872740 ] shahid commented on SPARK-27802: Could you please provide a reproducible step for the issue? > SparkUI

[jira] [Commented] (SPARK-28152) ShortType and FloatTypes are not correctly mapped to right JDBC types when using JDBC connector

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872739#comment-16872739 ] Shiv Prashant Sood commented on SPARK-28152: Resolved as part of

[jira] [Updated] (SPARK-28151) ByteType, ShortType and FloatTypes are not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiv Prashant Sood updated SPARK-28151: --- Description: ##ByteType issue Writing dataframe with column type BYTETYPE fails

[jira] [Updated] (SPARK-28151) ByteType, ShortType and FloatTypes are not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiv Prashant Sood updated SPARK-28151: --- Summary: ByteType, ShortType and FloatTypes are not correctly mapped for read/write

[jira] [Updated] (SPARK-28152) ShortType and FloatTypes are not correctly mapped to right JDBC types when using JDBC connector

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiv Prashant Sood updated SPARK-28152: --- Description: ShortType and FloatTypes are not correctly mapped to right JDBC types

[jira] [Updated] (SPARK-28166) Query optimization for symmetric difference / disjunctive union of Datasets

2019-06-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-28166: --- Description: The *symmetric difference* (a.k.a. *disjunctive union*) of two sets is their set

[jira] [Created] (SPARK-28166) Query optimization for symmetric difference / disjunctive union of Datasets

2019-06-25 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-28166: -- Summary: Query optimization for symmetric difference / disjunctive union of Datasets Key: SPARK-28166 URL: https://issues.apache.org/jira/browse/SPARK-28166 Project:

[jira] [Commented] (SPARK-25390) data source V2 API refactoring

2019-06-25 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872684#comment-16872684 ] Lars Francke commented on SPARK-25390: -- Is there any kind of end-user documentation for this on how

[jira] [Commented] (SPARK-28135) ceil/ceiling/floor/power returns incorrect values

2019-06-25 Thread Tony Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872657#comment-16872657 ] Tony Zhang commented on SPARK-28135: As commented in the PR, to fix this overflow, we should not

[jira] [Resolved] (SPARK-27630) Stage retry causes totalRunningTasks calculation to be negative

2019-06-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-27630. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24497

[jira] [Assigned] (SPARK-27630) Stage retry causes totalRunningTasks calculation to be negative

2019-06-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-27630: Assignee: dzcxzl > Stage retry causes totalRunningTasks calculation to be negative >

[jira] [Updated] (SPARK-28157) Make SHS clear KVStore LogInfo for the blacklisted entries

2019-06-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28157: -- Summary: Make SHS clear KVStore LogInfo for the blacklisted entries (was: Make SHS check

[jira] [Commented] (SPARK-28151) ByteType is not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Shiv Prashant Sood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872577#comment-16872577 ] Shiv Prashant Sood commented on SPARK-28151: Fixed by 

[jira] [Assigned] (SPARK-28151) ByteType is not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28151: Assignee: Apache Spark > ByteType is not correctly mapped for read/write of SQLServer

[jira] [Assigned] (SPARK-28151) ByteType is not correctly mapped for read/write of SQLServer tables

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28151: Assignee: (was: Apache Spark) > ByteType is not correctly mapped for read/write of

[jira] [Commented] (SPARK-28164) usage description does not match with shell scripts

2019-06-25 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872556#comment-16872556 ] Shivu Sondur commented on SPARK-28164: -- [~hannankan]  ./sbin/start-slave.sh  it will start

[jira] [Created] (SPARK-28165) SHS does not delete old inprogress files until cleaner.maxAge after SHS start time

2019-06-25 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-28165: Summary: SHS does not delete old inprogress files until cleaner.maxAge after SHS start time Key: SPARK-28165 URL: https://issues.apache.org/jira/browse/SPARK-28165

[jira] [Commented] (SPARK-28114) Add Jenkins job for `Hadoop-3.2` profile

2019-06-25 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872530#comment-16872530 ] shane knapp commented on SPARK-28114: - [~dongjoon] the `--force` came back because someone manually

[jira] [Resolved] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

2019-06-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27622. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24554

[jira] [Assigned] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

2019-06-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27622: -- Assignee: Attila Zsolt Piros > Avoid the network when block manager fetches disk

[jira] [Updated] (SPARK-28145) Executor pods polling source can fail to replace dead executors

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28145: -- Priority: Minor (was: Major) Issue Type: Improvement (was: New Feature) > Executor pods

[jira] [Resolved] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26985. --- Resolution: Fixed Assignee: ketan kunde Fix Version/s: 3.0.0 Resolved by

[jira] [Resolved] (SPARK-28154) GMM fix double caching

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28154. --- Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 3.0.0

[jira] [Assigned] (SPARK-28117) LDA and BisectingKMeans cache the input dataset if necessary

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28117: - Assignee: zhengruifeng > LDA and BisectingKMeans cache the input dataset if necessary >

[jira] [Resolved] (SPARK-28117) LDA and BisectingKMeans cache the input dataset if necessary

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28117. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24920

[jira] [Updated] (SPARK-28117) LDA and BisectingKMeans cache the input dataset if necessary

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28117: -- Priority: Minor (was: Major) > LDA and BisectingKMeans cache the input dataset if necessary >

[jira] [Updated] (SPARK-28045) add missing RankingEvaluator

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28045: -- Priority: Minor (was: Major) > add missing RankingEvaluator > > >

[jira] [Assigned] (SPARK-28045) add missing RankingEvaluator

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28045: - Assignee: zhengruifeng > add missing RankingEvaluator > > >

[jira] [Resolved] (SPARK-28045) add missing RankingEvaluator

2019-06-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28045. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24869

[jira] [Created] (SPARK-28164) usage description does not match with shell scripts

2019-06-25 Thread Hanna Kan (JIRA)
Hanna Kan created SPARK-28164: - Summary: usage description does not match with shell scripts Key: SPARK-28164 URL: https://issues.apache.org/jira/browse/SPARK-28164 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28163) Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS

2019-06-25 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28163: -- Description: There are "unsafe" conversions in the Kafka connector. CaseInsensitiveStringMap

[jira] [Assigned] (SPARK-28163) Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28163: Assignee: Apache Spark > Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and

[jira] [Assigned] (SPARK-28163) Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28163: Assignee: (was: Apache Spark) > Kafka ignores user configuration on

[jira] [Updated] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28157: -- Description: At Spark 2.4.0/2.3.2/2.2.3, SPARK-24948 delegated access permission checks to

[jira] [Created] (SPARK-28163) Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS

2019-06-25 Thread Gabor Somogyi (JIRA)
Gabor Somogyi created SPARK-28163: - Summary: Kafka ignores user configuration on FETCH_OFFSET_NUM_RETRY and FETCH_OFFSET_RETRY_INTERVAL_MS Key: SPARK-28163 URL: https://issues.apache.org/jira/browse/SPARK-28163

[jira] [Assigned] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28157: Assignee: Apache Spark > Make SHS check Spark event log file permission changes >

[jira] [Assigned] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28157: Assignee: (was: Apache Spark) > Make SHS check Spark event log file permission

[jira] [Created] (SPARK-28162) approximSimilarityJoin creating a bottleneck

2019-06-25 Thread Simone Iovane (JIRA)
Simone Iovane created SPARK-28162: - Summary: approximSimilarityJoin creating a bottleneck Key: SPARK-28162 URL: https://issues.apache.org/jira/browse/SPARK-28162 Project: Spark Issue Type:

[jira] [Reopened] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-28157: --- > Make SHS check Spark event log file permission changes >

[jira] [Issue Comment Deleted] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28157: -- Comment: was deleted (was: My bad. This issue is invalid.) > Make SHS check Spark event log

[jira] [Assigned] (SPARK-27463) Support Dataframe Cogroup via Pandas UDFs

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27463: Assignee: Apache Spark > Support Dataframe Cogroup via Pandas UDFs >

[jira] [Assigned] (SPARK-27463) Support Dataframe Cogroup via Pandas UDFs

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27463: Assignee: (was: Apache Spark) > Support Dataframe Cogroup via Pandas UDFs >

[jira] [Assigned] (SPARK-28160) TransportClient.sendRpcSync may hang forever

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28160: Assignee: (was: Apache Spark) > TransportClient.sendRpcSync may hang forever >

[jira] [Assigned] (SPARK-28160) TransportClient.sendRpcSync may hang forever

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28160: Assignee: Apache Spark > TransportClient.sendRpcSync may hang forever >

[jira] [Commented] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872216#comment-16872216 ] Steve Loughran commented on SPARK-28091: (FWIW, I really like codahale; lines up very nicely

[jira] [Commented] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872214#comment-16872214 ] Steve Loughran commented on SPARK-28091: thanks for the links. FWIW, if you call toString() on

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Description: Trying to build spark from source based on the Dockerfile attached locally

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Description: Trying to build spark from source based on the Dockerfile attached locally

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Environment: {code} # Dockerfile # Pull base image. FROM ubuntu:16.04 RUN apt update

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Environment: {code:docker} # Dockerfile # Pull base image. FROM ubuntu:16.04 RUN apt update

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Environment: {quote}# Dockerfile # Pull base image. FROM ubuntu:16.04 RUN apt update

[jira] [Updated] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Nigsch updated SPARK-28161: -- Environment: # Dockerfile # Pull base image. FROM ubuntu:16.04 RUN apt update --fix-missing

[jira] [Created] (SPARK-28161) Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212

2019-06-25 Thread Martin Nigsch (JIRA)
Martin Nigsch created SPARK-28161: - Summary: Can't build Spark 2.4.3 based on Ubuntu and Oracle Java 8 SDK v212 Key: SPARK-28161 URL: https://issues.apache.org/jira/browse/SPARK-28161 Project: Spark

[jira] [Created] (SPARK-28160) TransportClient.sendRpcSync may hang forever

2019-06-25 Thread Lantao Jin (JIRA)
Lantao Jin created SPARK-28160: -- Summary: TransportClient.sendRpcSync may hang forever Key: SPARK-28160 URL: https://issues.apache.org/jira/browse/SPARK-28160 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-28036) Built-in udf left/right has inconsistent behavior

2019-06-25 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872045#comment-16872045 ] Shivu Sondur edited comment on SPARK-28036 at 6/25/19 8:30 AM: --- [~yumwang]

[jira] [Assigned] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28159: Assignee: (was: Apache Spark) > Make the transform natively in ml framework to avoid

[jira] [Assigned] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28159: Assignee: Apache Spark > Make the transform natively in ml framework to avoid extra

[jira] [Created] (SPARK-28159) Make the transform natively in ml framework to avoid extra conversion

2019-06-25 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-28159: Summary: Make the transform natively in ml framework to avoid extra conversion Key: SPARK-28159 URL: https://issues.apache.org/jira/browse/SPARK-28159 Project: Spark

[jira] [Commented] (SPARK-28091) Extend Spark metrics system with executor plugin metrics

2019-06-25 Thread Luca Canali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872075#comment-16872075 ] Luca Canali commented on SPARK-28091: - Thank you [~ste...@apache.org] for your comment and

[jira] [Assigned] (SPARK-28149) Disable negeative DNS caching

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28149: Assignee: (was: Apache Spark) > Disable negeative DNS caching >

[jira] [Assigned] (SPARK-28149) Disable negeative DNS caching

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28149: Assignee: Apache Spark > Disable negeative DNS caching > - >

[jira] [Assigned] (SPARK-28158) Hive UDFs supports UDT type

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28158: Assignee: (was: Apache Spark) > Hive UDFs supports UDT type >

[jira] [Assigned] (SPARK-28158) Hive UDFs supports UDT type

2019-06-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28158: Assignee: Apache Spark > Hive UDFs supports UDT type > --- > >

[jira] [Created] (SPARK-28158) Hive UDFs supports UDT type

2019-06-25 Thread Genmao Yu (JIRA)
Genmao Yu created SPARK-28158: - Summary: Hive UDFs supports UDT type Key: SPARK-28158 URL: https://issues.apache.org/jira/browse/SPARK-28158 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-28157) Make SHS check Spark event log file permission changes

2019-06-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28157. --- Resolution: Invalid My bad. This issue is invalid. > Make SHS check Spark event log file

[jira] [Commented] (SPARK-28036) Built-in udf left/right has inconsistent behavior

2019-06-25 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872050#comment-16872050 ] Yuming Wang commented on SPARK-28036: - {code:sql} [root@spark-3267648

[jira] [Commented] (SPARK-28036) Built-in udf left/right has inconsistent behavior

2019-06-25 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872045#comment-16872045 ] Shivu Sondur commented on SPARK-28036: -- [~yumwang] select left('ahoj', 2), right('ahoj', 2); use