[jira] [Resolved] (SPARK-26427) Upgrade Apache ORC to 1.5.4

2018-12-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26427. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 This is resol

[jira] [Commented] (SPARK-26427) Upgrade Apache ORC to 1.5.4

2018-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727286#comment-16727286 ] ASF GitHub Bot commented on SPARK-26427: asfgit closed pull request #23364: [SPA

[jira] [Resolved] (SPARK-26428) Minimize deprecated `ProcessingTime` usage

2018-12-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26428. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 This is resol

[jira] [Resolved] (SPARK-26430) Upgrade Surefire plugin to 3.0.0-M2

2018-12-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26430. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 This is resol

[jira] [Commented] (SPARK-26428) Minimize deprecated `ProcessingTime` usage

2018-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727288#comment-16727288 ] ASF GitHub Bot commented on SPARK-26428: asfgit closed pull request #23367: [SPA

[jira] [Commented] (SPARK-26430) Upgrade Surefire plugin to 3.0.0-M2

2018-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727293#comment-16727293 ] ASF GitHub Bot commented on SPARK-26430: asfgit closed pull request #23370: [SPA

[jira] [Commented] (SPARK-26366) Except with transform regression

2018-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727366#comment-16727366 ] ASF GitHub Bot commented on SPARK-26366: mgaido91 opened a new pull request #233

[jira] [Updated] (SPARK-26269) YarnAllocator should have same blacklist behaviour with YARN to maxmize use of cluster resource

2018-12-22 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-26269: -- Issue Type: Bug (was: Improvement) > YarnAllocator should have same blacklist behaviour with

[jira] [Resolved] (SPARK-26285) Add a metric source for accumulators (aka AccumulatorSource)

2018-12-22 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-26285. --- Resolution: Fixed Fix Version/s: 3.0.0 > Add a metric source for accumulators (aka Ac

[jira] [Assigned] (SPARK-26285) Add a metric source for accumulators (aka AccumulatorSource)

2018-12-22 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-26285: - Assignee: Alessandro Bellina > Add a metric source for accumulators (aka AccumulatorSou

[jira] [Commented] (SPARK-26285) Add a metric source for accumulators (aka AccumulatorSource)

2018-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727482#comment-16727482 ] ASF GitHub Bot commented on SPARK-26285: asfgit closed pull request #23242: [SPA

[jira] [Commented] (SPARK-14023) Make exceptions consistent regarding fields and columns

2018-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727491#comment-16727491 ] ASF GitHub Bot commented on SPARK-14023: srowen closed pull request #20500: [SPA

[jira] [Commented] (SPARK-14023) Make exceptions consistent regarding fields and columns

2018-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727490#comment-16727490 ] ASF GitHub Bot commented on SPARK-14023: srowen opened a new pull request #23373

[jira] [Assigned] (SPARK-14023) Make exceptions consistent regarding fields and columns

2018-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-14023: - Assignee: Rekha Joshi > Make exceptions consistent regarding fields and columns > -

[jira] [Commented] (SPARK-25953) install jdk11 on jenkins workers

2018-12-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727495#comment-16727495 ] shane knapp commented on SPARK-25953: - alright, java 11 is installed on all of the j

[jira] [Closed] (SPARK-26282) Update JVM to 8u191 on jenkins workers

2018-12-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp closed SPARK-26282. --- > Update JVM to 8u191 on jenkins workers > -- > > Ke

[jira] [Assigned] (SPARK-24422) Add JDK11 in our Jenkins' build servers

2018-12-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp reassigned SPARK-24422: --- Assignee: shane knapp > Add JDK11 in our Jenkins' build servers > -

[jira] [Commented] (SPARK-24422) Add JDK11 in our Jenkins' build servers

2018-12-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727496#comment-16727496 ] shane knapp commented on SPARK-24422: - alright, java 11 is installed on all of the j

[jira] [Closed] (SPARK-25953) install jdk11 on jenkins workers

2018-12-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp closed SPARK-25953. --- > install jdk11 on jenkins workers > > > Key: SPARK-259

[jira] [Resolved] (SPARK-25953) install jdk11 on jenkins workers

2018-12-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp resolved SPARK-25953. - Resolution: Duplicate dupe of https://issues.apache.org/jira/browse/SPARK-24422 > install jdk11

[jira] [Commented] (SPARK-24422) Add JDK11 in our Jenkins' build servers

2018-12-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727499#comment-16727499 ] shane knapp commented on SPARK-24422: - btw, to address earlier comments:  JDK11 will

[jira] [Assigned] (SPARK-25245) Explain regarding limiting modification on "spark.sql.shuffle.partitions" for structured streaming

2018-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25245: - Assignee: Jungtaek Lim > Explain regarding limiting modification on "spark.sql.shuffle.partitio

[jira] [Resolved] (SPARK-25245) Explain regarding limiting modification on "spark.sql.shuffle.partitions" for structured streaming

2018-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25245. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22238 [https://github.c

[jira] [Updated] (SPARK-25245) Explain regarding limiting modification on "spark.sql.shuffle.partitions" for structured streaming

2018-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25245: -- Priority: Minor (was: Major) > Explain regarding limiting modification on "spark.sql.shuffle.partitio

[jira] [Commented] (SPARK-25245) Explain regarding limiting modification on "spark.sql.shuffle.partitions" for structured streaming

2018-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727501#comment-16727501 ] ASF GitHub Bot commented on SPARK-25245: srowen closed pull request #22238: [SPA

[jira] [Commented] (SPARK-24422) Add JDK11 in our Jenkins' build servers

2018-12-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727502#comment-16727502 ] shane knapp commented on SPARK-24422: - test build started: https://amplab.cs.berkel

[jira] [Commented] (SPARK-26402) Accessing nested fields with different cases in case insensitive mode

2018-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727529#comment-16727529 ] ASF GitHub Bot commented on SPARK-26402: asfgit closed pull request #23353: [SPA

[jira] [Commented] (SPARK-26243) Use java.time API for parsing timestamps and dates from JSON

2018-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727552#comment-16727552 ] Apache Spark commented on SPARK-26243: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-26243) Use java.time API for parsing timestamps and dates from JSON

2018-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727551#comment-16727551 ] Apache Spark commented on SPARK-26243: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-26421) Spark2.4.0 integration hadoop3.1.1 causes hive sql not to use,just in idea local mode

2018-12-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727737#comment-16727737 ] Dongjoon Hyun commented on SPARK-26421: --- Hi, [~thinktothings]. This is a duplicati

[jira] [Resolved] (SPARK-26421) Spark2.4.0 integration hadoop3.1.1 causes hive sql not to use,just in idea local mode

2018-12-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26421. --- Resolution: Duplicate Target Version/s: (was: 2.4.0) > Spark2.4.0 integration ha

[jira] [Closed] (SPARK-26421) Spark2.4.0 integration hadoop3.1.1 causes hive sql not to use,just in idea local mode

2018-12-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-26421. - > Spark2.4.0 integration hadoop3.1.1 causes hive sql not to use,just in idea > local mode > ---

[jira] [Updated] (SPARK-26366) Except with transform regression

2018-12-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26366: -- Fix Version/s: 2.3.3 > Except with transform regression > > >

[jira] [Commented] (SPARK-24422) Add JDK11 in our Jenkins' build servers

2018-12-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727788#comment-16727788 ] shane knapp commented on SPARK-24422: - build is failing when attempting to build cor

[jira] [Commented] (SPARK-26421) Spark2.4.0 integration hadoop3.1.1 causes hive sql not to use,just in idea local mode

2018-12-22 Thread thinktothings (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727789#comment-16727789 ] thinktothings commented on SPARK-26421: --- Thanks, I understand this question, I hav

[jira] [Commented] (SPARK-2984) FileNotFoundException on _temporary directory

2018-12-22 Thread Gaurav Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727799#comment-16727799 ] Gaurav Kumar commented on SPARK-2984: - I am having similar issues while using spark 1