[jira] [Created] (SPARK-25573) Combine resolveExpression and resolve in the rule ResolveReferences

Xiao Li created SPARK-25573: --- Summary: Combine resolveExpression and resolve in the rule ResolveReferences Key: SPARK-25573 URL: https://issues.apache.org/jira/browse/SPARK-25573 Project: Spark Is

[jira] [Commented] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632796#comment-16632796 ] Apache Spark commented on SPARK-25572: -- User 'felixcheung' has created a pull reque

[jira] [Updated] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25572: - Summary: SparkR tests failed on CRAN on Java 10 (was: SparkR to skip tests because Java 10) >

[jira] [Assigned] (SPARK-25572) SparkR to skip tests because Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25572: Assignee: Apache Spark (was: Felix Cheung) > SparkR to skip tests because Java 10 >

[jira] [Commented] (SPARK-25572) SparkR to skip tests because Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632795#comment-16632795 ] Apache Spark commented on SPARK-25572: -- User 'felixcheung' has created a pull reque

[jira] [Assigned] (SPARK-25572) SparkR to skip tests because Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25572: Assignee: Felix Cheung (was: Apache Spark) > SparkR to skip tests because Java 10 >

[jira] [Created] (SPARK-25572) SparkR to skip tests because Java 10

Felix Cheung created SPARK-25572: Summary: SparkR to skip tests because Java 10 Key: SPARK-25572 URL: https://issues.apache.org/jira/browse/SPARK-25572 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-25571) Add withColumnsRenamed method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-25571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632777#comment-16632777 ] Chaerim Yeo commented on SPARK-25571: - I'm working on it now. > Add withColumnsRena

[jira] [Created] (SPARK-25571) Add withColumnsRenamed method to Dataset

Chaerim Yeo created SPARK-25571: --- Summary: Add withColumnsRenamed method to Dataset Key: SPARK-25571 URL: https://issues.apache.org/jira/browse/SPARK-25571 Project: Spark Issue Type: Improvemen

[jira] [Commented] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632771#comment-16632771 ] Apache Spark commented on SPARK-25262: -- User 'viirya' has created a pull request fo

[jira] [Resolved] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-25570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25570. -- Resolution: Fixed Fix Version/s: 2.4.1 2.3.3 2.5.0

[jira] [Assigned] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-25570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25570: Assignee: Dongjoon Hyun > Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite >

[jira] [Commented] (SPARK-25538) incorrect row counts after distinct()

[ https://issues.apache.org/jira/browse/SPARK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632729#comment-16632729 ] Steven Rand commented on SPARK-25538: - [~kiszk] that makes sense, I'll try to do so.

[jira] [Resolved] (SPARK-25559) Just remove the unsupported predicates in Parquet

[ https://issues.apache.org/jira/browse/SPARK-25559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25559. --- Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22574 [https://

[jira] [Commented] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-25570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632667#comment-16632667 ] Apache Spark commented on SPARK-25570: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-25570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25570: Assignee: (was: Apache Spark) > Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersio

[jira] [Commented] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-25570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632666#comment-16632666 ] Apache Spark commented on SPARK-25570: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-25570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25570: Assignee: Apache Spark > Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite > -

[jira] [Created] (SPARK-25570) Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

Dongjoon Hyun created SPARK-25570: - Summary: Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite Key: SPARK-25570 URL: https://issues.apache.org/jira/browse/SPARK-25570 Project: Spark

[jira] [Resolved] (SPARK-25449) Don't send zero accumulators in heartbeats

[ https://issues.apache.org/jira/browse/SPARK-25449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-25449. -- Resolution: Fixed Assignee: Mukul Murthy Fix Version/s: 2.5.0 > Don't send zer

[jira] [Resolved] (SPARK-25429) SparkListenerBus inefficient due to 'LiveStageMetrics#accumulatorIds:Array[Long]' data structure

[ https://issues.apache.org/jira/browse/SPARK-25429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25429. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.5.0 > SparkListenerBus ineffici

[jira] [Resolved] (SPARK-25458) Support FOR ALL COLUMNS in ANALYZE TABLE

[ https://issues.apache.org/jira/browse/SPARK-25458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25458. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.5.0 > Support FOR ALL COLUMNS

[jira] [Created] (SPARK-25569) Failing a Spark job when an accumulator cannot be updated

Shixiong Zhu created SPARK-25569: Summary: Failing a Spark job when an accumulator cannot be updated Key: SPARK-25569 URL: https://issues.apache.org/jira/browse/SPARK-25569 Project: Spark Iss

[jira] [Commented] (SPARK-25542) Flaky test: OpenHashMapSuite

[ https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632568#comment-16632568 ] Dongjoon Hyun commented on SPARK-25542: --- I marked this as 2.4.1 because we are in

[jira] [Updated] (SPARK-25542) Flaky test: OpenHashMapSuite

[ https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25542: -- Fix Version/s: (was: 2.4.0) 2.4.1 > Flaky test: OpenHashMapSuite >

[jira] [Assigned] (SPARK-25542) Flaky test: OpenHashMapSuite

[ https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25542: - Assignee: Liang-Chi Hsieh > Flaky test: OpenHashMapSuite >

[jira] [Resolved] (SPARK-25542) Flaky test: OpenHashMapSuite

[ https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25542. --- Resolution: Fixed Resolved via https://github.com/apache/spark/pull/22569 > Flaky test: Ope

[jira] [Updated] (SPARK-25542) Flaky test: OpenHashMapSuite

[ https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25542: -- Fix Version/s: 2.4.0 > Flaky test: OpenHashMapSuite > > >

[jira] [Assigned] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator

[ https://issues.apache.org/jira/browse/SPARK-25568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25568: Assignee: Apache Spark (was: Shixiong Zhu) > Continue to update the remaining accumulato

[jira] [Assigned] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator

[ https://issues.apache.org/jira/browse/SPARK-25568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25568: Assignee: Shixiong Zhu (was: Apache Spark) > Continue to update the remaining accumulato

[jira] [Commented] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator

[ https://issues.apache.org/jira/browse/SPARK-25568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632547#comment-16632547 ] Apache Spark commented on SPARK-25568: -- User 'zsxwing' has created a pull request f

[jira] [Created] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator

Shixiong Zhu created SPARK-25568: Summary: Continue to update the remaining accumulators when failing to update one accumulator Key: SPARK-25568 URL: https://issues.apache.org/jira/browse/SPARK-25568

[jira] [Updated] (SPARK-25568) Continue to update the remaining accumulators when failing to update one accumulator

[ https://issues.apache.org/jira/browse/SPARK-25568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-25568: - Description: Currently when failing to update an accumulator, DAGScheduler.updateAccumulators w

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632512#comment-16632512 ] Nicholas Chammas commented on SPARK-25150: -- Correct, this isn't a cross join. I

[jira] [Commented] (SPARK-23285) Allow spark.executor.cores to be fractional

[ https://issues.apache.org/jira/browse/SPARK-23285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632511#comment-16632511 ] Apache Spark commented on SPARK-23285: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632491#comment-16632491 ] Apache Spark commented on SPARK-25262: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632490#comment-16632490 ] Apache Spark commented on SPARK-25262: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632485#comment-16632485 ] Sean Owen commented on SPARK-25150: --- Hm, I am not sure I understand the example yet –

[jira] [Commented] (SPARK-25561) HiveClient.getPartitionsByFilter throws an exception if Hive retries directSql

[ https://issues.apache.org/jira/browse/SPARK-25561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632483#comment-16632483 ] Karthik Manamcheri commented on SPARK-25561: [~michael] thanks for the promp

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632381#comment-16632381 ] Nicholas Chammas commented on SPARK-25150: -- ([~petertoth] - Seeing your comment

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632281#comment-16632281 ] Nicholas Chammas commented on SPARK-25150: -- I've uploaded the expected output.

[jira] [Comment Edited] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632274#comment-16632274 ] Peter Toth edited comment on SPARK-25150 at 9/28/18 7:28 PM: -

[jira] [Updated] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-25150: - Attachment: expected-output.txt > Joining DataFrames derived from the same source yields

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632274#comment-16632274 ] Peter Toth commented on SPARK-25150: [~nchammas], sorry for the late reply. There i

[jira] [Updated] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-25150: - Description: I have two DataFrames, A and B. From B, I have derived two additional Data

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632252#comment-16632252 ] Nicholas Chammas commented on SPARK-25150: -- The attachments on this ticket cont

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632234#comment-16632234 ] Sean Owen commented on SPARK-25150: --- What's an example of expected vs actual results h

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1663#comment-1663 ] Nicholas Chammas commented on SPARK-25150: -- [~cloud_fan] / [~srowen] - Would yo

[jira] [Updated] (SPARK-25320) ML, Graph 2.4 QA: API: Binary incompatible changes

[ https://issues.apache.org/jira/browse/SPARK-25320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-25320: -- Fix Version/s: 2.4.0 > ML, Graph 2.4 QA: API: Binary incompatible changes > --

[jira] [Updated] (SPARK-25324) ML 2.4 QA: API: Java compatibility, docs

[ https://issues.apache.org/jira/browse/SPARK-25324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-25324: -- Fix Version/s: 2.4.0 > ML 2.4 QA: API: Java compatibility, docs >

[jira] [Comment Edited] (SPARK-25561) HiveClient.getPartitionsByFilter throws an exception if Hive retries directSql

[ https://issues.apache.org/jira/browse/SPARK-25561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632137#comment-16632137 ] Michael Allman edited comment on SPARK-25561 at 9/28/18 5:08 PM: -

[jira] [Commented] (SPARK-25561) HiveClient.getPartitionsByFilter throws an exception if Hive retries directSql

[ https://issues.apache.org/jira/browse/SPARK-25561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632137#comment-16632137 ] Michael Allman commented on SPARK-25561: cc [~cloud_fan] [~ekhliang] Hi [~karth

[jira] [Comment Edited] (SPARK-23717) Leverage docker support in Hadoop 3

[ https://issues.apache.org/jira/browse/SPARK-23717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632100#comment-16632100 ] Eric Yang edited comment on SPARK-23717 at 9/28/18 4:33 PM:

[jira] [Commented] (SPARK-23717) Leverage docker support in Hadoop 3

[ https://issues.apache.org/jira/browse/SPARK-23717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632100#comment-16632100 ] Eric Yang commented on SPARK-23717: --- It is possible to run standalone Spark in YARN wi

[jira] [Commented] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml

[ https://issues.apache.org/jira/browse/SPARK-25553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632061#comment-16632061 ] Yuming Wang commented on SPARK-25553: - Thanks [~srowen] > Add EmptyInterpolatedStri

[jira] [Updated] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20937: -- Fix Version/s: (was: 2.4.1) (was: 2.5.0) 2.4.0 > Describ

[jira] [Updated] (SPARK-25431) Fix function examples and unify the format of the example results.

[ https://issues.apache.org/jira/browse/SPARK-25431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25431: -- Fix Version/s: (was: 2.4.1) (was: 3.0.0) 2.4.0 > Fix fun

[jira] [Commented] (SPARK-21514) Hive has updated with new support for S3 and InsertIntoHiveTable.scala should update also

[ https://issues.apache.org/jira/browse/SPARK-21514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632003#comment-16632003 ] Nick Orka commented on SPARK-21514: --- Recently S3 increased request rate. Thus eventual

[jira] [Updated] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25565: -- Priority: Minor (was: Major) > Add scala style checker to check add Locale.ROOT to .toLowerCase and

[jira] [Resolved] (SPARK-25553) Add EmptyInterpolatedStringChecker to scalastyle-config.xml

[ https://issues.apache.org/jira/browse/SPARK-25553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25553. --- Resolution: Won't Fix I'd say if anything, later, instead focus on removing uses of {{"...".format(

[jira] [Assigned] (SPARK-17159) Improve FileInputDStream.findNewFiles list performance

[ https://issues.apache.org/jira/browse/SPARK-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17159: Assignee: (was: Apache Spark) > Improve FileInputDStream.findNewFiles list performanc

[jira] [Assigned] (SPARK-17159) Improve FileInputDStream.findNewFiles list performance

[ https://issues.apache.org/jira/browse/SPARK-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17159: Assignee: Apache Spark > Improve FileInputDStream.findNewFiles list performance > ---

[jira] [Reopened] (SPARK-17159) Improve FileInputDStream.findNewFiles list performance

[ https://issues.apache.org/jira/browse/SPARK-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-17159: --- > Improve FileInputDStream.findNewFiles list performance > -

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631751#comment-16631751 ] Li Yuanjian commented on SPARK-10816: - Design doc: [https://docs.google.com/documen

[jira] [Updated] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Yuanjian updated SPARK-10816: Attachment: Session Window Support For Structure Streaming.pdf > EventTime based sessionization >

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631733#comment-16631733 ] Apache Spark commented on SPARK-10816: -- User 'xuanyuanking' has created a pull requ

[jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631711#comment-16631711 ] shahid commented on SPARK-25567: Thanks. I will raise a PR > [Spark Job History] Table

[jira] [Created] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

ABHISHEK KUMAR GUPTA created SPARK-25567: Summary: [Spark Job History] Table listing in SQL Tab not display Sort Icon Key: SPARK-25567 URL: https://issues.apache.org/jira/browse/SPARK-25567 Pr

[jira] [Commented] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631703#comment-16631703 ] shahid commented on SPARK-25566: Thanks for reporting. I am working on it. > [Spark Job

[jira] [Created] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

ABHISHEK KUMAR GUPTA created SPARK-25566: Summary: [Spark Job History] SQL UI Page does not support Pagination Key: SPARK-25566 URL: https://issues.apache.org/jira/browse/SPARK-25566 Project:

[jira] [Commented] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631700#comment-16631700 ] Apache Spark commented on SPARK-25505: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25565: Assignee: Apache Spark > Add scala style checker to check add Locale.ROOT to .toLowerCase

[jira] [Commented] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631662#comment-16631662 ] Apache Spark commented on SPARK-25565: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25565: Assignee: (was: Apache Spark) > Add scala style checker to check add Locale.ROOT to .

[jira] [Commented] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631654#comment-16631654 ] Yuming Wang commented on SPARK-25565: - Thanks [~hyukjin.kwon] Please go ahead. > Ad

[jira] [Commented] (SPARK-23194) from_json in FAILFAST mode doesn't fail fast, instead it just returns nulls

[ https://issues.apache.org/jira/browse/SPARK-23194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631652#comment-16631652 ] Daniel Mateus Pires commented on SPARK-23194: - Any news on this ? not being

[jira] [Commented] (SPARK-25538) incorrect row counts after distinct()

[ https://issues.apache.org/jira/browse/SPARK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631605#comment-16631605 ] Kazuaki Ishizaki commented on SPARK-25538: -- Thank for upload a schema. While I

[jira] [Commented] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631575#comment-16631575 ] Hyukjin Kwon commented on SPARK-25565: -- I am taking a look for this. I will open a

[jira] [Assigned] (SPARK-25508) Refactor OrcReadBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25508: Assignee: Apache Spark > Refactor OrcReadBenchmark to use main method > -

[jira] [Assigned] (SPARK-25508) Refactor OrcReadBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25508: Assignee: (was: Apache Spark) > Refactor OrcReadBenchmark to use main method > --

[jira] [Commented] (SPARK-25508) Refactor OrcReadBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631573#comment-16631573 ] Apache Spark commented on SPARK-25508: -- User 'yucai' has created a pull request for

[jira] [Commented] (SPARK-21774) The rule PromoteStrings cast string to a wrong data type

[ https://issues.apache.org/jira/browse/SPARK-21774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631568#comment-16631568 ] ice bai commented on SPARK-21774: - I met the same problem in Spark 2.3.0. The flowlling

[jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark

[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631550#comment-16631550 ] Jungtaek Lim commented on SPARK-24630: -- I think it would be better to describe actu

[jira] [Created] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

Yuming Wang created SPARK-25565: --- Summary: Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls Key: SPARK-25565 URL: https://issues.apache.org/jira/browse/SPARK-25565

[jira] [Updated] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25565: Component/s: (was: Block Manager) Build > Add scala style checker to check ad

[jira] [Commented] (SPARK-25429) SparkListenerBus inefficient due to 'LiveStageMetrics#accumulatorIds:Array[Long]' data structure

[ https://issues.apache.org/jira/browse/SPARK-25429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631513#comment-16631513 ] Apache Spark commented on SPARK-25429: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631508#comment-16631508 ] Apache Spark commented on SPARK-25564: -- User 'LantaoJin' has created a pull request

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25564: Assignee: Apache Spark > Add output bytes metrics for each Executor > ---

[jira] [Commented] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631507#comment-16631507 ] Apache Spark commented on SPARK-25564: -- User 'LantaoJin' has created a pull request

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25564: Assignee: (was: Apache Spark) > Add output bytes metrics for each Executor >

[jira] [Commented] (SPARK-25554) Avro logical types get ignored in SchemaConverters.toSqlType

[ https://issues.apache.org/jira/browse/SPARK-25554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631505#comment-16631505 ] Liang-Chi Hsieh commented on SPARK-25554: - hmm, I think Spark 2.4 should have co

[jira] [Assigned] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25505: --- Assignee: Maryann Xue > The output order of grouping columns in Pivot is different from the input

[jira] [Updated] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25505: Fix Version/s: 2.4.0 > The output order of grouping columns in Pivot is different from the input > order

[jira] [Resolved] (SPARK-25505) The output order of grouping columns in Pivot is different from the input order

[ https://issues.apache.org/jira/browse/SPARK-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25505. - Resolution: Fixed > The output order of grouping columns in Pivot is different from the input > order >

[jira] [Updated] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-25564: --- Summary: Add output bytes metrics for each Executor (was: LiveExecutor misses the OutputBytes metri

[jira] [Created] (SPARK-25564) LiveExecutor misses the OutputBytes metrics

Lantao Jin created SPARK-25564: -- Summary: LiveExecutor misses the OutputBytes metrics Key: SPARK-25564 URL: https://issues.apache.org/jira/browse/SPARK-25564 Project: Spark Issue Type: Bug