[jira] [Comment Edited] (SPARK-25829) Duplicated map keys are not handled consistently

[ https://issues.apache.org/jira/browse/SPARK-25829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663118#comment-16663118 ] Wenchen Fan edited comment on SPARK-25829 at 11/15/18 7:32 AM: ---

[jira] [Comment Edited] (SPARK-25829) Duplicated map keys are not handled consistently

[ https://issues.apache.org/jira/browse/SPARK-25829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663118#comment-16663118 ] Wenchen Fan edited comment on SPARK-25829 at 11/15/18 7:28 AM: ---

[jira] [Assigned] (SPARK-26069) Flaky test: RpcIntegrationSuite.sendRpcWithStreamFailures

[ https://issues.apache.org/jira/browse/SPARK-26069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26069: Assignee: Shixiong Zhu (was: Apache Spark) > Flaky test: RpcIntegrationSuite.sendRpcWith

[jira] [Commented] (SPARK-26069) Flaky test: RpcIntegrationSuite.sendRpcWithStreamFailures

[ https://issues.apache.org/jira/browse/SPARK-26069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687589#comment-16687589 ] Apache Spark commented on SPARK-26069: -- User 'zsxwing' has created a pull request f

[jira] [Assigned] (SPARK-26069) Flaky test: RpcIntegrationSuite.sendRpcWithStreamFailures

[ https://issues.apache.org/jira/browse/SPARK-26069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26069: Assignee: Apache Spark (was: Shixiong Zhu) > Flaky test: RpcIntegrationSuite.sendRpcWith

[jira] [Created] (SPARK-26069) Flaky test: RpcIntegrationSuite.sendRpcWithStreamFailures

Shixiong Zhu created SPARK-26069: Summary: Flaky test: RpcIntegrationSuite.sendRpcWithStreamFailures Key: SPARK-26069 URL: https://issues.apache.org/jira/browse/SPARK-26069 Project: Spark Iss

[jira] [Commented] (SPARK-26068) ChunkedByteBufferInputStream is truncated by empty chunk

[ https://issues.apache.org/jira/browse/SPARK-26068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687497#comment-16687497 ] Apache Spark commented on SPARK-26068: -- User 'linhong-intel' has created a pull req

[jira] [Assigned] (SPARK-26068) ChunkedByteBufferInputStream is truncated by empty chunk

[ https://issues.apache.org/jira/browse/SPARK-26068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26068: Assignee: Apache Spark > ChunkedByteBufferInputStream is truncated by empty chunk > -

[jira] [Commented] (SPARK-26068) ChunkedByteBufferInputStream is truncated by empty chunk

[ https://issues.apache.org/jira/browse/SPARK-26068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687498#comment-16687498 ] Apache Spark commented on SPARK-26068: -- User 'linhong-intel' has created a pull req

[jira] [Assigned] (SPARK-26068) ChunkedByteBufferInputStream is truncated by empty chunk

[ https://issues.apache.org/jira/browse/SPARK-26068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26068: Assignee: (was: Apache Spark) > ChunkedByteBufferInputStream is truncated by empty ch

[jira] [Updated] (SPARK-26068) ChunkedByteBufferInputStream is truncated by empty chunk

[ https://issues.apache.org/jira/browse/SPARK-26068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu, Linhong updated SPARK-26068: - Description: If ChunkedByteBuffer contains empty chunk in the middle of it, then the  ChunkedByt

[jira] [Updated] (SPARK-26068) ChunkedByteBufferInputStream is truncated by empty chunk

[ https://issues.apache.org/jira/browse/SPARK-26068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu, Linhong updated SPARK-26068: - Description: If ChunkedByteBuffer contains empty chunk in the middle of it, then the  ChunkedByt

[jira] [Created] (SPARK-26068) ChunkedByteBufferInputStream is truncated by empty chunk

Liu, Linhong created SPARK-26068: Summary: ChunkedByteBufferInputStream is truncated by empty chunk Key: SPARK-26068 URL: https://issues.apache.org/jira/browse/SPARK-26068 Project: Spark Issu

[jira] [Resolved] (SPARK-26036) Break large tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26036. -- Resolution: Fixed Issue resolved by pull request 23033 [https://github.com/apache/spark/pull/2

[jira] [Assigned] (SPARK-26036) Break large tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26036: Assignee: Hyukjin Kwon > Break large tests.py files into smaller files >

[jira] [Updated] (SPARK-26067) Pandas GROUPED_MAP udf breaks if DF has >255 columns

[ https://issues.apache.org/jira/browse/SPARK-26067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdeali Kothari updated SPARK-26067: Description: When I run spark's Pandas GROUPED_MAP udfs to apply a UDAF i wrote in pythoh

[jira] [Created] (SPARK-26067) Pandas GROUPED_MAP udf breaks if DF has >255 columns

Abdeali Kothari created SPARK-26067: --- Summary: Pandas GROUPED_MAP udf breaks if DF has >255 columns Key: SPARK-26067 URL: https://issues.apache.org/jira/browse/SPARK-26067 Project: Spark Is

[jira] [Commented] (SPARK-26017) SVD++ error rate is high in the test suite.

[ https://issues.apache.org/jira/browse/SPARK-26017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687361#comment-16687361 ] shahid commented on SPARK-26017: I am analyzing it > SVD++ error rate is high in the te

[jira] [Commented] (SPARK-25957) Skip building spark-r docker image if spark distribution does not have R support

[ https://issues.apache.org/jira/browse/SPARK-25957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687337#comment-16687337 ] Nagaram Prasad Addepally commented on SPARK-25957: -- Thanks [~vanzin]...

[jira] [Resolved] (SPARK-25956) Make Scala 2.12 as default Scala version in Spark 3.0

[ https://issues.apache.org/jira/browse/SPARK-25956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25956. --- Resolution: Fixed Assignee: DB Tsai Fix Version/s: 3.0.0 This is resolved vi

[jira] [Comment Edited] (SPARK-25957) Skip building spark-r docker image if spark distribution does not have R support

[ https://issues.apache.org/jira/browse/SPARK-25957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687306#comment-16687306 ] Marcelo Vanzin edited comment on SPARK-25957 at 11/15/18 12:16 AM: ---

[jira] [Commented] (SPARK-25957) Skip building spark-r docker image if spark distribution does not have R support

[ https://issues.apache.org/jira/browse/SPARK-25957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687306#comment-16687306 ] Marcelo Vanzin commented on SPARK-25957: I prefer to keep the current behavior a

[jira] [Commented] (SPARK-25957) Skip building spark-r docker image if spark distribution does not have R support

[ https://issues.apache.org/jira/browse/SPARK-25957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687276#comment-16687276 ] Nagaram Prasad Addepally commented on SPARK-25957: -- I think we can para

[jira] [Commented] (SPARK-26066) Moving truncatedString to sql/catalyst

[ https://issues.apache.org/jira/browse/SPARK-26066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687169#comment-16687169 ] Apache Spark commented on SPARK-26066: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-26066) Moving truncatedString to sql/catalyst

[ https://issues.apache.org/jira/browse/SPARK-26066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26066: Assignee: (was: Apache Spark) > Moving truncatedString to sql/catalyst >

[jira] [Assigned] (SPARK-26066) Moving truncatedString to sql/catalyst

[ https://issues.apache.org/jira/browse/SPARK-26066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26066: Assignee: Apache Spark > Moving truncatedString to sql/catalyst > ---

[jira] [Assigned] (SPARK-25451) Stages page doesn't show the right number of the total tasks

[ https://issues.apache.org/jira/browse/SPARK-25451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25451: Assignee: Apache Spark > Stages page doesn't show the right number of the total tasks > -

[jira] [Commented] (SPARK-25451) Stages page doesn't show the right number of the total tasks

[ https://issues.apache.org/jira/browse/SPARK-25451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687130#comment-16687130 ] Apache Spark commented on SPARK-25451: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25451) Stages page doesn't show the right number of the total tasks

[ https://issues.apache.org/jira/browse/SPARK-25451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25451: Assignee: (was: Apache Spark) > Stages page doesn't show the right number of the tota

[jira] [Commented] (SPARK-25451) Stages page doesn't show the right number of the total tasks

[ https://issues.apache.org/jira/browse/SPARK-25451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687128#comment-16687128 ] Apache Spark commented on SPARK-25451: -- User 'shahidki31' has created a pull reques

[jira] [Resolved] (SPARK-25986) Banning throw new Errors

[ https://issues.apache.org/jira/browse/SPARK-25986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25986. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22989 [https://github.c

[jira] [Updated] (SPARK-25986) Banning throw new Errors

[ https://issues.apache.org/jira/browse/SPARK-25986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25986: -- Docs Text: Release notes text: Certain methods in Spark MLlib would throw NotImplementedError or Unkn

[jira] [Assigned] (SPARK-25778) WriteAheadLogBackedBlockRDD in YARN Cluster Mode Fails due lack of access to tmpDir from $PWD to HDFS

[ https://issues.apache.org/jira/browse/SPARK-25778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25778: -- Assignee: Greg Senia > WriteAheadLogBackedBlockRDD in YARN Cluster Mode Fails due lac

[jira] [Resolved] (SPARK-25778) WriteAheadLogBackedBlockRDD in YARN Cluster Mode Fails due lack of access to tmpDir from $PWD to HDFS

[ https://issues.apache.org/jira/browse/SPARK-25778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25778. Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 Issue resolved by p

[jira] [Resolved] (SPARK-24421) Accessing sun.misc.Cleaner in JDK11

[ https://issues.apache.org/jira/browse/SPARK-24421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24421. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22993 [https://github.c

[jira] [Assigned] (SPARK-24421) Accessing sun.misc.Cleaner in JDK11

[ https://issues.apache.org/jira/browse/SPARK-24421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24421: - Assignee: Sean Owen > Accessing sun.misc.Cleaner in JDK11 > ---

[jira] [Created] (SPARK-26066) Moving truncatedString to sql/catalyst

Maxim Gekk created SPARK-26066: -- Summary: Moving truncatedString to sql/catalyst Key: SPARK-26066 URL: https://issues.apache.org/jira/browse/SPARK-26066 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-26041: -- Environment: Spark 2.3.2  Hadoop 2.6 When we materialize one of intermediate datafra

[jira] [Commented] (SPARK-25982) Dataframe write is non blocking in fair scheduling mode

[ https://issues.apache.org/jira/browse/SPARK-25982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687034#comment-16687034 ] Ramandeep Singh commented on SPARK-25982: - Sure, a) The setting for scheduler i

[jira] [Commented] (SPARK-26051) Can't create table with column name '22222d'

[ https://issues.apache.org/jira/browse/SPARK-26051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687025#comment-16687025 ] Dilip Biswal commented on SPARK-26051: -- I would like to take a look at this one. >

[jira] [Assigned] (SPARK-25965) Add read benchmark for Avro

[ https://issues.apache.org/jira/browse/SPARK-25965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25965: - Assignee: Gengliang Wang > Add read benchmark for Avro > --- >

[jira] [Resolved] (SPARK-25965) Add read benchmark for Avro

[ https://issues.apache.org/jira/browse/SPARK-25965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25965. --- Resolution: Fixed Fix Version/s: 3.0.0 This is resolved via https://github.com/apache

[jira] [Assigned] (SPARK-26065) Change query hint from a `LogicalPlan` to a field

[ https://issues.apache.org/jira/browse/SPARK-26065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26065: Assignee: Apache Spark > Change query hint from a `LogicalPlan` to a field >

[jira] [Assigned] (SPARK-26065) Change query hint from a `LogicalPlan` to a field

[ https://issues.apache.org/jira/browse/SPARK-26065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26065: Assignee: (was: Apache Spark) > Change query hint from a `LogicalPlan` to a field > -

[jira] [Commented] (SPARK-26065) Change query hint from a `LogicalPlan` to a field

[ https://issues.apache.org/jira/browse/SPARK-26065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687003#comment-16687003 ] Apache Spark commented on SPARK-26065: -- User 'maryannxue' has created a pull reques

[jira] [Resolved] (SPARK-26042) KafkaContinuousSourceTopicDeletionSuite may hang forever

[ https://issues.apache.org/jira/browse/SPARK-26042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-26042. -- Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 > KafkaContinuousSource

[jira] [Comment Edited] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686907#comment-16686907 ] Ruslan Dautkhanov edited comment on SPARK-26041 at 11/14/18 5:45 PM: -

[jira] [Comment Edited] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686907#comment-16686907 ] Ruslan Dautkhanov edited comment on SPARK-26041 at 11/14/18 5:45 PM: -

[jira] [Commented] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686907#comment-16686907 ] Ruslan Dautkhanov commented on SPARK-26041: --- thank for checking this [~mgaido]

[jira] [Updated] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-26041: -- Attachment: SPARK-26041.txt > catalyst cuts out some columns from dataframes: > org.a

[jira] [Resolved] (SPARK-23067) Allow for easier debugging of the docker container

[ https://issues.apache.org/jira/browse/SPARK-23067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23067. Resolution: Duplicate This was added in SPARK-24534. Yay for searching before filing a new

[jira] [Created] (SPARK-26065) Change query hint from a `LogicalPlan` to a field

Maryann Xue created SPARK-26065: --- Summary: Change query hint from a `LogicalPlan` to a field Key: SPARK-26065 URL: https://issues.apache.org/jira/browse/SPARK-26065 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686870#comment-16686870 ] Marco Gaido commented on SPARK-26041: - No, it is not, for 2.3 we would need a dedica

[jira] [Commented] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686857#comment-16686857 ] Marco Gaido commented on SPARK-26041: - Then it'd help if you could provide a reprodu

[jira] [Commented] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686851#comment-16686851 ] Ruslan Dautkhanov commented on SPARK-26041: --- Thanks for referencing that jira

[jira] [Updated] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-26041: -- Affects Version/s: 2.3.0 2.3.1 > catalyst cuts out some columns

[jira] [Commented] (SPARK-26041) catalyst cuts out some columns from dataframes: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding attribute

[ https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686828#comment-16686828 ] Marco Gaido commented on SPARK-26041: - I think this may be a duplicate of SPARK-2605

[jira] [Resolved] (SPARK-25118) Need a solution to persist Spark application console outputs when running in shell/yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-25118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25118. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22504 [https:

[jira] [Assigned] (SPARK-25118) Need a solution to persist Spark application console outputs when running in shell/yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-25118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25118: -- Assignee: Ankur Gupta > Need a solution to persist Spark application console outputs

[jira] [Commented] (SPARK-26057) Table joining is broken in Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-26057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686715#comment-16686715 ] Apache Spark commented on SPARK-26057: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-26057) Table joining is broken in Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-26057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26057: Assignee: (was: Apache Spark) > Table joining is broken in Spark 2.4 > --

[jira] [Commented] (SPARK-26057) Table joining is broken in Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-26057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686710#comment-16686710 ] Apache Spark commented on SPARK-26057: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-26057) Table joining is broken in Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-26057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26057: Assignee: Apache Spark > Table joining is broken in Spark 2.4 > -

[jira] [Commented] (SPARK-26035) Break large streaming/tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686661#comment-16686661 ] Apache Spark commented on SPARK-26035: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-25868) One part of Spark MLlib Kmean Logic Performance problem

[ https://issues.apache.org/jira/browse/SPARK-25868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25868. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22893 [https://github.c

[jira] [Assigned] (SPARK-25868) One part of Spark MLlib Kmean Logic Performance problem

[ https://issues.apache.org/jira/browse/SPARK-25868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25868: - Assignee: Liang Li > One part of Spark MLlib Kmean Logic Performance problem >

[jira] [Commented] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686677#comment-16686677 ] Apache Spark commented on SPARK-26054: -- User 'mgaido91' has created a pull request

[jira] [Commented] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686671#comment-16686671 ] Apache Spark commented on SPARK-26054: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-26035) Break large streaming/tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26035: Assignee: (was: Apache Spark) > Break large streaming/tests.py files into smaller fil

[jira] [Assigned] (SPARK-26035) Break large streaming/tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26035: Assignee: Apache Spark > Break large streaming/tests.py files into smaller files > --

[jira] [Commented] (SPARK-23831) Add org.apache.derby to IsolatedClientLoader

[ https://issues.apache.org/jira/browse/SPARK-23831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686640#comment-16686640 ] Hyukjin Kwon commented on SPARK-23831: -- [~marmbrus], what did you make you came her

[jira] [Created] (SPARK-26064) Unable to fetch jar from remote repo while running spark-submit on kubernetes

Bala Bharath Reddy Resapu created SPARK-26064: - Summary: Unable to fetch jar from remote repo while running spark-submit on kubernetes Key: SPARK-26064 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-26054: Affects Version/s: (was: 2.4.0) 2.2.0 > Creating a computed column appl

[jira] [Updated] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-26054: Component/s: (was: Spark Core) SQL > Creating a computed column applying the

[jira] [Resolved] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved SPARK-26054. - Resolution: Cannot Reproduce > Creating a computed column applying the spark sql rounding on a c

[jira] [Commented] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686395#comment-16686395 ] Marco Gaido commented on SPARK-26054: - Then the affected version is 2.2.0, not 2.4.0

[jira] [Commented] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686386#comment-16686386 ] Jaya Krishna commented on SPARK-26054: -- Are you not seeing the issue even with BigD

[jira] [Commented] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686378#comment-16686378 ] Marco Gaido commented on SPARK-26054: - Yes, sorry, I forgot to copy its definition.

[jira] [Created] (SPARK-26063) CatalystDataToAvro gives "UnresolvedException: Invalid call to dataType on unresolved object" when requested for numberedTreeString

Jacek Laskowski created SPARK-26063: --- Summary: CatalystDataToAvro gives "UnresolvedException: Invalid call to dataType on unresolved object" when requested for numberedTreeString Key: SPARK-26063 URL: https://is

[jira] [Commented] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686373#comment-16686373 ] Jaya Krishna commented on SPARK-26054: -- Sorry for the confusion. I actually joined

[jira] [Updated] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaya Krishna updated SPARK-26054: - Attachment: (was: sparksql-rounding.png) > Creating a computed column applying the spark sql

[jira] [Updated] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaya Krishna updated SPARK-26054: - Attachment: sparksql-rounding.png > Creating a computed column applying the spark sql rounding o

[jira] [Updated] (SPARK-26035) Break large streaming/tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26035: - Target Version/s: 3.0.0 Fix Version/s: (was: 3.0.0) > Break large streaming/tests.py

[jira] [Created] (SPARK-26062) Rename spark-avro external module to spark-sql-avro (to match spark-sql-kafka)

Jacek Laskowski created SPARK-26062: --- Summary: Rename spark-avro external module to spark-sql-avro (to match spark-sql-kafka) Key: SPARK-26062 URL: https://issues.apache.org/jira/browse/SPARK-26062

[jira] [Assigned] (SPARK-26036) Break large tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26036: Assignee: (was: Apache Spark) > Break large tests.py files into smaller files > -

[jira] [Commented] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686333#comment-16686333 ] Marco Gaido commented on SPARK-26054: - {code} val data = Seq(AA("0101", "2500.98

[jira] [Commented] (SPARK-26036) Break large tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686328#comment-16686328 ] Apache Spark commented on SPARK-26036: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-26036) Break large tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26036: Assignee: Apache Spark > Break large tests.py files into smaller files >

[jira] [Commented] (SPARK-26036) Break large tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686327#comment-16686327 ] Apache Spark commented on SPARK-26036: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686318#comment-16686318 ] Jaya Krishna commented on SPARK-26054: -- Hmm. There seems to be an issue if we start

[jira] [Assigned] (SPARK-26061) Reduce the number of unused UnsafeRowWriters created in whole-stage codegen

[ https://issues.apache.org/jira/browse/SPARK-26061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26061: Assignee: Apache Spark > Reduce the number of unused UnsafeRowWriters created in whole-st

[jira] [Commented] (SPARK-26061) Reduce the number of unused UnsafeRowWriters created in whole-stage codegen

[ https://issues.apache.org/jira/browse/SPARK-26061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686299#comment-16686299 ] Apache Spark commented on SPARK-26061: -- User 'rednaxelafx' has created a pull reque

[jira] [Assigned] (SPARK-26061) Reduce the number of unused UnsafeRowWriters created in whole-stage codegen

[ https://issues.apache.org/jira/browse/SPARK-26061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26061: Assignee: (was: Apache Spark) > Reduce the number of unused UnsafeRowWriters created

[jira] [Commented] (SPARK-26061) Reduce the number of unused UnsafeRowWriters created in whole-stage codegen

[ https://issues.apache.org/jira/browse/SPARK-26061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686300#comment-16686300 ] Apache Spark commented on SPARK-26061: -- User 'rednaxelafx' has created a pull reque

[jira] [Created] (SPARK-26061) Reduce the number of unused UnsafeRowWriters created in whole-stage codegen

Kris Mok created SPARK-26061: Summary: Reduce the number of unused UnsafeRowWriters created in whole-stage codegen Key: SPARK-26061 URL: https://issues.apache.org/jira/browse/SPARK-26061 Project: Spark

[jira] [Commented] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

[ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686293#comment-16686293 ] Marco Gaido commented on SPARK-26054: - I cannot reproduce this: {code} val df = Seq

[jira] [Assigned] (SPARK-26060) Track SparkConf entries and make SET command reject such entries.

[ https://issues.apache.org/jira/browse/SPARK-26060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26060: Assignee: Apache Spark > Track SparkConf entries and make SET command reject such entries

[jira] [Commented] (SPARK-26060) Track SparkConf entries and make SET command reject such entries.

[ https://issues.apache.org/jira/browse/SPARK-26060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686233#comment-16686233 ] Apache Spark commented on SPARK-26060: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-26060) Track SparkConf entries and make SET command reject such entries.

[ https://issues.apache.org/jira/browse/SPARK-26060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26060: Assignee: (was: Apache Spark) > Track SparkConf entries and make SET command reject s

[jira] [Created] (SPARK-26060) Track SparkConf entries and make SET command reject such entries.

Takuya Ueshin created SPARK-26060: - Summary: Track SparkConf entries and make SET command reject such entries. Key: SPARK-26060 URL: https://issues.apache.org/jira/browse/SPARK-26060 Project: Spark

  1   2   >