[jira] [Commented] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572775#comment-16572775 ] Lukas Rytz commented on SPARK-25044: The encoding is as expected. To expand on a few

[jira] [Assigned] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt

[ https://issues.apache.org/jira/browse/SPARK-25036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25036: Assignee: Kazuaki Ishizaki > Scala 2.12 issues: Compilation error with sbt >

[jira] [Resolved] (SPARK-25036) Scala 2.12 issues: Compilation error with sbt

[ https://issues.apache.org/jira/browse/SPARK-25036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25036. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22014 [https://gi

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572717#comment-16572717 ] Lukas Rytz commented on SPARK-25047: Here is some older discussion: https://stackove

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572713#comment-16572713 ] Lukas Rytz commented on SPARK-25047:  I don't have the full picture, or an example a

[jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check

[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24948: Fix Version/s: 2.2.3 > SHS filters wrongly some applications due to permission check > ---

[jira] [Assigned] (SPARK-24948) SHS filters wrongly some applications due to permission check

[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-24948: --- Assignee: Marco Gaido > SHS filters wrongly some applications due to permission check > ---

[jira] [Commented] (SPARK-22634) Update Bouncy castle dependency

[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572675#comment-16572675 ] Steve Loughran commented on SPARK-22634: If nothing else is using it, correct. A

[jira] [Assigned] (SPARK-25054) Enable MetricsServlet sink for Executor

[ https://issues.apache.org/jira/browse/SPARK-25054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25054: Assignee: Apache Spark > Enable MetricsServlet sink for Executor > --

[jira] [Commented] (SPARK-25054) Enable MetricsServlet sink for Executor

[ https://issues.apache.org/jira/browse/SPARK-25054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572662#comment-16572662 ] Apache Spark commented on SPARK-25054: -- User 'LantaoJin' has created a pull request

[jira] [Assigned] (SPARK-25054) Enable MetricsServlet sink for Executor

[ https://issues.apache.org/jira/browse/SPARK-25054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25054: Assignee: (was: Apache Spark) > Enable MetricsServlet sink for Executor > ---

[jira] [Created] (SPARK-25054) Enable MetricsServlet sink for Executor

Lantao Jin created SPARK-25054: -- Summary: Enable MetricsServlet sink for Executor Key: SPARK-25054 URL: https://issues.apache.org/jira/browse/SPARK-25054 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output?

[ https://issues.apache.org/jira/browse/SPARK-25052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572608#comment-16572608 ] bharath kumar avusherla commented on SPARK-25052: - i also thought about

[jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check

[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24948: Fix Version/s: 2.3.2 > SHS filters wrongly some applications due to permission check > ---

[jira] [Resolved] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output?

[ https://issues.apache.org/jira/browse/SPARK-25052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25052. -- Resolution: Invalid Questions should better go to mailing list, https://spark.apache.org/comm

[jira] [Commented] (SPARK-25051) where clause on dataset gives AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572571#comment-16572571 ] Hyukjin Kwon commented on SPARK-25051: -- Can you post some codes for df1 and df2 as

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572570#comment-16572570 ] Sean Owen commented on SPARK-25029: --- If we _really_ needed to resolve this unilaterall

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572564#comment-16572564 ] Hyukjin Kwon commented on SPARK-24924: -- [~cloud_fan], Yea, adding them as implicit

[jira] [Resolved] (SPARK-24251) DataSourceV2: Add AppendData logical operation

[ https://issues.apache.org/jira/browse/SPARK-24251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24251. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21305 [https://gith

[jira] [Assigned] (SPARK-24251) DataSourceV2: Add AppendData logical operation

[ https://issues.apache.org/jira/browse/SPARK-24251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24251: --- Assignee: Ryan Blue > DataSourceV2: Add AppendData logical operation >

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572556#comment-16572556 ] Wenchen Fan commented on SPARK-24924: - > I assume we could theoretically also suppo

[jira] [Commented] (SPARK-22634) Update Bouncy castle dependency

[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572551#comment-16572551 ] Sean Owen commented on SPARK-22634: --- [~ste...@apache.org] are you saying that this who

[jira] [Commented] (SPARK-22634) Update Bouncy castle dependency

[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572542#comment-16572542 ] Saisai Shao commented on SPARK-22634: - [~srowen] I'm wondering if it is possible to

[jira] [Commented] (SPARK-23935) High-order function: map_entries(map) → array>

[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572532#comment-16572532 ] Apache Spark commented on SPARK-23935: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25047: Assignee: Apache Spark > Can't assign SerializedLambda to scala.Function1 in deserializat

[jira] [Assigned] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25047: Assignee: (was: Apache Spark) > Can't assign SerializedLambda to scala.Function1 in d

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572518#comment-16572518 ] Apache Spark commented on SPARK-25047: -- User 'srowen' has created a pull request fo

[jira] [Resolved] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-25045. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22026 [https://

[jira] [Assigned] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25045: - Assignee: Jiang Xingbo > Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions

[jira] [Created] (SPARK-25053) Allow additional port forwarding on Spark on K8S as needed

holdenk created SPARK-25053: --- Summary: Allow additional port forwarding on Spark on K8S as needed Key: SPARK-25053 URL: https://issues.apache.org/jira/browse/SPARK-25053 Project: Spark Issue Type:

[jira] [Created] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output?

bharath kumar avusherla created SPARK-25052: --- Summary: Is there any possibility that spark structured streaming generate duplicates in the output? Key: SPARK-25052 URL: https://issues.apache.org/jira/bro

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572410#comment-16572410 ] Sean Owen commented on SPARK-25047: --- More notes.These two SO answers shed a little lig

[jira] [Assigned] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25046: --- Assignee: SongXun > Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO" > ---

[jira] [Resolved] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25046. - Resolution: Fixed Fix Version/s: 2.4.0 > Alter View can excute sql like "ALTER VIEW ... AS INSE

[jira] [Commented] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers

[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572232#comment-16572232 ] Thomas Graves commented on SPARK-23207: --- does this affect spark 2.2 and < ? from t

[jira] [Updated] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25029: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-14220 > Scala 2.12 issues: TaskNotSerializable

[jira] [Updated] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25044: -- Description: A few SQL-related tests fail in Scala 2.12, such as UDFSuite's "SPARK-24891 Fix HandleNu

[jira] [Created] (SPARK-25051) where clause on dataset gives AnalysisException

MIK created SPARK-25051: --- Summary: where clause on dataset gives AnalysisException Key: SPARK-25051 URL: https://issues.apache.org/jira/browse/SPARK-25051 Project: Spark Issue Type: Bug Compo

[jira] [Assigned] (SPARK-23932) High-order function: zip_with(array, array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23932: Assignee: (was: Apache Spark) > High-order function: zip_with(array, array, function)

[jira] [Assigned] (SPARK-23932) High-order function: zip_with(array, array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23932: Assignee: Apache Spark > High-order function: zip_with(array, array, function) → > array

[jira] [Commented] (SPARK-23932) High-order function: zip_with(array, array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572140#comment-16572140 ] Apache Spark commented on SPARK-23932: -- User 'techaddict' has created a pull reques

[jira] [Comment Edited] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572095#comment-16572095 ] Stavros Kontopoulos edited comment on SPARK-25044 at 8/7/18 6:35 PM: -

[jira] [Commented] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572115#comment-16572115 ] Sean Owen commented on SPARK-25044: --- More specific info. In Scala 2.12: {code:java} sc

[jira] [Comment Edited] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572094#comment-16572094 ] Stavros Kontopoulos edited comment on SPARK-25047 at 8/7/18 6:18 PM: -

[jira] [Comment Edited] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572095#comment-16572095 ] Stavros Kontopoulos edited comment on SPARK-25044 at 8/7/18 6:18 PM: -

[jira] [Commented] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572095#comment-16572095 ] Stavros Kontopoulos commented on SPARK-25044: - @lrytz thoughts? > Address t

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572094#comment-16572094 ] Stavros Kontopoulos commented on SPARK-25047: - [~lrytz] ideas? > Can't assi

[jira] [Created] (SPARK-25050) Handle more than two types in avro union types

DB Tsai created SPARK-25050: --- Summary: Handle more than two types in avro union types Key: SPARK-25050 URL: https://issues.apache.org/jira/browse/SPARK-25050 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-25049) Support custom schema in `to_avro`

DB Tsai created SPARK-25049: --- Summary: Support custom schema in `to_avro` Key: SPARK-25049 URL: https://issues.apache.org/jira/browse/SPARK-25049 Project: Spark Issue Type: Improvement Co

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572020#comment-16572020 ] shane knapp commented on SPARK-25029: - updated the build so concurrent runs can happ

[jira] [Commented] (SPARK-24598) SPARK SQL:Datatype overflow conditions gives incorrect result

[ https://issues.apache.org/jira/browse/SPARK-24598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572011#comment-16572011 ] Thomas Graves commented on SPARK-24598: --- In the very least we should file a separa

[jira] [Resolved] (SPARK-23937) High-order function: map_filter(map, function) → MAP

[ https://issues.apache.org/jira/browse/SPARK-23937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23937. --- Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.4.0 Issue resolved

[jira] [Resolved] (SPARK-25041) genjavadoc-plugin_0.10 is not found with sbt in scala-2.12

[ https://issues.apache.org/jira/browse/SPARK-25041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25041. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22020 [https://github.c

[jira] [Assigned] (SPARK-25041) genjavadoc-plugin_0.10 is not found with sbt in scala-2.12

[ https://issues.apache.org/jira/browse/SPARK-25041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25041: - Assignee: Kazuaki Ishizaki > genjavadoc-plugin_0.10 is not found with sbt in scala-2.12 > -

[jira] [Updated] (SPARK-25048) Pivoting by multiple columns in Scala/Java

[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-25048: --- Summary: Pivoting by multiple columns in Scala/Java (was: Pivoting by multiple columns) > Pivoting

[jira] [Commented] (SPARK-25048) Pivoting by multiple columns

[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571952#comment-16571952 ] Apache Spark commented on SPARK-25048: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-25048) Pivoting by multiple columns

[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25048: Assignee: Apache Spark > Pivoting by multiple columns > > >

[jira] [Assigned] (SPARK-25048) Pivoting by multiple columns

[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25048: Assignee: (was: Apache Spark) > Pivoting by multiple columns > --

[jira] [Created] (SPARK-25048) Pivoting by multiple columns

Maxim Gekk created SPARK-25048: -- Summary: Pivoting by multiple columns Key: SPARK-25048 URL: https://issues.apache.org/jira/browse/SPARK-25048 Project: Spark Issue Type: Improvement Co

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571908#comment-16571908 ] Thomas Graves commented on SPARK-24924: --- so originally when I started on this I di

[jira] [Assigned] (SPARK-24395) Fix Behavior of NOT IN with Literals Containing NULL

[ https://issues.apache.org/jira/browse/SPARK-24395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24395: Assignee: Apache Spark > Fix Behavior of NOT IN with Literals Containing NULL > -

[jira] [Commented] (SPARK-24395) Fix Behavior of NOT IN with Literals Containing NULL

[ https://issues.apache.org/jira/browse/SPARK-24395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571892#comment-16571892 ] Apache Spark commented on SPARK-24395: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-24395) Fix Behavior of NOT IN with Literals Containing NULL

[ https://issues.apache.org/jira/browse/SPARK-24395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24395: Assignee: (was: Apache Spark) > Fix Behavior of NOT IN with Literals Containing NULL

[jira] [Created] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

Sean Owen created SPARK-25047: - Summary: Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel Key: SPARK-25047 URL: https://issues.apache.org/jira/browse/SPARK-25047

[jira] [Resolved] (SPARK-24979) add AnalysisHelper#resolveOperatorsUp

[ https://issues.apache.org/jira/browse/SPARK-24979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24979. - Resolution: Fixed Fix Version/s: 2.4.0 > add AnalysisHelper#resolveOperatorsUp >

[jira] [Commented] (SPARK-25037) plan.transformAllExpressions() doesn't transform expressions in nested SubqueryExpression plans

[ https://issues.apache.org/jira/browse/SPARK-25037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571855#comment-16571855 ] Dilip Biswal commented on SPARK-25037: -- [~chriso] [~hyukjin.kwon] Subquery plans ar

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571852#comment-16571852 ] Thomas Graves commented on SPARK-24924: --- thanks, I missed it in the output for spa

[jira] [Assigned] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25046: Assignee: Apache Spark > Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

[jira] [Assigned] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25046: Assignee: (was: Apache Spark) > Alter View can excute sql like "ALTER VIEW ... AS I

[jira] [Commented] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571842#comment-16571842 ] Apache Spark commented on SPARK-25046: -- User 'sddyljsx' has created a pull request

[jira] [Commented] (SPARK-25010) Rand/Randn should produce different values for each execution in streaming query

[ https://issues.apache.org/jira/browse/SPARK-25010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571834#comment-16571834 ] Apache Spark commented on SPARK-25010: -- User 'ueshin' has created a pull request fo

[jira] [Created] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

SongXun created SPARK-25046: --- Summary: Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO" Key: SPARK-25046 URL: https://issues.apache.org/jira/browse/SPARK-25046 Project: Spark Issu

[jira] [Assigned] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25045: Assignee: (was: Apache Spark) > Make `RDDBarrier.mapParititions` similar to `RDD.mapP

[jira] [Assigned] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25045: Assignee: Apache Spark > Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

[jira] [Commented] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571804#comment-16571804 ] Apache Spark commented on SPARK-25045: -- User 'jiangxb1987' has created a pull reque

[jira] [Commented] (SPARK-24918) Executor Plugin API

[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571793#comment-16571793 ] Imran Rashid commented on SPARK-24918: -- [~lucacanali] you could certainly sample st

[jira] [Created] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

Jiang Xingbo created SPARK-25045: Summary: Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions` Key: SPARK-25045 URL: https://issues.apache.org/jira/browse/SPARK-25045 Project: Spark

[jira] [Updated] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25044: -- Description: A few SQL-related tests fail in Scala 2.12, such as UDFSuite's "SPARK-24891 Fix HandleNu

[jira] [Created] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

Sean Owen created SPARK-25044: - Summary: Address translation of LMF closure primitive args to Object in Scala 2.12 Key: SPARK-25044 URL: https://issues.apache.org/jira/browse/SPARK-25044 Project: Spark

[jira] [Reopened] (SPARK-14220) Build and test Spark against Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-14220: --- Assignee: Sean Owen OK, bad news, I think we still have several non-trivial issues with Scala 2.12

[jira] [Updated] (SPARK-14220) Build and test Spark against Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14220: -- Target Version/s: 2.4.0 Fix Version/s: (was: 2.4.0) > Build and test Spark against Scala 2.

[jira] [Commented] (SPARK-24918) Executor Plugin API

[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571748#comment-16571748 ] Luca Canali commented on SPARK-24918: - I have a use case where I would like to sampl

[jira] [Assigned] (SPARK-25043) spark-sql should print the appId and master on startup

[ https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25043: Assignee: Apache Spark > spark-sql should print the appId and master on startup > ---

[jira] [Assigned] (SPARK-25043) spark-sql should print the appId and master on startup

[ https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25043: Assignee: (was: Apache Spark) > spark-sql should print the appId and master on startu

[jira] [Commented] (SPARK-25043) spark-sql should print the appId and master on startup

[ https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571736#comment-16571736 ] Apache Spark commented on SPARK-25043: -- User 'abellina' has created a pull request

[jira] [Created] (SPARK-25043) spark-sql should print the appId and master on startup

Alessandro Bellina created SPARK-25043: -- Summary: spark-sql should print the appId and master on startup Key: SPARK-25043 URL: https://issues.apache.org/jira/browse/SPARK-25043 Project: Spark

[jira] [Resolved] (SPARK-19602) Unable to query using the fully qualified column name of the form ( ..)

[ https://issues.apache.org/jira/browse/SPARK-19602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19602. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 17185 [https://gith

[jira] [Commented] (SPARK-25003) Pyspark Does not use Spark Sql Extensions

[ https://issues.apache.org/jira/browse/SPARK-25003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571630#comment-16571630 ] Apache Spark commented on SPARK-25003: -- User 'RussellSpitzer' has created a pull re

[jira] [Commented] (SPARK-25003) Pyspark Does not use Spark Sql Extensions

[ https://issues.apache.org/jira/browse/SPARK-25003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571631#comment-16571631 ] Apache Spark commented on SPARK-25003: -- User 'RussellSpitzer' has created a pull re

[jira] [Assigned] (SPARK-25034) possible triple memory consumption in fetchBlockSync()

[ https://issues.apache.org/jira/browse/SPARK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25034: Assignee: Apache Spark > possible triple memory consumption in fetchBlockSync() > ---

[jira] [Commented] (SPARK-25034) possible triple memory consumption in fetchBlockSync()

[ https://issues.apache.org/jira/browse/SPARK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571626#comment-16571626 ] Apache Spark commented on SPARK-25034: -- User 'vincent-grosbois' has created a pull

[jira] [Assigned] (SPARK-25034) possible triple memory consumption in fetchBlockSync()

[ https://issues.apache.org/jira/browse/SPARK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25034: Assignee: (was: Apache Spark) > possible triple memory consumption in fetchBlockSync(

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571421#comment-16571421 ] Apache Spark commented on SPARK-23928: -- User 'mgaido91' has created a pull request

[jira] [Created] (SPARK-25042) Flaky test: org.apache.spark.streaming.kafka010.KafkaRDDSuite.compacted topic

Marco Gaido created SPARK-25042: --- Summary: Flaky test: org.apache.spark.streaming.kafka010.KafkaRDDSuite.compacted topic Key: SPARK-25042 URL: https://issues.apache.org/jira/browse/SPARK-25042 Project:

[jira] [Assigned] (SPARK-24772) support reading AVRO logical types - Decimal

[ https://issues.apache.org/jira/browse/SPARK-24772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24772: --- Assignee: Gengliang Wang > support reading AVRO logical types - Decimal > -

[jira] [Resolved] (SPARK-24772) support reading AVRO logical types - Decimal

[ https://issues.apache.org/jira/browse/SPARK-24772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24772. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21984 [https://gith

[jira] [Assigned] (SPARK-24005) Remove usage of Scala’s parallel collection

[ https://issues.apache.org/jira/browse/SPARK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24005: --- Assignee: Maxim Gekk > Remove usage of Scala’s parallel collection > --

[jira] [Resolved] (SPARK-24005) Remove usage of Scala’s parallel collection

[ https://issues.apache.org/jira/browse/SPARK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24005. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21913 [https://gith

[jira] [Commented] (SPARK-24948) SHS filters wrongly some applications due to permission check

[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571294#comment-16571294 ] Apache Spark commented on SPARK-24948: -- User 'mgaido91' has created a pull request

[jira] [Commented] (SPARK-24948) SHS filters wrongly some applications due to permission check

[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571260#comment-16571260 ] Apache Spark commented on SPARK-24948: -- User 'mgaido91' has created a pull request

  1   2   >