[jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24948: Fix Version/s: 2.2.3 > SHS filters wrongly some applications due to permission check >

[jira] [Assigned] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-24948: --- Assignee: Marco Gaido > SHS filters wrongly some applications due to permission check >

[jira] [Commented] (SPARK-22634) Update Bouncy castle dependency

2018-08-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572675#comment-16572675 ] Steve Loughran commented on SPARK-22634: If nothing else is using it, correct. And nothing is

[jira] [Assigned] (SPARK-25054) Enable MetricsServlet sink for Executor

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25054: Assignee: Apache Spark > Enable MetricsServlet sink for Executor >

[jira] [Commented] (SPARK-25054) Enable MetricsServlet sink for Executor

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572662#comment-16572662 ] Apache Spark commented on SPARK-25054: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25054) Enable MetricsServlet sink for Executor

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25054: Assignee: (was: Apache Spark) > Enable MetricsServlet sink for Executor >

[jira] [Created] (SPARK-25054) Enable MetricsServlet sink for Executor

2018-08-07 Thread Lantao Jin (JIRA)
Lantao Jin created SPARK-25054: -- Summary: Enable MetricsServlet sink for Executor Key: SPARK-25054 URL: https://issues.apache.org/jira/browse/SPARK-25054 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output?

2018-08-07 Thread bharath kumar avusherla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572608#comment-16572608 ] bharath kumar avusherla commented on SPARK-25052: - i also thought about it. Hence I

[jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24948: Fix Version/s: 2.3.2 > SHS filters wrongly some applications due to permission check >

[jira] [Resolved] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output?

2018-08-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25052. -- Resolution: Invalid Questions should better go to mailing list,

[jira] [Commented] (SPARK-25051) where clause on dataset gives AnalysisException

2018-08-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572571#comment-16572571 ] Hyukjin Kwon commented on SPARK-25051: -- Can you post some codes for df1 and df2 as well? > where

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572570#comment-16572570 ] Sean Owen commented on SPARK-25029: --- If we _really_ needed to resolve this unilaterally from the Spark

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572564#comment-16572564 ] Hyukjin Kwon commented on SPARK-24924: -- [~cloud_fan], Yea, adding them as implicit sounds not a

[jira] [Resolved] (SPARK-24251) DataSourceV2: Add AppendData logical operation

2018-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24251. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21305

[jira] [Assigned] (SPARK-24251) DataSourceV2: Add AppendData logical operation

2018-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24251: --- Assignee: Ryan Blue > DataSourceV2: Add AppendData logical operation >

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572556#comment-16572556 ] Wenchen Fan commented on SPARK-24924: - > I assume we could theoretically also support the

[jira] [Commented] (SPARK-22634) Update Bouncy castle dependency

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572551#comment-16572551 ] Sean Owen commented on SPARK-22634: --- [~ste...@apache.org] are you saying that this whole issue is moot

[jira] [Commented] (SPARK-22634) Update Bouncy castle dependency

2018-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572542#comment-16572542 ] Saisai Shao commented on SPARK-22634: - [~srowen] I'm wondering if it is possible to upgrade to

[jira] [Commented] (SPARK-23935) High-order function: map_entries(map) → array>

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572532#comment-16572532 ] Apache Spark commented on SPARK-23935: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25047: Assignee: Apache Spark > Can't assign SerializedLambda to scala.Function1 in

[jira] [Assigned] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25047: Assignee: (was: Apache Spark) > Can't assign SerializedLambda to scala.Function1 in

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572518#comment-16572518 ] Apache Spark commented on SPARK-25047: -- User 'srowen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

2018-08-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-25045. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22026

[jira] [Assigned] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

2018-08-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-25045: - Assignee: Jiang Xingbo > Make `RDDBarrier.mapParititions` similar to

[jira] [Created] (SPARK-25053) Allow additional port forwarding on Spark on K8S as needed

2018-08-07 Thread holdenk (JIRA)
holdenk created SPARK-25053: --- Summary: Allow additional port forwarding on Spark on K8S as needed Key: SPARK-25053 URL: https://issues.apache.org/jira/browse/SPARK-25053 Project: Spark Issue Type:

[jira] [Created] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output?

2018-08-07 Thread bharath kumar avusherla (JIRA)
bharath kumar avusherla created SPARK-25052: --- Summary: Is there any possibility that spark structured streaming generate duplicates in the output? Key: SPARK-25052 URL:

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572410#comment-16572410 ] Sean Owen commented on SPARK-25047: --- More notes.These two SO answers shed a little light:

[jira] [Assigned] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

2018-08-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25046: --- Assignee: SongXun > Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO" >

[jira] [Resolved] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

2018-08-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25046. - Resolution: Fixed Fix Version/s: 2.4.0 > Alter View can excute sql like "ALTER VIEW ... AS

[jira] [Commented] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers

2018-08-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572232#comment-16572232 ] Thomas Graves commented on SPARK-23207: --- does this affect spark 2.2 and < ? from the description

[jira] [Updated] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25029: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-14220 > Scala 2.12 issues: TaskNotSerializable

[jira] [Updated] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25044: -- Description: A few SQL-related tests fail in Scala 2.12, such as UDFSuite's "SPARK-24891 Fix

[jira] [Created] (SPARK-25051) where clause on dataset gives AnalysisException

2018-08-07 Thread MIK (JIRA)
MIK created SPARK-25051: --- Summary: where clause on dataset gives AnalysisException Key: SPARK-25051 URL: https://issues.apache.org/jira/browse/SPARK-25051 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-23932) High-order function: zip_with(array, array, function) → array

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23932: Assignee: (was: Apache Spark) > High-order function: zip_with(array, array,

[jira] [Assigned] (SPARK-23932) High-order function: zip_with(array, array, function) → array

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23932: Assignee: Apache Spark > High-order function: zip_with(array, array, function) → >

[jira] [Commented] (SPARK-23932) High-order function: zip_with(array, array, function) → array

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572140#comment-16572140 ] Apache Spark commented on SPARK-23932: -- User 'techaddict' has created a pull request for this

[jira] [Comment Edited] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

2018-08-07 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572095#comment-16572095 ] Stavros Kontopoulos edited comment on SPARK-25044 at 8/7/18 6:35 PM: -

[jira] [Commented] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572115#comment-16572115 ] Sean Owen commented on SPARK-25044: --- More specific info. In Scala 2.12: {code:java} scala> val f = (i:

[jira] [Comment Edited] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

2018-08-07 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572094#comment-16572094 ] Stavros Kontopoulos edited comment on SPARK-25047 at 8/7/18 6:18 PM: -

[jira] [Comment Edited] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

2018-08-07 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572095#comment-16572095 ] Stavros Kontopoulos edited comment on SPARK-25044 at 8/7/18 6:18 PM: -

[jira] [Commented] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

2018-08-07 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572095#comment-16572095 ] Stavros Kontopoulos commented on SPARK-25044: - @lrytz thoughts? > Address translation of

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

2018-08-07 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572094#comment-16572094 ] Stavros Kontopoulos commented on SPARK-25047: - [~lrytz] ideas? > Can't assign

[jira] [Created] (SPARK-25050) Handle more than two types in avro union types

2018-08-07 Thread DB Tsai (JIRA)
DB Tsai created SPARK-25050: --- Summary: Handle more than two types in avro union types Key: SPARK-25050 URL: https://issues.apache.org/jira/browse/SPARK-25050 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-25049) Support custom schema in `to_avro`

2018-08-07 Thread DB Tsai (JIRA)
DB Tsai created SPARK-25049: --- Summary: Support custom schema in `to_avro` Key: SPARK-25049 URL: https://issues.apache.org/jira/browse/SPARK-25049 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572020#comment-16572020 ] shane knapp commented on SPARK-25029: - updated the build so concurrent runs can happen, albeit

[jira] [Commented] (SPARK-24598) SPARK SQL:Datatype overflow conditions gives incorrect result

2018-08-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572011#comment-16572011 ] Thomas Graves commented on SPARK-24598: --- In the very least we should file a separate Jira to track

[jira] [Resolved] (SPARK-23937) High-order function: map_filter(map, function) → MAP

2018-08-07 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23937. --- Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.4.0 Issue resolved

[jira] [Resolved] (SPARK-25041) genjavadoc-plugin_0.10 is not found with sbt in scala-2.12

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25041. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22020

[jira] [Assigned] (SPARK-25041) genjavadoc-plugin_0.10 is not found with sbt in scala-2.12

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25041: - Assignee: Kazuaki Ishizaki > genjavadoc-plugin_0.10 is not found with sbt in scala-2.12 >

[jira] [Updated] (SPARK-25048) Pivoting by multiple columns in Scala/Java

2018-08-07 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-25048: --- Summary: Pivoting by multiple columns in Scala/Java (was: Pivoting by multiple columns) >

[jira] [Commented] (SPARK-25048) Pivoting by multiple columns

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571952#comment-16571952 ] Apache Spark commented on SPARK-25048: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25048) Pivoting by multiple columns

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25048: Assignee: Apache Spark > Pivoting by multiple columns > > >

[jira] [Assigned] (SPARK-25048) Pivoting by multiple columns

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25048: Assignee: (was: Apache Spark) > Pivoting by multiple columns >

[jira] [Created] (SPARK-25048) Pivoting by multiple columns

2018-08-07 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-25048: -- Summary: Pivoting by multiple columns Key: SPARK-25048 URL: https://issues.apache.org/jira/browse/SPARK-25048 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571908#comment-16571908 ] Thomas Graves commented on SPARK-24924: --- so originally when I started on this I didn't know about

[jira] [Assigned] (SPARK-24395) Fix Behavior of NOT IN with Literals Containing NULL

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24395: Assignee: Apache Spark > Fix Behavior of NOT IN with Literals Containing NULL >

[jira] [Commented] (SPARK-24395) Fix Behavior of NOT IN with Literals Containing NULL

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571892#comment-16571892 ] Apache Spark commented on SPARK-24395: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24395) Fix Behavior of NOT IN with Literals Containing NULL

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24395: Assignee: (was: Apache Spark) > Fix Behavior of NOT IN with Literals Containing NULL

[jira] [Created] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

2018-08-07 Thread Sean Owen (JIRA)
Sean Owen created SPARK-25047: - Summary: Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel Key: SPARK-25047 URL: https://issues.apache.org/jira/browse/SPARK-25047

[jira] [Resolved] (SPARK-24979) add AnalysisHelper#resolveOperatorsUp

2018-08-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24979. - Resolution: Fixed Fix Version/s: 2.4.0 > add AnalysisHelper#resolveOperatorsUp >

[jira] [Commented] (SPARK-25037) plan.transformAllExpressions() doesn't transform expressions in nested SubqueryExpression plans

2018-08-07 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571855#comment-16571855 ] Dilip Biswal commented on SPARK-25037: -- [~chriso] [~hyukjin.kwon] Subquery plans are not part of

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571852#comment-16571852 ] Thomas Graves commented on SPARK-24924: --- thanks, I missed it in the output for spark as I was just

[jira] [Assigned] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25046: Assignee: Apache Spark > Alter View can excute sql like "ALTER VIEW ... AS INSERT

[jira] [Assigned] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25046: Assignee: (was: Apache Spark) > Alter View can excute sql like "ALTER VIEW ... AS

[jira] [Commented] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571842#comment-16571842 ] Apache Spark commented on SPARK-25046: -- User 'sddyljsx' has created a pull request for this issue:

[jira] [Commented] (SPARK-25010) Rand/Randn should produce different values for each execution in streaming query

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571834#comment-16571834 ] Apache Spark commented on SPARK-25010: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-25046) Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO"

2018-08-07 Thread SongXun (JIRA)
SongXun created SPARK-25046: --- Summary: Alter View can excute sql like "ALTER VIEW ... AS INSERT INTO" Key: SPARK-25046 URL: https://issues.apache.org/jira/browse/SPARK-25046 Project: Spark

[jira] [Assigned] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25045: Assignee: (was: Apache Spark) > Make `RDDBarrier.mapParititions` similar to

[jira] [Assigned] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25045: Assignee: Apache Spark > Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

[jira] [Commented] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571804#comment-16571804 ] Apache Spark commented on SPARK-25045: -- User 'jiangxb1987' has created a pull request for this

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-07 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571793#comment-16571793 ] Imran Rashid commented on SPARK-24918: -- [~lucacanali] you could certainly sample stack traces, but

[jira] [Created] (SPARK-25045) Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions`

2018-08-07 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-25045: Summary: Make `RDDBarrier.mapParititions` similar to `RDD.mapPartitions` Key: SPARK-25045 URL: https://issues.apache.org/jira/browse/SPARK-25045 Project: Spark

[jira] [Updated] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25044: -- Description: A few SQL-related tests fail in Scala 2.12, such as UDFSuite's "SPARK-24891 Fix

[jira] [Created] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

2018-08-07 Thread Sean Owen (JIRA)
Sean Owen created SPARK-25044: - Summary: Address translation of LMF closure primitive args to Object in Scala 2.12 Key: SPARK-25044 URL: https://issues.apache.org/jira/browse/SPARK-25044 Project: Spark

[jira] [Reopened] (SPARK-14220) Build and test Spark against Scala 2.12

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-14220: --- Assignee: Sean Owen OK, bad news, I think we still have several non-trivial issues with Scala

[jira] [Updated] (SPARK-14220) Build and test Spark against Scala 2.12

2018-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14220: -- Target Version/s: 2.4.0 Fix Version/s: (was: 2.4.0) > Build and test Spark against Scala

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-07 Thread Luca Canali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571748#comment-16571748 ] Luca Canali commented on SPARK-24918: - I have a use case where I would like to sample stack traces

[jira] [Assigned] (SPARK-25043) spark-sql should print the appId and master on startup

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25043: Assignee: Apache Spark > spark-sql should print the appId and master on startup >

[jira] [Assigned] (SPARK-25043) spark-sql should print the appId and master on startup

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25043: Assignee: (was: Apache Spark) > spark-sql should print the appId and master on

[jira] [Commented] (SPARK-25043) spark-sql should print the appId and master on startup

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571736#comment-16571736 ] Apache Spark commented on SPARK-25043: -- User 'abellina' has created a pull request for this issue:

[jira] [Created] (SPARK-25043) spark-sql should print the appId and master on startup

2018-08-07 Thread Alessandro Bellina (JIRA)
Alessandro Bellina created SPARK-25043: -- Summary: spark-sql should print the appId and master on startup Key: SPARK-25043 URL: https://issues.apache.org/jira/browse/SPARK-25043 Project: Spark

[jira] [Resolved] (SPARK-19602) Unable to query using the fully qualified column name of the form ( ..)

2018-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19602. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 17185

[jira] [Commented] (SPARK-25003) Pyspark Does not use Spark Sql Extensions

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571630#comment-16571630 ] Apache Spark commented on SPARK-25003: -- User 'RussellSpitzer' has created a pull request for this

[jira] [Commented] (SPARK-25003) Pyspark Does not use Spark Sql Extensions

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571631#comment-16571631 ] Apache Spark commented on SPARK-25003: -- User 'RussellSpitzer' has created a pull request for this

[jira] [Assigned] (SPARK-25034) possible triple memory consumption in fetchBlockSync()

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25034: Assignee: Apache Spark > possible triple memory consumption in fetchBlockSync() >

[jira] [Commented] (SPARK-25034) possible triple memory consumption in fetchBlockSync()

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571626#comment-16571626 ] Apache Spark commented on SPARK-25034: -- User 'vincent-grosbois' has created a pull request for this

[jira] [Assigned] (SPARK-25034) possible triple memory consumption in fetchBlockSync()

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25034: Assignee: (was: Apache Spark) > possible triple memory consumption in

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571421#comment-16571421 ] Apache Spark commented on SPARK-23928: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Created] (SPARK-25042) Flaky test: org.apache.spark.streaming.kafka010.KafkaRDDSuite.compacted topic

2018-08-07 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-25042: --- Summary: Flaky test: org.apache.spark.streaming.kafka010.KafkaRDDSuite.compacted topic Key: SPARK-25042 URL: https://issues.apache.org/jira/browse/SPARK-25042 Project:

[jira] [Assigned] (SPARK-24772) support reading AVRO logical types - Decimal

2018-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24772: --- Assignee: Gengliang Wang > support reading AVRO logical types - Decimal >

[jira] [Resolved] (SPARK-24772) support reading AVRO logical types - Decimal

2018-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24772. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21984

[jira] [Assigned] (SPARK-24005) Remove usage of Scala’s parallel collection

2018-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24005: --- Assignee: Maxim Gekk > Remove usage of Scala’s parallel collection >

[jira] [Resolved] (SPARK-24005) Remove usage of Scala’s parallel collection

2018-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24005. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21913

[jira] [Commented] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571294#comment-16571294 ] Apache Spark commented on SPARK-24948: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-24948) SHS filters wrongly some applications due to permission check

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571260#comment-16571260 ] Apache Spark commented on SPARK-24948: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Updated] (SPARK-25041) genjavadoc-plugin_0.10 is not found with sbt in scala-2.12

2018-08-07 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-25041: - Summary: genjavadoc-plugin_0.10 is not found with sbt in scala-2.12 (was:

[jira] [Assigned] (SPARK-25041) genjavadoc-plugin_2.12.6 is not found with sbt in scala-2.12

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25041: Assignee: (was: Apache Spark) > genjavadoc-plugin_2.12.6 is not found with sbt in

[jira] [Assigned] (SPARK-25041) genjavadoc-plugin_2.12.6 is not found with sbt in scala-2.12

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25041: Assignee: Apache Spark > genjavadoc-plugin_2.12.6 is not found with sbt in scala-2.12 >

[jira] [Commented] (SPARK-25041) genjavadoc-plugin_2.12.6 is not found with sbt in scala-2.12

2018-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571240#comment-16571240 ] Apache Spark commented on SPARK-25041: -- User 'kiszk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-24341) Codegen compile error from predicate subquery

2018-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24341. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21403

  1   2   >