[jira] [Assigned] (SPARK-17374) Improves the error message when fails to parse some json file lines in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17374: Assignee: (was: Apache Spark) > Improves the error message when fails to parse some js

[jira] [Assigned] (SPARK-17374) Improves the error message when fails to parse some json file lines in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17374: Assignee: Apache Spark > Improves the error message when fails to parse some json file lin

[jira] [Commented] (SPARK-17374) Improves the error message when fails to parse some json file lines in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457716#comment-15457716 ] Apache Spark commented on SPARK-17374: -- User 'clockfly' has created a pull request f

[jira] [Created] (SPARK-17374) Improves the error message when fails to parse some json file lines in DataFrameReader

Sean Zhong created SPARK-17374: -- Summary: Improves the error message when fails to parse some json file lines in DataFrameReader Key: SPARK-17374 URL: https://issues.apache.org/jira/browse/SPARK-17374 Pr

[jira] [Updated] (SPARK-17373) spark+hive+hbase+hbaseIntegration not working

[ https://issues.apache.org/jira/browse/SPARK-17373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] prasannaP updated SPARK-17373: -- Labels: soon (was: ) > spark+hive+hbase+hbaseIntegration not working > ---

[jira] [Created] (SPARK-17373) spark+hive+hbase+hbaseIntegration not working

prasannaP created SPARK-17373: - Summary: spark+hive+hbase+hbaseIntegration not working Key: SPARK-17373 URL: https://issues.apache.org/jira/browse/SPARK-17373 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16614) DirectJoin with DataSource for SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-16614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457572#comment-15457572 ] Yin Huai commented on SPARK-16614: -- [~rspitzer] One clarification question. Do you mean

[jira] [Commented] (SPARK-11397) PySpark Streaming uses threadcontext class loader, may cause issues on mesos

[ https://issues.apache.org/jira/browse/SPARK-11397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457534#comment-15457534 ] Dayne Sorvisto commented on SPARK-11397: I'd love to work on this issue. > PySpa

[jira] [Updated] (SPARK-17361) file-based external table without path should not be created

[ https://issues.apache.org/jira/browse/SPARK-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17361: Summary: file-based external table without path should not be created (was: createExternalTable sh

[jira] [Commented] (SPARK-16533) Spark application not handling preemption messages

[ https://issues.apache.org/jira/browse/SPARK-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457493#comment-15457493 ] Apache Spark commented on SPARK-16533: -- User 'angolon' has created a pull request fo

[jira] [Updated] (SPARK-17279) better error message for exceptions during ScalaUDF execution

[ https://issues.apache.org/jira/browse/SPARK-17279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17279: Summary: better error message for exceptions during ScalaUDF execution (was: better error message

[jira] [Created] (SPARK-17372) Running a file stream on a directory with partitioned subdirs throw NotSerializableException/StackOverflowError

Tathagata Das created SPARK-17372: - Summary: Running a file stream on a directory with partitioned subdirs throw NotSerializableException/StackOverflowError Key: SPARK-17372 URL: https://issues.apache.org/jira/bro

[jira] [Assigned] (SPARK-17371) Resubmitted stage outputs deleted by zombie map tasks on stop()

[ https://issues.apache.org/jira/browse/SPARK-17371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17371: Assignee: Apache Spark > Resubmitted stage outputs deleted by zombie map tasks on stop() >

[jira] [Assigned] (SPARK-17371) Resubmitted stage outputs deleted by zombie map tasks on stop()

[ https://issues.apache.org/jira/browse/SPARK-17371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17371: Assignee: (was: Apache Spark) > Resubmitted stage outputs deleted by zombie map tasks

[jira] [Commented] (SPARK-17371) Resubmitted stage outputs deleted by zombie map tasks on stop()

[ https://issues.apache.org/jira/browse/SPARK-17371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457215#comment-15457215 ] Apache Spark commented on SPARK-17371: -- User 'ericl' has created a pull request for

[jira] [Updated] (SPARK-17370) Shuffle service files not invalidated when a slave is lost

[ https://issues.apache.org/jira/browse/SPARK-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-17370: --- Component/s: Spark Core > Shuffle service files not invalidated when a slave is lost > --

[jira] [Created] (SPARK-17371) Resubmitted stage outputs deleted by zombie map tasks on stop()

Eric Liang created SPARK-17371: -- Summary: Resubmitted stage outputs deleted by zombie map tasks on stop() Key: SPARK-17371 URL: https://issues.apache.org/jira/browse/SPARK-17371 Project: Spark

[jira] [Commented] (SPARK-17370) Shuffle service files not invalidated when a slave is lost

[ https://issues.apache.org/jira/browse/SPARK-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457168#comment-15457168 ] Apache Spark commented on SPARK-17370: -- User 'ericl' has created a pull request for

[jira] [Assigned] (SPARK-17370) Shuffle service files not invalidated when a slave is lost

[ https://issues.apache.org/jira/browse/SPARK-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17370: Assignee: (was: Apache Spark) > Shuffle service files not invalidated when a slave is

[jira] [Assigned] (SPARK-17370) Shuffle service files not invalidated when a slave is lost

[ https://issues.apache.org/jira/browse/SPARK-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17370: Assignee: Apache Spark > Shuffle service files not invalidated when a slave is lost >

[jira] [Created] (SPARK-17370) Shuffle service files not invalidated when a slave is lost

Eric Liang created SPARK-17370: -- Summary: Shuffle service files not invalidated when a slave is lost Key: SPARK-17370 URL: https://issues.apache.org/jira/browse/SPARK-17370 Project: Spark Issue

[jira] [Commented] (SPARK-16926) Partition columns are present in columns metadata for partition but not table

[ https://issues.apache.org/jira/browse/SPARK-16926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457098#comment-15457098 ] Apache Spark commented on SPARK-16926: -- User 'dafrista' has created a pull request f

[jira] [Updated] (SPARK-16302) Set the right number of partitions for reading data from a local collection.

[ https://issues.apache.org/jira/browse/SPARK-16302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-16302: --- Assignee: Lianhui Wang > Set the right number of partitions for reading data from a local collection.

[jira] [Resolved] (SPARK-16302) Set the right number of partitions for reading data from a local collection.

[ https://issues.apache.org/jira/browse/SPARK-16302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-16302. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 13979 [https://github.

[jira] [Resolved] (SPARK-16619) Add shuffle service metrics entry in monitoring docs

[ https://issues.apache.org/jira/browse/SPARK-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-16619. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14254 [https://github.

[jira] [Resolved] (SPARK-16525) Enable Row Based HashMap in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-16525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-16525. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14176 [https://github.

[jira] [Commented] (SPARK-13534) Implement Apache Arrow serializer for Spark DataFrame for use in DataFrame.toPandas

[ https://issues.apache.org/jira/browse/SPARK-13534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456990#comment-15456990 ] Frederick Reiss commented on SPARK-13534: - [~wesmckinn], are you planning to work

[jira] [Updated] (SPARK-16619) Add shuffle service metrics entry in monitoring docs

[ https://issues.apache.org/jira/browse/SPARK-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-16619: --- Assignee: YangyangLiu > Add shuffle service metrics entry in monitoring docs > --

[jira] [Commented] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456979#comment-15456979 ] Aris Vlasakakis commented on SPARK-17368: - Yes, agreed that this code cannot be p

[jira] [Comment Edited] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456966#comment-15456966 ] Jakob Odersky edited comment on SPARK-17368 at 9/1/16 11:48 PM: ---

[jira] [Commented] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456966#comment-15456966 ] Jakob Odersky commented on SPARK-17368: --- FYI the issue also occurs for top-level va

[jira] [Resolved] (SPARK-17355) Work around exception thrown by HiveResultSetMetaData.isSigned

[ https://issues.apache.org/jira/browse/SPARK-17355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17355. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull reque

[jira] [Assigned] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17369: Assignee: (was: Apache Spark) > MetastoreRelation toJSON throws exception > --

[jira] [Commented] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456936#comment-15456936 ] Apache Spark commented on SPARK-17369: -- User 'clockfly' has created a pull request f

[jira] [Assigned] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17369: Assignee: Apache Spark > MetastoreRelation toJSON throws exception > -

[jira] [Created] (SPARK-17369) MetastoreRelation toJSON throws exception

Sean Zhong created SPARK-17369: -- Summary: MetastoreRelation toJSON throws exception Key: SPARK-17369 URL: https://issues.apache.org/jira/browse/SPARK-17369 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aris Vlasakakis updated SPARK-17368: Description: Using Scala value classes as the inner type for Datasets breaks in Spark 2.0

[jira] [Updated] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aris Vlasakakis updated SPARK-17368: Environment: JDK 8 on MacOS Scala 2.11.8 Spark 2.0.0 was:Java 8 on MacOS > Scala value

[jira] [Created] (SPARK-17368) Scala value classes create encoder problems and break at runtime

Aris Vlasakakis created SPARK-17368: --- Summary: Scala value classes create encoder problems and break at runtime Key: SPARK-17368 URL: https://issues.apache.org/jira/browse/SPARK-17368 Project: Spark

[jira] [Commented] (SPARK-16882) Failures in JobGenerator Thread are Swallowed, Job Does Not Fail

[ https://issues.apache.org/jira/browse/SPARK-16882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456898#comment-15456898 ] Shixiong Zhu commented on SPARK-16882: -- You can register a default "UncaughtExceptio

[jira] [Updated] (SPARK-17356) A large Metadata filed in Alias can cause OOM when calling TreeNode.toJSON

[ https://issues.apache.org/jira/browse/SPARK-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-17356: - Target Version/s: 1.6.3, 2.0.1, 2.1.0 (was: 1.6.3, 2.0.0, 2.1.0) > A large Metadata filed in Ali

[jira] [Comment Edited] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456867#comment-15456867 ] gurmukh singh edited comment on SPARK-17211 at 9/1/16 10:52 PM: ---

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456867#comment-15456867 ] gurmukh singh commented on SPARK-17211: --- Thanks Davies. Can see the issue with the

[jira] [Updated] (SPARK-16461) Support partition batch pruning with `<=>` (EqualNullSafe) predicate in InMemoryTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-16461: --- Component/s: SQL > Support partition batch pruning with `<=>` (EqualNullSafe) predicate in > InMemor

[jira] [Updated] (SPARK-16461) Support partition batch pruning with `<=>` (EqualNullSafe) predicate in InMemoryTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-16461: --- Assignee: Hyukjin Kwon > Support partition batch pruning with `<=>` (EqualNullSafe) predicate in > I

[jira] [Resolved] (SPARK-16461) Support partition batch pruning with `<=>` (EqualNullSafe) predicate in InMemoryTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-16461. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14117 [https://github.

[jira] [Commented] (SPARK-16922) Query with Broadcast Hash join fails due to executor OOM in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456744#comment-15456744 ] Sital Kedia commented on SPARK-16922: - Thanks for the fix [~davies]. I will test this

[jira] [Commented] (SPARK-17366) Temp tables cached in spark - Joins performance

[ https://issues.apache.org/jira/browse/SPARK-17366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456694#comment-15456694 ] Herman van Hovell commented on SPARK-17366: --- [~chris_sanjiv] Is this a question

[jira] [Created] (SPARK-17367) Cannot define value classes in REPL

Jakob Odersky created SPARK-17367: - Summary: Cannot define value classes in REPL Key: SPARK-17367 URL: https://issues.apache.org/jira/browse/SPARK-17367 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-16926) Partition columns are present in columns metadata for partition but not table

[ https://issues.apache.org/jira/browse/SPARK-16926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-16926. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull reque

[jira] [Created] (SPARK-17366) Temp tables cached in spark - Joins performance

Chris Sanjiv Xavier created SPARK-17366: --- Summary: Temp tables cached in spark - Joins performance Key: SPARK-17366 URL: https://issues.apache.org/jira/browse/SPARK-17366 Project: Spark

[jira] [Resolved] (SPARK-11138) Flaky pyspark test: test_add_py_file

[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11138. Resolution: Cannot Reproduce Haven't seen this in a long while, let's close it for now. >

[jira] [Updated] (SPARK-16732) Remove unused codes in subexpressionEliminationForWholeStageCodegen

[ https://issues.apache.org/jira/browse/SPARK-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-16732: --- Fix Version/s: (was: 2.0.1) > Remove unused codes in subexpressionEliminationForWholeStageCodegen

[jira] [Commented] (SPARK-16922) Query with Broadcast Hash join fails due to executor OOM in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456605#comment-15456605 ] Davies Liu commented on SPARK-16922: [~sitalke...@gmail.com] I think I found the caus

[jira] [Commented] (SPARK-16922) Query with Broadcast Hash join fails due to executor OOM in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456597#comment-15456597 ] Apache Spark commented on SPARK-16922: -- User 'davies' has created a pull request for

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456598#comment-15456598 ] Apache Spark commented on SPARK-17211: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-16922) Query with Broadcast Hash join fails due to executor OOM in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-16922: -- Assignee: Davies Liu > Query with Broadcast Hash join fails due to executor OOM in Spark 2.0 >

[jira] [Assigned] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-17211: -- Assignee: Davies Liu > Broadcast join produces incorrect results on EMR with large driver memo

[jira] [Assigned] (SPARK-17365) Kill multiple executors together to reduce lock contention

[ https://issues.apache.org/jira/browse/SPARK-17365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17365: Assignee: Apache Spark > Kill multiple executors together to reduce lock contention >

[jira] [Commented] (SPARK-17365) Kill multiple executors together to reduce lock contention

[ https://issues.apache.org/jira/browse/SPARK-17365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456507#comment-15456507 ] Apache Spark commented on SPARK-17365: -- User 'dhruve' has created a pull request for

[jira] [Assigned] (SPARK-17365) Kill multiple executors together to reduce lock contention

[ https://issues.apache.org/jira/browse/SPARK-17365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17365: Assignee: (was: Apache Spark) > Kill multiple executors together to reduce lock conten

[jira] [Created] (SPARK-17365) Kill multiple executors together to reduce lock contention

Dhruve Ashar created SPARK-17365: Summary: Kill multiple executors together to reduce lock contention Key: SPARK-17365 URL: https://issues.apache.org/jira/browse/SPARK-17365 Project: Spark Is

[jira] [Commented] (SPARK-16533) Spark application not handling preemption messages

[ https://issues.apache.org/jira/browse/SPARK-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456416#comment-15456416 ] Apache Spark commented on SPARK-16533: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-17299) TRIM/LTRIM/RTRIM strips characters other than spaces

[ https://issues.apache.org/jira/browse/SPARK-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17299: Assignee: Apache Spark > TRIM/LTRIM/RTRIM strips characters other than spaces > --

[jira] [Assigned] (SPARK-17299) TRIM/LTRIM/RTRIM strips characters other than spaces

[ https://issues.apache.org/jira/browse/SPARK-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17299: Assignee: (was: Apache Spark) > TRIM/LTRIM/RTRIM strips characters other than spaces >

[jira] [Commented] (SPARK-17299) TRIM/LTRIM/RTRIM strips characters other than spaces

[ https://issues.apache.org/jira/browse/SPARK-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456387#comment-15456387 ] Apache Spark commented on SPARK-17299: -- User 'techaddict' has created a pull request

[jira] [Resolved] (SPARK-17331) Avoid allocating 0-length arrays

[ https://issues.apache.org/jira/browse/SPARK-17331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17331. Resolution: Fixed Fix Version/s: 2.1.0 > Avoid allocating 0-length arrays >

[jira] [Resolved] (SPARK-17263) Support binary literals in SQL

[ https://issues.apache.org/jira/browse/SPARK-17263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17263. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14832 [https://github.

[jira] [Updated] (SPARK-17309) ALTER VIEW should throw exception if view not exist

[ https://issues.apache.org/jira/browse/SPARK-17309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-17309: --- Fix Version/s: (was: 2.01) 2.0.1 > ALTER VIEW should throw exception i

[jira] [Updated] (SPARK-17356) A large Metadata filed in Alias can cause OOM when calling TreeNode.toJSON

[ https://issues.apache.org/jira/browse/SPARK-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17356: - Target Version/s: 2.0.0, 1.6.3, 2.1.0 (was: 2.0.0, 2.1.0) > A large Metadata filed in Alias can cause OO

[jira] [Resolved] (SPARK-17362) fix MultivariantOnlineSummerizer.numNonZeros

[ https://issues.apache.org/jira/browse/SPARK-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17362. --- Resolution: Duplicate > fix MultivariantOnlineSummerizer.numNonZeros > --

[jira] [Updated] (SPARK-17067) Revocable resource support

[ https://issues.apache.org/jira/browse/SPARK-17067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-17067: Description: Blocked by https://issues.apache.org/jira/browse/MESOS-4392 > Revocable resour

[jira] [Closed] (SPARK-11183) enable support for mesos 0.24+

[ https://issues.apache.org/jira/browse/SPARK-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt closed SPARK-11183. --- Resolution: Done > enable support for mesos 0.24+ > -- > >

[jira] [Closed] (SPARK-6679) java.lang.ClassNotFoundException on Mesos fine grained mode and input replication

[ https://issues.apache.org/jira/browse/SPARK-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt closed SPARK-6679. -- Resolution: Won't Fix fine-grained is deprecated > java.lang.ClassNotFoundException on Mesos f

[jira] [Closed] (SPARK-5197) Support external shuffle service in fine-grained mode on mesos cluster

[ https://issues.apache.org/jira/browse/SPARK-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt closed SPARK-5197. -- Resolution: Won't Fix fine-grained is deprecated > Support external shuffle service in fine-gr

[jira] [Resolved] (SPARK-17318) Fix flaky test: o.a.s.repl.ReplSuite replicating blocks of object with class defined in repl

[ https://issues.apache.org/jira/browse/SPARK-17318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-17318. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Fix flaky test: o.a.s.

[jira] [Created] (SPARK-17364) Can not query hive table starting with number

Egor Pahomov created SPARK-17364: Summary: Can not query hive table starting with number Key: SPARK-17364 URL: https://issues.apache.org/jira/browse/SPARK-17364 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-16533) Spark application not handling preemption messages

[ https://issues.apache.org/jira/browse/SPARK-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16533. Resolution: Fixed Assignee: Angus Gerry Fix Version/s: 2.1.0 > Spark applic

[jira] [Updated] (SPARK-17356) A large Metadata filed in Alias can cause OOM when calling TreeNode.toJSON

[ https://issues.apache.org/jira/browse/SPARK-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17356: - Summary: A large Metadata filed in Alias can cause OOM when calling TreeNode.toJSON (was: Out of memory

[jira] [Assigned] (SPARK-17363) fix MultivariantOnlineSummerizer.numNonZeros

[ https://issues.apache.org/jira/browse/SPARK-17363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17363: Assignee: (was: Apache Spark) > fix MultivariantOnlineSummerizer.numNonZeros > ---

[jira] [Assigned] (SPARK-17363) fix MultivariantOnlineSummerizer.numNonZeros

[ https://issues.apache.org/jira/browse/SPARK-17363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17363: Assignee: Apache Spark > fix MultivariantOnlineSummerizer.numNonZeros > --

[jira] [Commented] (SPARK-17363) fix MultivariantOnlineSummerizer.numNonZeros

[ https://issues.apache.org/jira/browse/SPARK-17363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456062#comment-15456062 ] Apache Spark commented on SPARK-17363: -- User 'WeichenXu123' has created a pull reque

[jira] [Assigned] (SPARK-17363) fix MultivariantOnlineSummerizer.numNonZeros

[ https://issues.apache.org/jira/browse/SPARK-17363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17363: Assignee: Apache Spark > fix MultivariantOnlineSummerizer.numNonZeros > --

[jira] [Assigned] (SPARK-17363) fix MultivariantOnlineSummerizer.numNonZeros

[ https://issues.apache.org/jira/browse/SPARK-17363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17363: Assignee: (was: Apache Spark) > fix MultivariantOnlineSummerizer.numNonZeros > ---

[jira] [Created] (SPARK-17362) fix MultivariantOnlineSummerizer.numNonZeros

Weichen Xu created SPARK-17362: -- Summary: fix MultivariantOnlineSummerizer.numNonZeros Key: SPARK-17362 URL: https://issues.apache.org/jira/browse/SPARK-17362 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-17363) fix MultivariantOnlineSummerizer.numNonZeros

Weichen Xu created SPARK-17363: -- Summary: fix MultivariantOnlineSummerizer.numNonZeros Key: SPARK-17363 URL: https://issues.apache.org/jira/browse/SPARK-17363 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12978) Skip unnecessary final group-by when input data already clustered with group-by keys

[ https://issues.apache.org/jira/browse/SPARK-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12978: -- Fix Version/s: (was: 2.1.0) > Skip unnecessary final group-by when input data already clustered wit

[jira] [Commented] (SPARK-17175) Add a expert formula to aggregationDepth of SharedParam

[ https://issues.apache.org/jira/browse/SPARK-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455963#comment-15455963 ] Weichen Xu commented on SPARK-17175: I will work on it, thanks! > Add a expert formu

[jira] [Assigned] (SPARK-17175) Add a expert formula to aggregationDepth of SharedParam

[ https://issues.apache.org/jira/browse/SPARK-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17175: Assignee: (was: Apache Spark) > Add a expert formula to aggregationDepth of SharedPara

[jira] [Commented] (SPARK-17175) Add a expert formula to aggregationDepth of SharedParam

[ https://issues.apache.org/jira/browse/SPARK-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455962#comment-15455962 ] Apache Spark commented on SPARK-17175: -- User 'WeichenXu123' has created a pull reque

[jira] [Assigned] (SPARK-17175) Add a expert formula to aggregationDepth of SharedParam

[ https://issues.apache.org/jira/browse/SPARK-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17175: Assignee: Apache Spark > Add a expert formula to aggregationDepth of SharedParam > ---

[jira] [Commented] (SPARK-17348) Incorrect results from subquery transformation

[ https://issues.apache.org/jira/browse/SPARK-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455851#comment-15455851 ] Nattavut Sutyanyong commented on SPARK-17348: - Here is a use case: "Find cus

[jira] [Comment Edited] (SPARK-17335) Creating Hive table from Spark data

[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455709#comment-15455709 ] Herman van Hovell edited comment on SPARK-17335 at 9/1/16 3:07 PM:

[jira] [Commented] (SPARK-17335) Creating Hive table from Spark data

[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455709#comment-15455709 ] Herman van Hovell commented on SPARK-17335: --- {ArrayType} and {MapType} do not h

[jira] [Commented] (SPARK-17361) createExternalTable should fail if path is not given for file-based data source

[ https://issues.apache.org/jira/browse/SPARK-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455675#comment-15455675 ] Apache Spark commented on SPARK-17361: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-17361) createExternalTable should fail if path is not given for file-based data source

[ https://issues.apache.org/jira/browse/SPARK-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17361: Assignee: Wenchen Fan (was: Apache Spark) > createExternalTable should fail if path is no

[jira] [Assigned] (SPARK-17361) createExternalTable should fail if path is not given for file-based data source

[ https://issues.apache.org/jira/browse/SPARK-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17361: Assignee: Apache Spark (was: Wenchen Fan) > createExternalTable should fail if path is no

[jira] [Commented] (SPARK-17335) Creating Hive table from Spark data

[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455672#comment-15455672 ] Herman van Hovell commented on SPARK-17335: --- Turns out this is not correct, Str

[jira] [Issue Comment Deleted] (SPARK-17335) Creating Hive table from Spark data

[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17335: -- Comment: was deleted (was: Turns out this is not correct, StructType handles this corre

[jira] [Commented] (SPARK-17335) Creating Hive table from Spark data

[ https://issues.apache.org/jira/browse/SPARK-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455671#comment-15455671 ] Herman van Hovell commented on SPARK-17335: --- Turns out this is not correct, Str

  1   2   >