[jira] [Updated] (SPARK-12362) Create a full-fledged built-in SQL parser

[ https://issues.apache.org/jira/browse/SPARK-12362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12362: Description: Spark currently has two SQL parsers it is using: a simple one based on Scala parser c

[jira] [Created] (SPARK-12419) FetchFailed = false Executor lost should not allowed re-registered in BlockManager Master again?

SuYan created SPARK-12419: - Summary: FetchFailed = false Executor lost should not allowed re-registered in BlockManager Master again? Key: SPARK-12419 URL: https://issues.apache.org/jira/browse/SPARK-12419 Pr

[jira] [Updated] (SPARK-12313) getPartitionsByFilter doesnt handle predicates on all / multiple Partition Columns

[ https://issues.apache.org/jira/browse/SPARK-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gobinathan SP updated SPARK-12313: -- Description: When enabled spark.sql.hive.metastorePartitionPruning, the getPartitionsByFilter

[jira] [Created] (SPARK-12418) spark shuffle FAILED_TO_UNCOMPRESS

dirk.zhang created SPARK-12418: -- Summary: spark shuffle FAILED_TO_UNCOMPRESS Key: SPARK-12418 URL: https://issues.apache.org/jira/browse/SPARK-12418 Project: Spark Issue Type: Bug Affects Ve

[jira] [Commented] (SPARK-12400) Avoid writing a shuffle file if a partition has no output (empty)

[ https://issues.apache.org/jira/browse/SPARK-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063534#comment-15063534 ] Reynold Xin commented on SPARK-12400: - Please go ahead. > Avoid writing a shuffle f

[jira] [Assigned] (SPARK-12398) Smart truncation of DataFrame / Dataset toString

[ https://issues.apache.org/jira/browse/SPARK-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12398: Assignee: Apache Spark > Smart truncation of DataFrame / Dataset toString > --

[jira] [Updated] (SPARK-8321) Authorization Support(on all operations not only DDL) in Spark Sql

[ https://issues.apache.org/jira/browse/SPARK-8321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-8321: -- Attachment: SparkSQLauthorizationDesignDocument.pdf > Authorization Support(on all operations not only DDL) in S

[jira] [Updated] (SPARK-12417) Orc bloom filter options are not propagated during file write in spark

[ https://issues.apache.org/jira/browse/SPARK-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-12417: - Attachment: SPARK-12417.1.patch > Orc bloom filter options are not propagated during file

[jira] [Created] (SPARK-12417) Orc bloom filter options are not propagated during file write in spark

Rajesh Balamohan created SPARK-12417: Summary: Orc bloom filter options are not propagated during file write in spark Key: SPARK-12417 URL: https://issues.apache.org/jira/browse/SPARK-12417 Projec

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: Apache Spark > Add read.text and write.text for SparkR > ---

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: (was: Apache Spark) > Add read.text and write.text for SparkR >

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: (was: Apache Spark) > Add read.text and write.text for SparkR >

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: Apache Spark > Add read.text and write.text for SparkR > ---

[jira] [Commented] (SPARK-12400) Avoid writing a shuffle file if a partition has no output (empty)

[ https://issues.apache.org/jira/browse/SPARK-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063372#comment-15063372 ] Saisai Shao commented on SPARK-12400: - [~rxin], would you mind me taking a crack at t

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063365#comment-15063365 ] Sun Rui commented on SPARK-12360: - yes, use string to represent a long value, and parse i

[jira] [Commented] (SPARK-12400) Avoid writing a shuffle file if a partition has no output (empty)

[ https://issues.apache.org/jira/browse/SPARK-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063359#comment-15063359 ] Saisai Shao commented on SPARK-12400: - So from my understanding this will only be exi

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063352#comment-15063352 ] Shivaram Venkataraman commented on SPARK-12360: --- For all the random seed ca

[jira] [Commented] (SPARK-12392) Optimize a location order of broadcast blocks by considering preferred local hosts

[ https://issues.apache.org/jira/browse/SPARK-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063323#comment-15063323 ] Apache Spark commented on SPARK-12392: -- User 'maropu' has created a pull request for

[jira] [Updated] (SPARK-12399) Display correct error message when accessing REST API with an unknown app Id

[ https://issues.apache.org/jira/browse/SPARK-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carson Wang updated SPARK-12399: Description: I got an exception when accessing the below REST API with an unknown application Id.

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063300#comment-15063300 ] Sun Rui commented on SPARK-12360: - This JIRA was intented to address the issue of passing

[jira] [Commented] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063295#comment-15063295 ] Shivaram Venkataraman commented on SPARK-10500: --- I don't mind merging this

[jira] [Resolved] (SPARK-11749) Duplicate creating the RDD in file stream when recovering from checkpoint data

[ https://issues.apache.org/jira/browse/SPARK-11749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-11749. -- Resolution: Fixed Assignee: Jack Hu Fix Version/s: 2.0.0 1.6.

[jira] [Commented] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063272#comment-15063272 ] Huaxin Gao commented on SPARK-12409: https://github.com/apache/spark/pull/10369 > JD

[jira] [Assigned] (SPARK-12399) Display correct error message when accessing REST API with an unknown app Id

[ https://issues.apache.org/jira/browse/SPARK-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12399: Assignee: Apache Spark > Display correct error message when accessing REST API with an unk

[jira] [Assigned] (SPARK-12399) Display correct error message when accessing REST API with an unknown app Id

[ https://issues.apache.org/jira/browse/SPARK-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12399: Assignee: (was: Apache Spark) > Display correct error message when accessing REST API

[jira] [Assigned] (SPARK-12415) Do not use closure serializer to serialize task result

[ https://issues.apache.org/jira/browse/SPARK-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12415: Assignee: Apache Spark > Do not use closure serializer to serialize task result >

[jira] [Assigned] (SPARK-12415) Do not use closure serializer to serialize task result

[ https://issues.apache.org/jira/browse/SPARK-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12415: Assignee: (was: Apache Spark) > Do not use closure serializer to serialize task result

[jira] [Commented] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063241#comment-15063241 ] Sun Rui commented on SPARK-10500: - [~jerryshao] I am OK with backporting. But will there

[jira] [Issue Comment Deleted] (SPARK-9346) Conversion is applied three times on partitioned data sources that require conversion

[ https://issues.apache.org/jira/browse/SPARK-9346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9346: --- Comment: was deleted (was: User 'viirya' has created a pull request for this issue: https://github.com

[jira] [Commented] (SPARK-12411) Reconsider executor heartbeats rpc timeout

[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063145#comment-15063145 ] Apache Spark commented on SPARK-12411: -- User 'nongli' has created a pull request for

[jira] [Assigned] (SPARK-12411) Reconsider executor heartbeats rpc timeout

[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12411: Assignee: Apache Spark > Reconsider executor heartbeats rpc timeout >

[jira] [Assigned] (SPARK-12411) Reconsider executor heartbeats rpc timeout

[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12411: Assignee: (was: Apache Spark) > Reconsider executor heartbeats rpc timeout > -

[jira] [Assigned] (SPARK-12416) Add Reliable receiver for JMS

[ https://issues.apache.org/jira/browse/SPARK-12416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12416: Assignee: Apache Spark > Add Reliable receiver for JMS > -- >

[jira] [Commented] (SPARK-12398) Smart truncation of DataFrame / Dataset toString

[ https://issues.apache.org/jira/browse/SPARK-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063137#comment-15063137 ] Reynold Xin commented on SPARK-12398: - Go for it. > Smart truncation of DataFrame /

[jira] [Created] (SPARK-12416) Add Reliable receiver for JMS

Matthew Taylor created SPARK-12416: -- Summary: Add Reliable receiver for JMS Key: SPARK-12416 URL: https://issues.apache.org/jira/browse/SPARK-12416 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-12415) Do not use closure serializer to serialize task result

Andrew Or created SPARK-12415: - Summary: Do not use closure serializer to serialize task result Key: SPARK-12415 URL: https://issues.apache.org/jira/browse/SPARK-12415 Project: Spark Issue Type:

[jira] [Created] (SPARK-12414) Remove closure serializer

Andrew Or created SPARK-12414: - Summary: Remove closure serializer Key: SPARK-12414 URL: https://issues.apache.org/jira/browse/SPARK-12414 Project: Spark Issue Type: Bug Components: Spa

[jira] [Resolved] (SPARK-8641) Native Spark Window Functions

[ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8641. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9819 [https://github.com/apac

[jira] [Updated] (SPARK-8641) Native Spark Window Functions

[ https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8641: Assignee: Herman van Hovell > Native Spark Window Functions > - > >

[jira] [Commented] (SPARK-12412) Support LIKE in the JDBCRDD

[ https://issues.apache.org/jira/browse/SPARK-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063040#comment-15063040 ] Bo Meng commented on SPARK-12412: - https://github.com/apache/spark/pull/10364 > Support

[jira] [Commented] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063005#comment-15063005 ] Michael Gummelt commented on SPARK-12413: - Updated. Thanks > Mesos ZK persisten

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: https://github.com/apache/spark/pull/10359 breaks ZK persistence due to https

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: This breaks ZK persistence due to https://issues.scala-lang.org/browse/SI-6654

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: https://github.com/apache/spark/pull/10359 breaks ZK persistence due to https

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: This breaks ZK persistence due to https://issues.scala-lang.org/browse/SI-6654

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Description: This breaks ZK persistence due to https://issues.scala-lang.org/browse/SI-6654

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Summary: Mesos ZK persistence throws a NotSerializableException (was: Mesos ZK persistence

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Summary: Mesos ZK persistence throws a (was: Mesos ZK persistence is broken) > Mesos ZK

[jira] [Assigned] (SPARK-12413) Mesos ZK persistence is broken

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12413: Assignee: Apache Spark > Mesos ZK persistence is broken > -- >

[jira] [Assigned] (SPARK-12413) Mesos ZK persistence is broken

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12413: Assignee: (was: Apache Spark) > Mesos ZK persistence is broken > -

[jira] [Commented] (SPARK-12413) Mesos ZK persistence is broken

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062990#comment-15062990 ] Sean Owen commented on SPARK-12413: --- [~mgummelt] I realize you linked to the issue but

[jira] [Created] (SPARK-12413) Mesos ZK persistence is broken

Michael Gummelt created SPARK-12413: --- Summary: Mesos ZK persistence is broken Key: SPARK-12413 URL: https://issues.apache.org/jira/browse/SPARK-12413 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12313) getPartitionsByFilter doesnt handle predicates on all / multiple Partition Columns

[ https://issues.apache.org/jira/browse/SPARK-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gobinathan SP updated SPARK-12313: -- Description: When enabled spark.sql.hive.metastorePartitionPruning, the getPartitionsByFilter

[jira] [Resolved] (SPARK-12376) Spark Streaming Java8APISuite fails in assertOrderInvariantEquals method

[ https://issues.apache.org/jira/browse/SPARK-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12376. -- Resolution: Fixed Assignee: Evan Chen Fix Version/s: 2.0.0 1.

[jira] [Resolved] (SPARK-12397) Improve error messages for data sources when they are not found

[ https://issues.apache.org/jira/browse/SPARK-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12397. -- Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved b

[jira] [Updated] (SPARK-12412) Support LIKE in the JDBCRDD

[ https://issues.apache.org/jira/browse/SPARK-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Meng updated SPARK-12412: Component/s: SQL > Support LIKE in the JDBCRDD > --- > > Key: SPARK

[jira] [Assigned] (SPARK-12412) Support LIKE in the JDBCRDD

[ https://issues.apache.org/jira/browse/SPARK-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12412: Assignee: Apache Spark > Support LIKE in the JDBCRDD > --- > >

[jira] [Assigned] (SPARK-12412) Support LIKE in the JDBCRDD

[ https://issues.apache.org/jira/browse/SPARK-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12412: Assignee: Apache Spark > Support LIKE in the JDBCRDD > --- > >

[jira] [Assigned] (SPARK-12412) Support LIKE in the JDBCRDD

[ https://issues.apache.org/jira/browse/SPARK-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12412: Assignee: (was: Apache Spark) > Support LIKE in the JDBCRDD >

[jira] [Created] (SPARK-12412) Support LIKE in the JDBCRDD

Bo Meng created SPARK-12412: --- Summary: Support LIKE in the JDBCRDD Key: SPARK-12412 URL: https://issues.apache.org/jira/browse/SPARK-12412 Project: Spark Issue Type: Improvement Reporte

[jira] [Commented] (SPARK-12387) JDBC IN operator push down

[ https://issues.apache.org/jira/browse/SPARK-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062890#comment-15062890 ] Apache Spark commented on SPARK-12387: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: Apache Spark > Add read.text and write.text for SparkR > ---

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: (was: Apache Spark) > Add read.text and write.text for SparkR >

[jira] [Updated] (SPARK-12313) getPartitionsByFilter doesnt handle predicates on all / multiple Partition Columns

[ https://issues.apache.org/jira/browse/SPARK-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gobinathan SP updated SPARK-12313: -- Priority: Critical (was: Minor) > getPartitionsByFilter doesnt handle predicates on all / mult

[jira] [Updated] (SPARK-12410) "." and "|" used for String.split directly

[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12410: - Fix Version/s: (was: 1.5.2) (was: 1.6.0) 2.0.0

[jira] [Resolved] (SPARK-12410) "." and "|" used for String.split directly

[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12410. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.2

[jira] [Updated] (SPARK-12410) "." and "|" used for String.split directly

[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12410: - Affects Version/s: 1.4.1 1.5.2 > "." and "|" used for String.split directl

[jira] [Commented] (SPARK-12218) Invalid splitting of nested AND expressions in Data Source filter API

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062835#comment-15062835 ] Apache Spark commented on SPARK-12218: -- User 'yhuai' has created a pull request for

[jira] [Comment Edited] (SPARK-10873) can't sort columns on history page

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062794#comment-15062794 ] Zhuo Liu edited comment on SPARK-10873 at 12/17/15 8:58 PM: H

[jira] [Updated] (SPARK-12218) Invalid splitting of nested AND expressions in Data Source filter API

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12218: - Summary: Invalid splitting of nested AND expressions in Data Source filter API (was: Boolean logic in sq

[jira] [Commented] (SPARK-10873) can't sort columns on history page

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062794#comment-15062794 ] Zhuo Liu commented on SPARK-10873: -- Hi Alex, I started working on this, hopefully I will

[jira] [Commented] (SPARK-12410) "." and "|" used for String.split directly

[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062768#comment-15062768 ] Apache Spark commented on SPARK-12410: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-10873) can't sort columns on history page

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062766#comment-15062766 ] Alex Bozarth commented on SPARK-10873: -- [~zhuoliu] are you currently working on this

[jira] [Updated] (SPARK-12390) Clean up unused serializer parameter in BlockManager

[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12390: -- Fix Version/s: 1.6.1 > Clean up unused serializer parameter in BlockManager > -

[jira] [Resolved] (SPARK-12390) Clean up unused serializer parameter in BlockManager

[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12390. --- Resolution: Fixed > Clean up unused serializer parameter in BlockManager > --

[jira] [Assigned] (SPARK-12390) Clean up unused serializer parameter in BlockManager

[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-12390: - Assignee: Andrew Or (was: Apache Spark) > Clean up unused serializer parameter in BlockManager

[jira] [Assigned] (SPARK-12387) JDBC IN operator push down

[ https://issues.apache.org/jira/browse/SPARK-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12387: Assignee: Apache Spark > JDBC IN operator push down > --- > >

[jira] [Created] (SPARK-12411) Reconsider executor heartbeats rpc timeout

Nong Li created SPARK-12411: --- Summary: Reconsider executor heartbeats rpc timeout Key: SPARK-12411 URL: https://issues.apache.org/jira/browse/SPARK-12411 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12402) Memory leak in pyspark

[ https://issues.apache.org/jira/browse/SPARK-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12402: --- Description: After run some SQL query in PySpark, the DataFrame are still referenced by py4j Gateway,

[jira] [Updated] (SPARK-12402) Memory leak in pyspark

[ https://issues.apache.org/jira/browse/SPARK-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12402: --- Summary: Memory leak in pyspark (was: Memory leak in broadcast hash join) > Memory leak in pyspark >

[jira] [Assigned] (SPARK-12410) "." and "|" used for String.split directly

[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12410: Assignee: Apache Spark > "." and "|" used for String.split directly >

[jira] [Assigned] (SPARK-12410) "." and "|" used for String.split directly

[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12410: Assignee: (was: Apache Spark) > "." and "|" used for String.split directly > -

[jira] [Updated] (SPARK-12410) "." and "|" used for String.split directly

[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12410: - Component/s: (was: Spark Core) Streaming > "." and "|" used for String.split

[jira] [Commented] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062628#comment-15062628 ] Apache Spark commented on SPARK-12404: -- User 'marmbrus' has created a pull request f

[jira] [Created] (SPARK-12410) "." and "|" used for String.split directly

Shixiong Zhu created SPARK-12410: Summary: "." and "|" used for String.split directly Key: SPARK-12410 URL: https://issues.apache.org/jira/browse/SPARK-12410 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-12409) JDBC AND operator push down

Huaxin Gao created SPARK-12409: -- Summary: JDBC AND operator push down Key: SPARK-12409 URL: https://issues.apache.org/jira/browse/SPARK-12409 Project: Spark Issue Type: Improvement Co

[jira] [Commented] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062612#comment-15062612 ] Huaxin Gao commented on SPARK-12409: I will submit a PR soon. > JDBC AND operator p

[jira] [Commented] (SPARK-12398) Smart truncation of DataFrame / Dataset toString

[ https://issues.apache.org/jira/browse/SPARK-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062527#comment-15062527 ] Dilip Biswal commented on SPARK-12398: -- [~rxin] Hi Reynold, are you working on this

[jira] [Resolved] (SPARK-12366) IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show

[ https://issues.apache.org/jira/browse/SPARK-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12366. Resolution: Duplicate > IllegalArgumentException: requirement failed: File not found: > ..

[jira] [Resolved] (SPARK-12220) Make Utils.fetchFile support files that contain special characters

[ https://issues.apache.org/jira/browse/SPARK-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12220. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0

[jira] [Updated] (SPARK-12220) Make Utils.fetchFile support files that contain special characters

[ https://issues.apache.org/jira/browse/SPARK-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12220: - Affects Version/s: 1.6.0 > Make Utils.fetchFile support files that contain special characters > -

[jira] [Updated] (SPARK-12408) Spark 1.6 with tachyon 0.8.2 uses deprecated client

[ https://issues.apache.org/jira/browse/SPARK-12408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12408: -- Priority: Minor (was: Major) [~calvin] yeah I had the same question. The Tachyon updates tend to intro

[jira] [Commented] (SPARK-11164) Add InSet pushdown filter back for Parquet

[ https://issues.apache.org/jira/browse/SPARK-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062319#comment-15062319 ] Apache Spark commented on SPARK-11164: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062313#comment-15062313 ] Cody Koeninger commented on SPARK-12177: Honestly SSL / auth is the only compelli

[jira] [Commented] (SPARK-10854) MesosExecutorBackend: Received launchTask but executor was null

[ https://issues.apache.org/jira/browse/SPARK-10854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062247#comment-15062247 ] Dmitry Romanenko commented on SPARK-10854: -- Any update on this? Maybe some sugge

[jira] [Created] (SPARK-12408) Spark 1.6 with tachyon 0.8.2 uses deprecated client

Rares Mirica created SPARK-12408: Summary: Spark 1.6 with tachyon 0.8.2 uses deprecated client Key: SPARK-12408 URL: https://issues.apache.org/jira/browse/SPARK-12408 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12353: Assignee: (was: Apache Spark) > wrong output for countByValue and countByValueAndWindo

[jira] [Assigned] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12353: Assignee: Apache Spark > wrong output for countByValue and countByValueAndWindow > ---

[jira] [Resolved] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12395. Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull reque

[jira] [Commented] (SPARK-12366) IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show

[ https://issues.apache.org/jira/browse/SPARK-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062203#comment-15062203 ] Yin Huai commented on SPARK-12366: -- Based on [~lian cheng]'s investigation, seems it is

  1   2   >