[jira] [Created] (SPARK-12973) Support to set priority when submit spark application to YARN

2016-01-23 Thread Chaozhong Yang (JIRA)
Chaozhong Yang created SPARK-12973: -- Summary: Support to set priority when submit spark application to YARN Key: SPARK-12973 URL: https://issues.apache.org/jira/browse/SPARK-12973 Project: Spark

[jira] [Commented] (SPARK-12972) Update org.apache.httpcomponents.httpclient

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114201#comment-15114201 ] Apache Spark commented on SPARK-12972: -- User 'blbradley' has created a pull request

[jira] [Assigned] (SPARK-12972) Update org.apache.httpcomponents.httpclient

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12972: Assignee: (was: Apache Spark) > Update org.apache.httpcomponents.httpclient >

[jira] [Assigned] (SPARK-12972) Update org.apache.httpcomponents.httpclient

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12972: Assignee: Apache Spark > Update org.apache.httpcomponents.httpclient > ---

[jira] [Created] (SPARK-12972) Update org.apache.httpcomponents.httpclient

2016-01-23 Thread Brandon Bradley (JIRA)
Brandon Bradley created SPARK-12972: --- Summary: Update org.apache.httpcomponents.httpclient Key: SPARK-12972 URL: https://issues.apache.org/jira/browse/SPARK-12972 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12624: Assignee: Apache Spark > When schema is specified, we should give better error message if

[jira] [Assigned] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12624: Assignee: (was: Apache Spark) > When schema is specified, we should give better error

[jira] [Commented] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114125#comment-15114125 ] Apache Spark commented on SPARK-12624: -- User 'liancheng' has created a pull request

[jira] [Updated] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12624: --- Description: The following code snippet reproduces this issue: {code} from pyspark.sql.types import S

[jira] [Commented] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114123#comment-15114123 ] Cheng Lian commented on SPARK-12624: Quoted Davies' offline comment {quote} We always

[jira] [Updated] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

2016-01-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12624: --- Summary: When schema is specified, we should give better error message if actual row length doesn't m

[jira] [Commented] (SPARK-8725) Test modules in topological order in dev/run-tests and python/run-tests

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114115#comment-15114115 ] Apache Spark commented on SPARK-8725: - User 'JoshRosen' has created a pull request for

[jira] [Comment Edited] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2016-01-23 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114080#comment-15114080 ] Alexander Ulanov edited comment on SPARK-10528 at 1/24/16 1:30 AM:

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2016-01-23 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114080#comment-15114080 ] Alexander Ulanov commented on SPARK-10528: -- Hi! I'm getting the same problem on

[jira] [Assigned] (SPARK-8725) Test modules in topological order in dev/run-tests and python/run-tests

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-8725: - Assignee: Josh Rosen > Test modules in topological order in dev/run-tests and python/run-tests >

[jira] [Commented] (SPARK-8725) Test modules in topological order in dev/run-tests and python/run-tests

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114067#comment-15114067 ] Josh Rosen commented on SPARK-8725: --- Here's an example of why this is a problem: I only

[jira] [Comment Edited] (SPARK-12970) Error in documentation

2016-01-23 Thread Haidar Hadi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114060#comment-15114060 ] Haidar Hadi edited comment on SPARK-12970 at 1/24/16 12:25 AM:

[jira] [Commented] (SPARK-12970) Error in documentation

2016-01-23 Thread Haidar Hadi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114060#comment-15114060 ] Haidar Hadi commented on SPARK-12970: - I do not mind, but I really do not know how to

[jira] [Assigned] (SPARK-12971) Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12971: Assignee: Apache Spark (was: Josh Rosen) > Address test isolation problems which broke Hi

[jira] [Commented] (SPARK-12971) Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114054#comment-15114054 ] Apache Spark commented on SPARK-12971: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-12971) Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12971: Assignee: Josh Rosen (was: Apache Spark) > Address test isolation problems which broke Hi

[jira] [Created] (SPARK-12971) Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build

2016-01-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-12971: -- Summary: Address test isolation problems which broke Hive tests on Hadoop 2.3 SBT build Key: SPARK-12971 URL: https://issues.apache.org/jira/browse/SPARK-12971 Project: S

[jira] [Commented] (SPARK-12897) spark ui with tachyon show all Stream Blocks

2016-01-23 Thread astralidea (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114052#comment-15114052 ] astralidea commented on SPARK-12897: It's a problem ! I mean if use StorageLevel such

[jira] [Commented] (SPARK-4878) driverPropsFetcher causes spurious Akka disassociate errors

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114044#comment-15114044 ] Josh Rosen commented on SPARK-4878: --- Sean, is this still valid after SPARK-5293, which r

[jira] [Resolved] (SPARK-12434) Make parts of the streaming testing API public to assist developers making their own tests.

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12434. Resolution: Won't Fix Closing as "Won't Fix", per the resolution of SPARK-12433 > Make parts of th

[jira] [Resolved] (SPARK-12432) Make parts of the Spark testing API public to assist developers making their own tests.

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12432. Resolution: Won't Fix Closing as "Won't Fix", per the resolution of SPARK-12433 > Make parts of th

[jira] [Resolved] (SPARK-12587) Make parts of the Spark SQL testing API public

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12587. Resolution: Won't Fix Closing as "Won't Fix", per the resolution of SPARK-12433 > Make parts of th

[jira] [Resolved] (SPARK-6557) Only set bold text on PR github test output for problems

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6557. --- Resolution: Won't Fix I don't think that anyone else has requested this feature, so I'm going to clos

[jira] [Comment Edited] (SPARK-10728) Failed to set Jenkins Identity header on email.

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114045#comment-15114045 ] Josh Rosen edited comment on SPARK-10728 at 1/24/16 12:02 AM: -

[jira] [Resolved] (SPARK-10728) Failed to set Jenkins Identity header on email.

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10728. Resolution: Invalid Resolving as "invalid", since I'd like to keep only actionable JIRAs that we m

[jira] [Resolved] (SPARK-9367) spark sql select * cause driver java.lang.OutOfMemoryError: Requested array size exceeds VM limit

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9367. --- Resolution: Invalid It sounds like you're trying to collect too much data to the driver. Without more

[jira] [Resolved] (SPARK-4991) Worker should reconnect to Master when Master actor restart

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4991. --- Resolution: Won't Fix Now that SPARK-5293, which removes Spark Core's dependency on Akka, has been co

[jira] [Resolved] (SPARK-10296) add preservesParitioning parameter to RDD.map

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10296. Resolution: Won't Fix Given the limited interest in this feature, combined with the fact that this

[jira] [Commented] (SPARK-9307) Logging: Make it either stable or private[spark]

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114032#comment-15114032 ] Josh Rosen commented on SPARK-9307: --- We might want to do this for Spark 2.0. > Logging:

[jira] [Commented] (SPARK-3075) Expose a way for users to parse event logs

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114030#comment-15114030 ] Josh Rosen commented on SPARK-3075: --- This seems out-of-scope / won't fix to me. I don't

[jira] [Resolved] (SPARK-3075) Expose a way for users to parse event logs

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3075. --- Resolution: Won't Fix > Expose a way for users to parse event logs > -

[jira] [Resolved] (SPARK-11588) Submitting of Spark (Streaming) Job and killing/stopping of them

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11588. Resolution: Invalid This JIRA asks several different questions some of which are mostly orthogonal.

[jira] [Resolved] (SPARK-9678) HTTP request to BlockManager port yields exception

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9678. --- Resolution: Not A Problem Resolving as "Not a Problem." > HTTP request to BlockManager port yields ex

[jira] [Resolved] (SPARK-3105) Calling cache() after RDDs are pipelined has no effect in PySpark

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3105. --- Resolution: Won't Fix Closing as "Won't Fix", since I don't think we have any plans to change this be

[jira] [Resolved] (SPARK-5812) Flaky test: o.a.s.JavaAPISuite

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5812. --- Resolution: Cannot Reproduce AFAIK this flakiness hasn't been observed in a really long time, so let's

[jira] [Updated] (SPARK-11416) Upgrade kryo package to version 3.0

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11416: --- Priority: Major (was: Trivial) > Upgrade kryo package to version 3.0 > -

[jira] [Updated] (SPARK-11416) Upgrade kryo package to version 3.0

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11416: --- Target Version/s: 2.0.0 > Upgrade kryo package to version 3.0 > --- >

[jira] [Resolved] (SPARK-12135) Remove scala-compiler and scalap deps from Spark runtime

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12135. Resolution: Won't Fix It's going to be tricky to assess whether JSON4S actually uses the scala-com

[jira] [Resolved] (SPARK-2949) SparkContext does not fate-share with ActorSystem

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2949. --- Resolution: Won't Fix Now that SPARK-5293, which removes Spark Core's dependency on Akka, has been co

[jira] [Resolved] (SPARK-2451) Enable to load config file for Akka

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2451. --- Resolution: Won't Fix Now that SPARK-5293, which removes Spark Core's dependency on Akka, has been co

[jira] [Commented] (SPARK-12946) The SQL page is empty

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114014#comment-15114014 ] Josh Rosen commented on SPARK-12946: +1. I don't think this JIRA is actionable given

[jira] [Commented] (SPARK-12964) SparkContext.localProperties leaked

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114011#comment-15114011 ] Josh Rosen commented on SPARK-12964: Haven't read the entirety of this yet, but to br

[jira] [Commented] (SPARK-12970) Error in documentation

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114010#comment-15114010 ] Josh Rosen commented on SPARK-12970: Do you mind submitting a pull request to fix thi

[jira] [Commented] (SPARK-12936) Initial bloom filter implementation

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113994#comment-15113994 ] Apache Spark commented on SPARK-12936: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-12936) Initial bloom filter implementation

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12936: Assignee: Wenchen Fan (was: Apache Spark) > Initial bloom filter implementation > ---

[jira] [Assigned] (SPARK-12936) Initial bloom filter implementation

2016-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12936: Assignee: Apache Spark (was: Wenchen Fan) > Initial bloom filter implementation > ---

[jira] [Commented] (SPARK-11796) Docker JDBC integration tests fail in Maven build due to dependency issue

2016-01-23 Thread Brandon Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113989#comment-15113989 ] Brandon Bradley commented on SPARK-11796: - I am still experiencing this while try

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

2016-01-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113985#comment-15113985 ] Josh Rosen commented on SPARK-3630: --- Hi [~gfeher], This is very helpful information. Th

[jira] [Updated] (SPARK-12904) Strength reduction for integer/decimal comparisons

2016-01-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12904: Description: We can do the following strength reduction for comparisons between an integral column

[jira] [Resolved] (SPARK-12904) Strength reduction for integer/decimal comparisons

2016-01-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12904. - Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 2.0.0 > Strength reduction

[jira] [Created] (SPARK-12970) Error in documentation

2016-01-23 Thread Haidar Hadi (JIRA)
Haidar Hadi created SPARK-12970: --- Summary: Error in documentation Key: SPARK-12970 URL: https://issues.apache.org/jira/browse/SPARK-12970 Project: Spark Issue Type: Bug Components: D

[jira] [Updated] (SPARK-12940) Partition field in Spark SQL WHERE clause causing Exception

2016-01-23 Thread Brian Wheeler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Wheeler updated SPARK-12940: -- Attachment: spark-12940.txt These commands can be run in the spark shell to duplicate this big.

[jira] [Updated] (SPARK-12940) Partition field in Spark SQL WHERE clause causing Exception

2016-01-23 Thread Brian Wheeler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Wheeler updated SPARK-12940: -- Affects Version/s: 1.6.0 Description: I have partitioned Parquet that I am trying to

[jira] [Created] (SPARK-12969) Exception while casting a spark supported date formatted "string" to "date" data type.

2016-01-23 Thread Jais Sebastian (JIRA)
Jais Sebastian created SPARK-12969: -- Summary: Exception while casting a spark supported date formatted "string" to "date" data type. Key: SPARK-12969 URL: https://issues.apache.org/jira/browse/SPARK-12969

[jira] [Commented] (SPARK-6875) Add support for Joda-time types

2016-01-23 Thread Patrick Grandjean (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113770#comment-15113770 ] Patrick Grandjean commented on SPARK-6875: -- SPARK-7768 > Add support for Joda-ti

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2016-01-23 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113764#comment-15113764 ] Luciano Resende commented on SPARK-5159: [~zhanzhang] Yes, the user that has prope

[jira] [Resolved] (SPARK-6422) support customized akka system for actor-based receiver

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6422. -- Resolution: Won't Fix > support customized akka system for actor-based receiver > --

[jira] [Resolved] (SPARK-6978) GraphX: Compute all the direct and indirect relations for each vertex

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6978. -- Resolution: Won't Fix > GraphX: Compute all the direct and indirect relations for each vertex >

[jira] [Resolved] (SPARK-6922) RDD.cartesian is much slower than join

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6922. -- Resolution: Duplicate Yes, a likely subset of SPARK-6307. I'm closing this since I don't see it's likel

[jira] [Resolved] (SPARK-6875) Add support for Joda-time types

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6875. -- Resolution: Won't Fix Although Joda is a pretty standard lib, it's also one of many third party librari

[jira] [Resolved] (SPARK-6539) SparkContext throws NullPointerException

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6539. -- Resolution: Won't Fix > SparkContext throws NullPointerException > -

[jira] [Resolved] (SPARK-3439) Add Canopy Clustering Algorithm

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3439. -- Resolution: Won't Fix > Add Canopy Clustering Algorithm > --- > >

[jira] [Commented] (SPARK-12966) Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type'

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113729#comment-15113729 ] Sean Owen commented on SPARK-12966: --- Don't set Fix version / set component please > Po

[jira] [Updated] (SPARK-12960) Some examples are missing support for python2

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12960: -- Assignee: Mark Grover > Some examples are missing support for python2 > ---

[jira] [Updated] (SPARK-12966) Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type'

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12966: -- Component/s: SQL > Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type' > --

[jira] [Updated] (SPARK-12967) NettyRPC races with SparkContext.stop() and throws exception

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12967: -- Component/s: Spark Core > NettyRPC races with SparkContext.stop() and throws exception > --

[jira] [Updated] (SPARK-12966) Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type'

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12966: -- Fix Version/s: (was: 1.6.1) > Postgres JDBC ArrayType(DecimalType) 'Unable to find server array typ

[jira] [Updated] (SPARK-12961) Work around memory leak in Snappy library

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12961: -- Component/s: Spark Core > Work around memory leak in Snappy library > -

[jira] [Commented] (SPARK-12968) Implement command to set current database

2016-01-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113723#comment-15113723 ] Herman van Hovell commented on SPARK-12968: --- I am working on removing the curre

[jira] [Resolved] (SPARK-12883) 1.6 Dynamic allocation document for removing executors with cached data differs in different sections

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12883. --- Resolution: Not A Problem > 1.6 Dynamic allocation document for removing executors with cached data

[jira] [Resolved] (SPARK-12897) spark ui with tachyon show all Stream Blocks

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12897. --- Resolution: Not A Problem > spark ui with tachyon show all Stream Blocks > --

[jira] [Resolved] (SPARK-11137) Make StreamingContext.stop() exception-safe

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11137. --- Resolution: Fixed Assignee: Jayadevan M Fix Version/s: 2.0.0 Resolved by https://gith

[jira] [Resolved] (SPARK-12760) inaccurate description for difference between local vs cluster mode in closure handling

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12760. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-12775) Couldn't find leader offsets exception when hostname can't be resolved

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12775. --- Resolution: Not A Problem > Couldn't find leader offsets exception when hostname can't be resolved >

[jira] [Updated] (SPARK-12760) inaccurate description for difference between local vs cluster mode in closure handling

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12760: -- Assignee: Mortada Mehyar > inaccurate description for difference between local vs cluster mode in > cl

[jira] [Updated] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-23 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12859: --- Fix Version/s: 2.0.0 1.6.1 > Names of input streams with receivers don't f

[jira] [Resolved] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-23 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-12859. Resolution: Fixed > Names of input streams with receivers don't fit in Streaming page > ---

[jira] [Updated] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-23 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12859: --- Assignee: Alex Bozarth > Names of input streams with receivers don't fit in Streaming page >

[jira] [Commented] (SPARK-12958) Map accumulator in spark

2016-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113665#comment-15113665 ] Sean Owen commented on SPARK-12958: --- Meaning, an accumulator that sums Long values for

[jira] [Comment Edited] (SPARK-12947) Spark with Swift throws EOFException when reading parquet file

2016-01-23 Thread Sam Stoelinga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113641#comment-15113641 ] Sam Stoelinga edited comment on SPARK-12947 at 1/23/16 9:16 AM: ---

[jira] [Commented] (SPARK-12626) MLlib 2.0 Roadmap

2016-01-23 Thread Ahmet AKYOL (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113656#comment-15113656 ] Ahmet AKYOL commented on SPARK-12626: - I don't know if you guys watched [SalesForce's

[jira] [Resolved] (SPARK-12933) Initial count-min sketch implementation

2016-01-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12933. - Resolution: Fixed Fix Version/s: 2.0.0 > Initial count-min sketch implementation > ---

[jira] [Commented] (SPARK-12947) Spark with Swift throws EOFException when reading parquet file

2016-01-23 Thread Sam Stoelinga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113641#comment-15113641 ] Sam Stoelinga commented on SPARK-12947: --- I'm using Ceph with Swift compatible front