[jira] [Commented] (SPARK-13634) Assigning spark context to variable results in serialization error

2016-03-07 Thread Chris A. Mattmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184597#comment-15184597 ] Chris A. Mattmann commented on SPARK-13634: --- Sean, thanks for your reply. We can agree to

[jira] [Updated] (SPARK-13734) SparkR histogram

2016-03-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13734: -- Priority: Minor (was: Major) [~olarayej] this isn't sufficient for a JIRA. Please fill out title and

[jira] [Commented] (SPARK-13736) Big-Endian plataform issues

2016-03-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184583#comment-15184583 ] Sean Owen commented on SPARK-13736: --- Let's not make an umbrella, since it doesn't cover much, and

[jira] [Commented] (SPARK-13634) Assigning spark context to variable results in serialization error

2016-03-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184563#comment-15184563 ] Sean Owen commented on SPARK-13634: --- JIRAs can be reopened, and should be if there's a change, like:

[jira] [Commented] (SPARK-13634) Assigning spark context to variable results in serialization error

2016-03-07 Thread Chris A. Mattmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184536#comment-15184536 ] Chris A. Mattmann commented on SPARK-13634: --- I'm CC'ed b/c I'm the PI of the SciSpark project

[jira] [Commented] (SPARK-13740) add null check for _verify_type in types.py

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184532#comment-15184532 ] Apache Spark commented on SPARK-13740: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13740) add null check for _verify_type in types.py

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13740: Assignee: (was: Apache Spark) > add null check for _verify_type in types.py >

[jira] [Assigned] (SPARK-13740) add null check for _verify_type in types.py

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13740: Assignee: Apache Spark > add null check for _verify_type in types.py >

[jira] [Created] (SPARK-13740) add null check for _verify_type in types.py

2016-03-07 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-13740: --- Summary: add null check for _verify_type in types.py Key: SPARK-13740 URL: https://issues.apache.org/jira/browse/SPARK-13740 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13231) Make Accumulable.countFailedValues a user facing API.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-13231: Description: Exposing it to user has no disadvantage I can think of, but it can be useful

[jira] [Commented] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184510#comment-15184510 ] Prashant Sharma commented on SPARK-3200: Yes, the issue SPARK-13634 is actually a duplicate. I

[jira] [Commented] (SPARK-13634) Assigning spark context to variable results in serialization error

2016-03-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184505#comment-15184505 ] Sean Owen commented on SPARK-13634: --- Chris, I resolved this as a duplicate, of an issue that's

[jira] [Commented] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

2016-03-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184506#comment-15184506 ] Josh Rosen commented on SPARK-5581: --- [~sitalke...@gmail.com], I'm not working on this right now so feel

[jira] [Commented] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

2016-03-07 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184491#comment-15184491 ] Sital Kedia commented on SPARK-5581: Is anyone working on this issue? I would like to work on it, if

[jira] [Commented] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Chris A. Mattmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184486#comment-15184486 ] Chris A. Mattmann commented on SPARK-3200: -- Hi [~prashant_] thanks for your reply. If you look at

[jira] [Comment Edited] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184468#comment-15184468 ] Prashant Sharma edited comment on SPARK-3200 at 3/8/16 6:06 AM: Hi

[jira] [Closed] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma closed SPARK-3200. -- Resolution: Won't Fix > Class defined with reference to external variables crashes in REPL. >

[jira] [Reopened] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reopened SPARK-3200: I am reopening only to close it again with Won't Fix. > Class defined with reference to

[jira] [Commented] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184468#comment-15184468 ] Prashant Sharma commented on SPARK-3200: Hi [~chrismattmann], It never worked. I have clarified

[jira] [Resolved] (SPARK-13659) Remove returnValues from BlockStore APIs

2016-03-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13659. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove returnValues from BlockStore APIs >

[jira] [Commented] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Chris A. Mattmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1518#comment-1518 ] Chris A. Mattmann commented on SPARK-3200: -- how did this get resolved other than simply saying in

[jira] [Updated] (SPARK-13231) Make Accumulable.countFailedValues a user facing API.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-13231: Summary: Make Accumulable.countFailedValues a user facing API. (was: Rename

[jira] [Resolved] (SPARK-13711) Apache Spark driver stopping JVM when master not available

2016-03-07 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13711. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-13139) Create native DDL commands

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184402#comment-15184402 ] Apache Spark commented on SPARK-13139: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-03-07 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184387#comment-15184387 ] Cody Koeninger commented on SPARK-12177: I've been hacking on a simple lru cache for consumers

[jira] [Updated] (SPARK-13593) improve the `createDataFrame` method to accept data type string and verify the data

2016-03-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-13593: Summary: improve the `createDataFrame` method to accept data type string and verify the data

[jira] [Resolved] (SPARK-13404) Create the variables for input when it's used

2016-03-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13404. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11274

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-03-07 Thread Mansi Shah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184346#comment-15184346 ] Mansi Shah commented on SPARK-12177: So looks like we are dealing with two independent issues here -

[jira] [Closed] (SPARK-13737) Add getOrCreate method for HiveContext

2016-03-07 Thread Mao, Wei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mao, Wei closed SPARK-13737. Resolution: Won't Fix > Add getOrCreate method for HiveContext > -- >

[jira] [Commented] (SPARK-13737) Add getOrCreate method for HiveContext

2016-03-07 Thread Mao, Wei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184263#comment-15184263 ] Mao, Wei commented on SPARK-13737: -- According to Reynold, databricks is actually going to deprecate

[jira] [Comment Edited] (SPARK-13731) expression evaluation for NaN in select statement

2016-03-07 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184034#comment-15184034 ] Ian edited comment on SPARK-13731 at 3/8/16 2:35 AM: - The test case we provided is

[jira] [Comment Edited] (SPARK-13731) expression evaluation for NaN in select statement

2016-03-07 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184034#comment-15184034 ] Ian edited comment on SPARK-13731 at 3/8/16 2:35 AM: - The test case we provided is

[jira] [Updated] (SPARK-13739) Predicate Push Down For Window Operator

2016-03-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13739: Description: Push down the predicate through the Window operator. > Predicate Push Down For Window

[jira] [Assigned] (SPARK-13738) Clean up ResolveDataSource

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13738: Assignee: Apache Spark (was: Michael Armbrust) > Clean up ResolveDataSource >

[jira] [Commented] (SPARK-13738) Clean up ResolveDataSource

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184244#comment-15184244 ] Apache Spark commented on SPARK-13738: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Updated] (SPARK-13739) Predicate Push Down Through Window Operator

2016-03-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13739: Summary: Predicate Push Down Through Window Operator (was: Predicate Push Down For Window Operator) >

[jira] [Assigned] (SPARK-13738) Clean up ResolveDataSource

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13738: Assignee: Michael Armbrust (was: Apache Spark) > Clean up ResolveDataSource >

[jira] [Commented] (SPARK-13739) Predicate Push Down Through Window Operator

2016-03-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184245#comment-15184245 ] Xiao Li commented on SPARK-13739: - Thanks! I am working on it. > Predicate Push Down Through Window

[jira] [Created] (SPARK-13739) Predicate Push Down For Window Operator

2016-03-07 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13739: --- Summary: Predicate Push Down For Window Operator Key: SPARK-13739 URL: https://issues.apache.org/jira/browse/SPARK-13739 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-13664) Simplify and Speedup HadoopFSRelation

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13664: Assignee: Michael Armbrust (was: Apache Spark) > Simplify and Speedup HadoopFSRelation >

[jira] [Commented] (SPARK-13664) Simplify and Speedup HadoopFSRelation

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184238#comment-15184238 ] Apache Spark commented on SPARK-13664: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13664) Simplify and Speedup HadoopFSRelation

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13664: Assignee: Apache Spark (was: Michael Armbrust) > Simplify and Speedup HadoopFSRelation >

[jira] [Created] (SPARK-13738) Clean up ResolveDataSource

2016-03-07 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-13738: Summary: Clean up ResolveDataSource Key: SPARK-13738 URL: https://issues.apache.org/jira/browse/SPARK-13738 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-13737) Add getOrCreate method for HiveContext

2016-03-07 Thread Mao, Wei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184221#comment-15184221 ] Mao, Wei commented on SPARK-13737: -- HiveContext is heavily used by many users now, and enen many of them

[jira] [Comment Edited] (SPARK-13737) Add getOrCreate method for HiveContext

2016-03-07 Thread Mao, Wei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184221#comment-15184221 ] Mao, Wei edited comment on SPARK-13737 at 3/8/16 2:07 AM: -- HiveContext is

[jira] [Commented] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

2016-03-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184213#comment-15184213 ] Xiao Li commented on SPARK-13721: - That sounds reasonable. Maybe we can wait until DataFrame and DataSet

[jira] [Resolved] (SPARK-13689) Move some methods in CatalystQl to a util object

2016-03-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13689. --- Resolution: Fixed Fix Version/s: 2.0.0 > Move some methods in CatalystQl to a util object >

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-03-07 Thread Mike Sukmanowsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184210#comment-15184210 ] Mike Sukmanowsky commented on SPARK-13587: -- [~juliet] I get the concerns relating to Spark

[jira] [Assigned] (SPARK-13737) Add getOrCreate method for HiveContext

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13737: Assignee: (was: Apache Spark) > Add getOrCreate method for HiveContext >

[jira] [Commented] (SPARK-13737) Add getOrCreate method for HiveContext

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184209#comment-15184209 ] Apache Spark commented on SPARK-13737: -- User 'mwws' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13737) Add getOrCreate method for HiveContext

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13737: Assignee: Apache Spark > Add getOrCreate method for HiveContext >

[jira] [Commented] (SPARK-13737) Add getOrCreate method for HiveContext

2016-03-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184208#comment-15184208 ] Xiao Li commented on SPARK-13737: - I think SQLContext and HiveContext is being combined. Not sure we

[jira] [Commented] (SPARK-529) Have a single file that controls the environmental variables and spark config options

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184206#comment-15184206 ] Apache Spark commented on SPARK-529: User 'vanzin' has created a pull request for this issue:

[jira] [Created] (SPARK-13737) Add getOrCreate method for HiveContext

2016-03-07 Thread Mao, Wei (JIRA)
Mao, Wei created SPARK-13737: Summary: Add getOrCreate method for HiveContext Key: SPARK-13737 URL: https://issues.apache.org/jira/browse/SPARK-13737 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-13723) YARN - Change behavior of --num-executors when spark.dynamicAllocation.enabled true

2016-03-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184177#comment-15184177 ] Saisai Shao commented on SPARK-13723: - Yes, I agree with what [~tgraves] described above. Normally

[jira] [Updated] (SPARK-12555) Datasets: data is corrupted when input data is reordered

2016-03-07 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende updated SPARK-12555: Issue Type: Sub-task (was: Bug) Parent: SPARK-13736 > Datasets: data is corrupted

[jira] [Updated] (SPARK-12319) ExchangeCoordinatorSuite fails on big-endian platforms

2016-03-07 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende updated SPARK-12319: Issue Type: Sub-task (was: Bug) Parent: SPARK-13736 > ExchangeCoordinatorSuite

[jira] [Created] (SPARK-13736) Big-Endian plataform issues

2016-03-07 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-13736: --- Summary: Big-Endian plataform issues Key: SPARK-13736 URL: https://issues.apache.org/jira/browse/SPARK-13736 Project: Spark Issue Type: Epic

[jira] [Commented] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

2016-03-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184110#comment-15184110 ] Takeshi Yamamuro commented on SPARK-13656: -- Okay, I'll make a pr in a day. > Delete

[jira] [Assigned] (SPARK-13734) SparkR histogram

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13734: Assignee: (was: Apache Spark) > SparkR histogram > > >

[jira] [Assigned] (SPARK-13734) SparkR histogram

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13734: Assignee: Apache Spark > SparkR histogram > > > Key:

[jira] [Commented] (SPARK-13734) SparkR histogram

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184106#comment-15184106 ] Apache Spark commented on SPARK-13734: -- User 'olarayej' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13418) SQL generation for uncorrelated scalar subqueries

2016-03-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13418. -- Resolution: Duplicate Fix Version/s: 2.0.0 > SQL generation for uncorrelated scalar subqueries

[jira] [Commented] (SPARK-13727) SparkConf.contains does not consider deprecated keys

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184095#comment-15184095 ] Apache Spark commented on SPARK-13727: -- User 'bomeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13727) SparkConf.contains does not consider deprecated keys

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13727: Assignee: (was: Apache Spark) > SparkConf.contains does not consider deprecated keys

[jira] [Assigned] (SPARK-13727) SparkConf.contains does not consider deprecated keys

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13727: Assignee: Apache Spark > SparkConf.contains does not consider deprecated keys >

[jira] [Created] (SPARK-13735) Log for parquet relation reading files is too verbose

2016-03-07 Thread Zhong Wang (JIRA)
Zhong Wang created SPARK-13735: -- Summary: Log for parquet relation reading files is too verbose Key: SPARK-13735 URL: https://issues.apache.org/jira/browse/SPARK-13735 Project: Spark Issue

[jira] [Closed] (SPARK-6666) org.apache.spark.sql.jdbc.JDBCRDD does not escape/quote column names

2016-03-07 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende closed SPARK-. -- Resolution: Cannot Reproduce I have tried the scenarios above in Spark trunk using both

[jira] [Commented] (SPARK-13726) Spark 1.6.0 stopping working for HiveThriftServer2 and registerTempTable

2016-03-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184077#comment-15184077 ] Yin Huai commented on SPARK-13726: -- I think that after setting that conf to true, the behavior should be

[jira] [Commented] (SPARK-10548) Concurrent execution in SQL does not work

2016-03-07 Thread nicerobot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184075#comment-15184075 ] nicerobot commented on SPARK-10548: --- Thanks [~zsxwing]. What's the recommended way to accomplish that?

[jira] [Updated] (SPARK-13734) SparkR histogram

2016-03-07 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oscar D. Lara Yejas updated SPARK-13734: Summary: SparkR histogram (was: Histogram) > SparkR histogram >

[jira] [Commented] (SPARK-13726) Spark 1.6.0 stopping working for HiveThriftServer2 and registerTempTable

2016-03-07 Thread Michael Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184062#comment-15184062 ] Michael Nguyen commented on SPARK-13726: That works. Thanks, Yin, for the work-around solution.

[jira] [Created] (SPARK-13734) Histogram

2016-03-07 Thread Oscar D. Lara Yejas (JIRA)
Oscar D. Lara Yejas created SPARK-13734: --- Summary: Histogram Key: SPARK-13734 URL: https://issues.apache.org/jira/browse/SPARK-13734 Project: Spark Issue Type: New Feature

[jira] [Comment Edited] (SPARK-13731) expression evaluation for NaN in select statement

2016-03-07 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183869#comment-15183869 ] Ian edited comment on SPARK-13731 at 3/8/16 12:04 AM: -- The expression in select

[jira] [Commented] (SPARK-13734) Histogram

2016-03-07 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184057#comment-15184057 ] Oscar D. Lara Yejas commented on SPARK-13734: - I'm working on this one. > Histogram >

[jira] [Updated] (SPARK-13731) expression evaluation for NaN in select statement

2016-03-07 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-13731: Description: We are expecting that arithmetic expression a/b should be: 1. returning NaN if a=0 and b=0 2.

[jira] [Resolved] (SPARK-13648) org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError on IBM JDK

2016-03-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13648. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Updated] (SPARK-13648) org.apache.spark.sql.hive.client.VersionsSuite fails NoClassDefFoundError on IBM JDK

2016-03-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13648: - Fix Version/s: (was: 1.6.1) 1.6.2 >

[jira] [Commented] (SPARK-12458) Add ExpressionDescription to datetime functions

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184038#comment-15184038 ] Apache Spark commented on SPARK-12458: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-12458) Add ExpressionDescription to datetime functions

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12458: Assignee: Apache Spark > Add ExpressionDescription to datetime functions >

[jira] [Assigned] (SPARK-12458) Add ExpressionDescription to datetime functions

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12458: Assignee: (was: Apache Spark) > Add ExpressionDescription to datetime functions >

[jira] [Comment Edited] (SPARK-13731) expression evaluation for NaN in select statement

2016-03-07 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184034#comment-15184034 ] Ian edited comment on SPARK-13731 at 3/7/16 11:41 PM: -- The test case we provided is

[jira] [Commented] (SPARK-13731) expression evaluation for NaN in select statement

2016-03-07 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184034#comment-15184034 ] Ian commented on SPARK-13731: - The test case we provided is using simple arithmetic expression like divisions

[jira] [Assigned] (SPARK-13711) Apache Spark driver stopping JVM when master not available

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13711: Assignee: (was: Apache Spark) > Apache Spark driver stopping JVM when master not

[jira] [Assigned] (SPARK-13711) Apache Spark driver stopping JVM when master not available

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13711: Assignee: Apache Spark > Apache Spark driver stopping JVM when master not available >

[jira] [Commented] (SPARK-13711) Apache Spark driver stopping JVM when master not available

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184016#comment-15184016 ] Apache Spark commented on SPARK-13711: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-07 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183996#comment-15183996 ] Suresh Thalamati commented on SPARK-13699: -- Thank you for providing the reproduction to the

[jira] [Comment Edited] (SPARK-13726) Spark 1.6.0 stopping working for HiveThriftServer2 and registerTempTable

2016-03-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183991#comment-15183991 ] Yin Huai edited comment on SPARK-13726 at 3/7/16 11:21 PM: --- I took a look at

[jira] [Commented] (SPARK-13726) Spark 1.6.0 stopping working for HiveThriftServer2 and registerTempTable

2016-03-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183991#comment-15183991 ] Yin Huai commented on SPARK-13726: -- I took a look at the code. I think this change is caused by Session

[jira] [Updated] (SPARK-13731) expression evaluation for NaN in select statement

2016-03-07 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-13731: Description: We are expecting that arithmetic expression a/b should be: 1. returning NaN if a=0 and b=0 2.

[jira] [Resolved] (SPARK-13665) Initial separation of concerns

2016-03-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13665. - Resolution: Fixed Fix Version/s: 2.0.0 > Initial separation of concerns >

[jira] [Commented] (SPARK-13725) Spark 1.6.0 stopping working for HiveThriftServer2 and registerTempTable

2016-03-07 Thread Michael Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183964#comment-15183964 ] Michael Nguyen commented on SPARK-13725: I typically do not set issues to Blocker. I set this

[jira] [Created] (SPARK-13733) Support initial weight distribution in personalized PageRank

2016-03-07 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-13733: - Summary: Support initial weight distribution in personalized PageRank Key: SPARK-13733 URL: https://issues.apache.org/jira/browse/SPARK-13733 Project: Spark

[jira] [Commented] (SPARK-13726) Spark 1.6.0 stopping working for HiveThriftServer2 and registerTempTable

2016-03-07 Thread Michael Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183953#comment-15183953 ] Michael Nguyen commented on SPARK-13726: Thrift server was started with

[jira] [Commented] (SPARK-13682) Finalize the public API for FileFormat

2016-03-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183949#comment-15183949 ] Reynold Xin commented on SPARK-13682: - Most "trait" should probably become "abstract class". >

[jira] [Resolved] (SPARK-13596) Move misc top-level build files into appropriate subdirs

2016-03-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13596. - Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 > Move misc top-level

[jira] [Updated] (SPARK-13692) Fix trivial Coverity/Checkstyle defects

2016-03-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13692: -- Description: This issue fixes the following potential bugs and Java coding style detected by

[jira] [Updated] (SPARK-13638) Support for saving with a quote mode

2016-03-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-13638: - Description: https://github.com/databricks/spark-csv/pull/254 tobithiel reported this. {quote}

[jira] [Assigned] (SPARK-13732) Remove projectList from Windows

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13732: Assignee: Apache Spark > Remove projectList from Windows >

[jira] [Assigned] (SPARK-13732) Remove projectList from Windows

2016-03-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13732: Assignee: (was: Apache Spark) > Remove projectList from Windows >

  1   2   3   >