[jira] [Assigned] (SPARK-10624) TakeOrderedAndProjectNode output is not ordered

[ https://issues.apache.org/jira/browse/SPARK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10624: Assignee: Andrew Or (was: Apache Spark) > TakeOrderedAndProjectNode output is not

[jira] [Resolved] (SPARK-4576) Add concatenation operator

[ https://issues.apache.org/jira/browse/SPARK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4576. --- Resolution: Won't Fix Going to resolve this as "Won't Fix" for now, since it seems like {{concat}}

[jira] [Commented] (SPARK-10624) TakeOrderedAndProjectNode output is not ordered

[ https://issues.apache.org/jira/browse/SPARK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746419#comment-14746419 ] Apache Spark commented on SPARK-10624: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Resolved] (SPARK-2337) String Interpolation for SparkSQL queries

[ https://issues.apache.org/jira/browse/SPARK-2337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2337. --- Resolution: Won't Fix Resolving as "Won't Fix" per PR discussion. > String Interpolation for

[jira] [Assigned] (SPARK-10624) TakeOrderedAndProjectNode output is not ordered

[ https://issues.apache.org/jira/browse/SPARK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10624: Assignee: Apache Spark (was: Andrew Or) > TakeOrderedAndProjectNode output is not

[jira] [Commented] (SPARK-10627) Regularization for artificial neural networks

[ https://issues.apache.org/jira/browse/SPARK-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746636#comment-14746636 ] Alexander Ulanov commented on SPARK-10627: -- Dropout WIP refactoring for the new ML API

[jira] [Updated] (SPARK-10584) Documentation about the compatible Hive version is wrong.

[ https://issues.apache.org/jira/browse/SPARK-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-10584: --- Description: In Spark 1.5.0, Spark SQL is compatible with Hive 0.12.0 through 1.2.1 but the

[jira] [Created] (SPARK-10629) Gradient boosted trees: mapPartitions input size increasing

Wenmin Wu created SPARK-10629: - Summary: Gradient boosted trees: mapPartitions input size increasing Key: SPARK-10629 URL: https://issues.apache.org/jira/browse/SPARK-10629 Project: Spark

[jira] [Created] (SPARK-10624) TakeOrderedAndProjectNode output is not ordered

Andrew Or created SPARK-10624: - Summary: TakeOrderedAndProjectNode output is not ordered Key: SPARK-10624 URL: https://issues.apache.org/jira/browse/SPARK-10624 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-6321) Adapt the number of partitions used by the Exchange rule to the cluster specifications

[ https://issues.apache.org/jira/browse/SPARK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6321. --- Resolution: Won't Fix I'm going to resolve this specific issue as "Won't Fix." While we do plan to do

[jira] [Commented] (SPARK-10300) Use tags to control which tests to run depending on changes being tested

[ https://issues.apache.org/jira/browse/SPARK-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746429#comment-14746429 ] Apache Spark commented on SPARK-10300: -- User 'vanzin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-5919) Enable broadcast joins for Parquet files

[ https://issues.apache.org/jira/browse/SPARK-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5919. --- Resolution: Fixed This is now supported; ParquetRelation now implements proper statistics support. >

[jira] [Commented] (SPARK-10508) incorrect evaluation of searched case expression

[ https://issues.apache.org/jira/browse/SPARK-10508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746515#comment-14746515 ] Josh Rosen commented on SPARK-10508: I managed to reproduce this on 1.3.1 as well, using the

[jira] [Resolved] (SPARK-10508) incorrect evaluation of searched case expression

[ https://issues.apache.org/jira/browse/SPARK-10508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10508. Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 > incorrect evaluation of

[jira] [Resolved] (SPARK-10613) Reduce LocalNode tests dependency on SQLContext

[ https://issues.apache.org/jira/browse/SPARK-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10613. --- Resolution: Fixed Fix Version/s: 1.6.0 > Reduce LocalNode tests dependency on SQLContext >

[jira] [Resolved] (SPARK-10624) TakeOrderedAndProjectNode output is not ordered

[ https://issues.apache.org/jira/browse/SPARK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10624. --- Resolution: Fixed Fix Version/s: 1.6.0 > TakeOrderedAndProjectNode output is not ordered >

[jira] [Commented] (SPARK-10577) [PySpark] DataFrame hint for broadcast join

[ https://issues.apache.org/jira/browse/SPARK-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746692#comment-14746692 ] Apache Spark commented on SPARK-10577: -- User 'Jianfeng-chs' has created a pull request for this

[jira] [Resolved] (SPARK-10595) Various ML programming guide cleanups post 1.5

[ https://issues.apache.org/jira/browse/SPARK-10595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10595. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8752

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746813#comment-14746813 ] Luvsandondov Lkhamsuren commented on SPARK-9963: Implementing

[jira] [Comment Edited] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746929#comment-14746929 ] Yi Zhou edited comment on SPARK-10474 at 9/16/15 5:55 AM: -- BTW, the

[jira] [Commented] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746929#comment-14746929 ] Yi Zhou commented on SPARK-10474: - BTW, the "spark.shuffle.safetyFraction" is not public .. >

[jira] [Commented] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746881#comment-14746881 ] Yi Zhou commented on SPARK-10474: - Thanks [~chenghao]. It's better not to throw such exception. >

[jira] [Updated] (SPARK-4684) Add a script to run JDBC server on Windows

[ https://issues.apache.org/jira/browse/SPARK-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4684: -- Component/s: Windows > Add a script to run JDBC server on Windows >

[jira] [Resolved] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7685. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 7884

[jira] [Updated] (SPARK-9642) LinearRegression should supported weighted data

[ https://issues.apache.org/jira/browse/SPARK-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-9642: --- Shepherd: DB Tsai > LinearRegression should supported weighted data >

[jira] [Resolved] (SPARK-10575) Wrap RDD.takeSample with scope

[ https://issues.apache.org/jira/browse/SPARK-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10575. --- Resolution: Fixed Fix Version/s: 1.6.0 > Wrap RDD.takeSample with scope >

[jira] [Resolved] (SPARK-8786) Create a wrapper for BinaryType

[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8786. --- Resolution: Fixed Fix Version/s: 1.5.0 This should have been fixed in 1.5.0. I believe that it

[jira] [Commented] (SPARK-8786) Create a wrapper for BinaryType

[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746588#comment-14746588 ] Josh Rosen commented on SPARK-8786: --- And to confirm, the case given above does work in 1.5. > Create a

[jira] [Created] (SPARK-10628) Add support for arbitrary RandomRDD generation to PySparkAPI

holdenk created SPARK-10628: --- Summary: Add support for arbitrary RandomRDD generation to PySparkAPI Key: SPARK-10628 URL: https://issues.apache.org/jira/browse/SPARK-10628 Project: Spark Issue

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746642#comment-14746642 ] Cheng Hao commented on SPARK-4226: -- Thank you [~brooks], you're right! I meant it will makes more

[jira] [Resolved] (SPARK-9033) scala.MatchError: interface java.util.Map (of class java.lang.Class) with Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9033. --- Resolution: Fixed Fix Version/s: 1.4.0 This should have been fixed for maps and arrays in

[jira] [Commented] (SPARK-6715) Eliminate duplicate filters from pushdown predicates

[ https://issues.apache.org/jira/browse/SPARK-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746442#comment-14746442 ] Josh Rosen commented on SPARK-6715: --- Per discussion on the PR, I believe that this is "Won't Fix" for

[jira] [Resolved] (SPARK-10460) fieldIndex method missing on spark.sql.Row

[ https://issues.apache.org/jira/browse/SPARK-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10460. Resolution: Cannot Reproduce Row definitely has a fieldIndex method as of 1.4.1

[jira] [Resolved] (SPARK-10548) Concurrent execution in SQL does not work

[ https://issues.apache.org/jira/browse/SPARK-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10548. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > Concurrent execution in SQL

[jira] [Commented] (SPARK-10563) SparkContext's local properties should be cloned when inherited

[ https://issues.apache.org/jira/browse/SPARK-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746512#comment-14746512 ] Andrew Or commented on SPARK-10563: --- NOTE: there's a subtle difference in behavior between branch-1.6

[jira] [Commented] (SPARK-10504) aggregate where NULL is defined as the value expression aborts when SUM used

[ https://issues.apache.org/jira/browse/SPARK-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746524#comment-14746524 ] Josh Rosen commented on SPARK-10504: [~marmbrus], I just checked and this is fixed in 1.5 but still

[jira] [Updated] (SPARK-10504) aggregate where NULL is defined as the value expression aborts when SUM used

[ https://issues.apache.org/jira/browse/SPARK-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10504: --- Affects Version/s: 1.4.1 > aggregate where NULL is defined as the value expression aborts when SUM

[jira] [Updated] (SPARK-8673) Launcher: add support for monitoring launched applications

[ https://issues.apache.org/jira/browse/SPARK-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8673: - Assignee: Marcelo Vanzin > Launcher: add support for monitoring launched applications >

[jira] [Updated] (SPARK-10629) Gradient boosted trees: mapPartitions input size increasing

[ https://issues.apache.org/jira/browse/SPARK-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenmin Wu updated SPARK-10629: -- Description: First of all, I think my problem is quite different from

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746450#comment-14746450 ] Peng Cheng commented on SPARK-10625: branch: https://github.com/Schedule1/spark/tree/SPARK-10625 will

[jira] [Updated] (SPARK-9642) LinearRegression should supported weighted data

[ https://issues.apache.org/jira/browse/SPARK-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-9642: --- Assignee: Meihua Wu > LinearRegression should supported weighted data >

[jira] [Updated] (SPARK-10503) incorrect predicate evaluation involving NULL value

[ https://issues.apache.org/jira/browse/SPARK-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10503: --- Description: Query an ORC table in Hive using the following SQL statement via the SPARKSQL

[jira] [Resolved] (SPARK-10381) Infinite loop when OutputCommitCoordination is enabled and OutputCommitter.commitTask throws exception

[ https://issues.apache.org/jira/browse/SPARK-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10381. Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 Issue resolved by pull

[jira] [Resolved] (SPARK-7192) Pyspark casts hive bigint to int

[ https://issues.apache.org/jira/browse/SPARK-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7192. --- Resolution: Not A Problem I'm resolving as "Not a Problem." Please comment / re-open if you can

[jira] [Updated] (SPARK-10584) Documentation about the compatible Hive version is wrong.

[ https://issues.apache.org/jira/browse/SPARK-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-10584: --- Summary: Documentation about the compatible Hive version is wrong. (was: Documentation

[jira] [Updated] (SPARK-10629) Gradient boosted trees: mapPartitions input size increasing

[ https://issues.apache.org/jira/browse/SPARK-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenmin Wu updated SPARK-10629: -- Description: First of all, I think my problem is quite different from

[jira] [Updated] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9078: --- Assignee: Suresh Thalamati > Use of non-standard LIMIT keyword in JDBC tableExists code >

[jira] [Updated] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9078: Assignee: Suresh Thalamati > Use of non-standard LIMIT keyword in JDBC tableExists code >

[jira] [Updated] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9078: Assignee: (was: Suresh Thalamati) > Use of non-standard LIMIT keyword in JDBC tableExists code >

[jira] [Resolved] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9078. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8676

[jira] [Resolved] (SPARK-6102) Create a SparkSQL DataSource API implementation for Redshift

[ https://issues.apache.org/jira/browse/SPARK-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6102. --- Resolution: Done The spark-redshift library did this: https://github.com/databricks/spark-redshift

[jira] [Commented] (SPARK-10584) Documentation about the compatible Hive version is wrong.

[ https://issues.apache.org/jira/browse/SPARK-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746660#comment-14746660 ] Apache Spark commented on SPARK-10584: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-4450) SparkSQL producing incorrect answer when using --master yarn

[ https://issues.apache.org/jira/browse/SPARK-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4450: -- Description: A simple summary program using spark-submit --master local MyJob.py vs. spark-submit

[jira] [Resolved] (SPARK-4450) SparkSQL producing incorrect answer when using --master yarn

[ https://issues.apache.org/jira/browse/SPARK-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4450. --- Resolution: Cannot Reproduce Resolving as "Cannot Reproduce" since this is targeted against an old

[jira] [Created] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

Peng Cheng created SPARK-10625: -- Summary: Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties Key: SPARK-10625 URL:

[jira] [Resolved] (SPARK-10563) SparkContext's local properties should be cloned when inherited

[ https://issues.apache.org/jira/browse/SPARK-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10563. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > SparkContext's local

[jira] [Created] (SPARK-10627) Regularization for artificial neural networks

Alexander Ulanov created SPARK-10627: Summary: Regularization for artificial neural networks Key: SPARK-10627 URL: https://issues.apache.org/jira/browse/SPARK-10627 Project: Spark Issue

[jira] [Updated] (SPARK-10629) Gradient boosted trees: mapPartitions input size increasing

[ https://issues.apache.org/jira/browse/SPARK-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenmin Wu updated SPARK-10629: -- Description: First of all, I think my problem is quite different from

[jira] [Resolved] (SPARK-5624) Can't find new column

[ https://issues.apache.org/jira/browse/SPARK-5624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5624. --- Resolution: Fixed Resolving as "Fixed" per claim that this works in a newer release. > Can't find

[jira] [Updated] (SPARK-10538) java.lang.NegativeArraySizeException during join

[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10538: --- Target Version/s: 1.5.1 > java.lang.NegativeArraySizeException during join >

[jira] [Updated] (SPARK-10508) incorrect evaluation of searched case expression

[ https://issues.apache.org/jira/browse/SPARK-10508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10508: --- Description: The following case expression never evaluates to 'test1' when cdec is -1 or 10 as it

[jira] [Resolved] (SPARK-10612) Add prepare to LocalNode

[ https://issues.apache.org/jira/browse/SPARK-10612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10612. --- Resolution: Fixed Fix Version/s: 1.6.0 > Add prepare to LocalNode >

[jira] [Created] (SPARK-10626) Create a Java friendly method for randomRDD & RandomDataGenerator on RandomRDDs.

holdenk created SPARK-10626: --- Summary: Create a Java friendly method for randomRDD & RandomDataGenerator on RandomRDDs. Key: SPARK-10626 URL: https://issues.apache.org/jira/browse/SPARK-10626 Project:

[jira] [Resolved] (SPARK-5236) java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.MutableAny cannot be cast to org.apache.spark.sql.catalyst.expressions.MutableInt

[ https://issues.apache.org/jira/browse/SPARK-5236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5236. - Resolution: Cannot Reproduce Closing as cannot reproduce, please reopen if you can. >

[jira] [Resolved] (SPARK-5194) ADD JAR doesn't update classpath until reconnect

[ https://issues.apache.org/jira/browse/SPARK-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5194. - Resolution: Cannot Reproduce Closing as cannot reproduce. Please reopen if you can on

[jira] [Resolved] (SPARK-5305) Using a field in a WHERE clause that is not in the schema does not throw an exception.

[ https://issues.apache.org/jira/browse/SPARK-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5305. - Resolution: Cannot Reproduce Marking as cannot reproduce, please reopen if you can. >

[jira] [Commented] (SPARK-5391) SparkSQL fails to create tables with custom JSON SerDe

[ https://issues.apache.org/jira/browse/SPARK-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746320#comment-14746320 ] David Ross commented on SPARK-5391: --- Haven't tried native JSON but looks promising, so this ticket is

[jira] [Commented] (SPARK-8152) Dataframe Join Ignores Condition

[ https://issues.apache.org/jira/browse/SPARK-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746337#comment-14746337 ] Eric Doi commented on SPARK-8152: - Thanks. Will reopen if I'm able to reproduce in a clearer way. >

[jira] [Closed] (SPARK-2789) Apply names to RDD to becoming SchemaRDD

[ https://issues.apache.org/jira/browse/SPARK-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen closed SPARK-2789. - Resolution: Won't Fix > Apply names to RDD to becoming SchemaRDD >

[jira] [Resolved] (SPARK-6632) Optimize the parquetSchema to metastore schema reconciliation, so that the process is delegated to each map task itself

[ https://issues.apache.org/jira/browse/SPARK-6632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6632. - Resolution: Fixed Fix Version/s: 1.5.0 Starting with Spark 1.5 I believe all

[jira] [Resolved] (SPARK-9188) make open hash set/table APIs public

[ https://issues.apache.org/jira/browse/SPARK-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9188. --- Resolution: Won't Fix This has been proposed previously. I'm closing this issue as "Won't Fix"

[jira] [Updated] (SPARK-9032) scala.MatchError in DataFrameReader.json(String path)

[ https://issues.apache.org/jira/browse/SPARK-9032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9032: -- Description: Executing read().json() of SQLContext e.g. DataFrameReader raises a MatchError with a

[jira] [Resolved] (SPARK-9032) scala.MatchError in DataFrameReader.json(String path)

[ https://issues.apache.org/jira/browse/SPARK-9032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9032. --- Resolution: Fixed Fix Version/s: 1.4.1 Just confirmed that this is fixed in 1.4.1. >

[jira] [Commented] (SPARK-6513) Add zipWithUniqueId (and other RDD APIs) to RDDApi

[ https://issues.apache.org/jira/browse/SPARK-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746365#comment-14746365 ] Josh Rosen commented on SPARK-6513: --- [~marmbrus], safe to say that this is "Won't Fix" given the RDDApi

[jira] [Updated] (SPARK-6942) Umbrella: UI Visualizations for Core and Dataframes

[ https://issues.apache.org/jira/browse/SPARK-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6942: --- Assignee: Andrew Or (was: Patrick Wendell) > Umbrella: UI Visualizations for Core and

[jira] [Resolved] (SPARK-7175) Upgrade Hive to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7175. --- Resolution: Duplicate We added support for connecting to Hive 1.1 in SPARK-8067 > Upgrade Hive to

[jira] [Updated] (SPARK-9033) scala.MatchError: interface java.util.Map (of class java.lang.Class) with Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9033: -- Description: I've a java.util.Map field in a POJO class and I'm trying to use it to

[jira] [Created] (SPARK-10609) Improve task distribution strategy in taskSetManager

Zhang, Liye created SPARK-10609: --- Summary: Improve task distribution strategy in taskSetManager Key: SPARK-10609 URL: https://issues.apache.org/jira/browse/SPARK-10609 Project: Spark Issue

[jira] [Created] (SPARK-10610) Using AppName instead AppId in the name of all metrics

Yi Tian created SPARK-10610: --- Summary: Using AppName instead AppId in the name of all metrics Key: SPARK-10610 URL: https://issues.apache.org/jira/browse/SPARK-10610 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-10466) UnsafeRow exception in Sort-Based Shuffle with data spill

[ https://issues.apache.org/jira/browse/SPARK-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744929#comment-14744929 ] Nalia Tang commented on SPARK-10466: 不知道这里适不适合提问。。也不知道中文是否恰当。。 在我使用decode 的时候 程序总是报：

[jira] [Commented] (SPARK-10590) Spark with YARN build is broken

[ https://issues.apache.org/jira/browse/SPARK-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744927#comment-14744927 ] Kevin Tsai commented on SPARK-10590: Hi Sean, Reynold, Thanks, It's my bad. This PR solved this

[jira] [Updated] (SPARK-10611) Configuration object thread safety issue in NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-10611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingyu Kim updated SPARK-10611: --- Attachment: Screen Shot 2015-09-09 at 12.58.13 PM.png > Configuration object thread safety issue in

[jira] [Created] (SPARK-10611) Configuration object thread safety issue in NewHadoopRDD

Mingyu Kim created SPARK-10611: -- Summary: Configuration object thread safety issue in NewHadoopRDD Key: SPARK-10611 URL: https://issues.apache.org/jira/browse/SPARK-10611 Project: Spark Issue

[jira] [Updated] (SPARK-10611) Configuration object thread safety issue in NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-10611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingyu Kim updated SPARK-10611: --- Attachment: (was: Screen Shot 2015-09-09 at 12.58.13 PM.png) > Configuration object thread

[jira] [Created] (SPARK-10612) Add prepare to LocalNode

Reynold Xin created SPARK-10612: --- Summary: Add prepare to LocalNode Key: SPARK-10612 URL: https://issues.apache.org/jira/browse/SPARK-10612 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-10608) turn off reduce tasks locality as default to avoid bad cases

Zhang, Liye created SPARK-10608: --- Summary: turn off reduce tasks locality as default to avoid bad cases Key: SPARK-10608 URL: https://issues.apache.org/jira/browse/SPARK-10608 Project: Spark

[jira] [Commented] (SPARK-10590) Spark with YARN build is broken

[ https://issues.apache.org/jira/browse/SPARK-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744931#comment-14744931 ] Reynold Xin commented on SPARK-10590: - Ok glad it worked! > Spark with YARN build is broken >

[jira] [Commented] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744969#comment-14744969 ] Cheng Hao commented on SPARK-10474: --- The root causes for the exception is the executor don't have

[jira] [Commented] (SPARK-10466) UnsafeRow exception in Sort-Based Shuffle with data spill

[ https://issues.apache.org/jira/browse/SPARK-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744966#comment-14744966 ] Cheng Hao commented on SPARK-10466: --- [~naliazheli] It's an irrelevant issue, you'd better to subscribe

[jira] [Updated] (SPARK-10611) Configuration object thread safety issue in NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-10611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingyu Kim updated SPARK-10611: --- Attachment: Screen Shot 2015-09-15 at 12.20.38 AM.png > Configuration object thread safety issue in

[jira] [Commented] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14745008#comment-14745008 ] Cheng Hao commented on SPARK-10474: --- But from the current implementation, we'd better not to throw

[jira] [Resolved] (SPARK-10598) RoutingTablePartition toMessage method refers to bytes instead of bits

[ https://issues.apache.org/jira/browse/SPARK-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10598. - Resolution: Fixed Fix Version/s: 1.6.0 > RoutingTablePartition toMessage method refers to

[jira] [Assigned] (SPARK-8426) Add blacklist mechanism for YARN container allocation

[ https://issues.apache.org/jira/browse/SPARK-8426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8426: --- Assignee: Apache Spark > Add blacklist mechanism for YARN container allocation >

[jira] [Assigned] (SPARK-8426) Add blacklist mechanism for YARN container allocation

[ https://issues.apache.org/jira/browse/SPARK-8426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8426: --- Assignee: (was: Apache Spark) > Add blacklist mechanism for YARN container allocation >

[jira] [Commented] (SPARK-8426) Add blacklist mechanism for YARN container allocation

[ https://issues.apache.org/jira/browse/SPARK-8426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744952#comment-14744952 ] Apache Spark commented on SPARK-8426: - User 'mwws' has created a pull request for this issue:

[jira] [Commented] (SPARK-10466) UnsafeRow exception in Sort-Based Shuffle with data spill

[ https://issues.apache.org/jira/browse/SPARK-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744967#comment-14744967 ] Cheng Hao commented on SPARK-10466: --- [~naliazheli] It's an irrelevant issue, you'd better to subscribe

[jira] [Issue Comment Deleted] (SPARK-10466) UnsafeRow exception in Sort-Based Shuffle with data spill

[ https://issues.apache.org/jira/browse/SPARK-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-10466: -- Comment: was deleted (was: [~naliazheli] It's an irrelevant issue, you'd better to subscribe the

[jira] [Assigned] (SPARK-10612) Add prepare to LocalNode

[ https://issues.apache.org/jira/browse/SPARK-10612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10612: Assignee: Apache Spark (was: Reynold Xin) > Add prepare to LocalNode >

[jira] [Commented] (SPARK-10612) Add prepare to LocalNode

[ https://issues.apache.org/jira/browse/SPARK-10612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14745015#comment-14745015 ] Apache Spark commented on SPARK-10612: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10612) Add prepare to LocalNode

[ https://issues.apache.org/jira/browse/SPARK-10612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10612: Assignee: Reynold Xin (was: Apache Spark) > Add prepare to LocalNode >

  1   2   3   >