[jira] [Updated] (SPARK-13866) Handle decimal type in CSV inference

2016-05-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13866: --- Assignee: Hyukjin Kwon > Handle decimal type in CSV inference >

[jira] [Resolved] (SPARK-13866) Handle decimal type in CSV inference

2016-05-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13866. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11724

[jira] [Resolved] (SPARK-14541) SQL function: IFNULL, NULLIF, NVL and NVL2

2016-05-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14541. -- Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 2.0.0 This issue has been

[jira] [Commented] (SPARK-15311) Disallow DML on Non-temporary Tables when Using In-Memory Catalog

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282400#comment-15282400 ] Apache Spark commented on SPARK-15311: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15311) Disallow DML on Non-temporary Tables when Using In-Memory Catalog

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15311: Assignee: (was: Apache Spark) > Disallow DML on Non-temporary Tables when Using

[jira] [Assigned] (SPARK-15311) Disallow DML on Non-temporary Tables when Using In-Memory Catalog

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15311: Assignee: Apache Spark > Disallow DML on Non-temporary Tables when Using In-Memory

[jira] [Updated] (SPARK-15311) Disallow DML on Non-temporary Tables when Using In-Memory Catalog

2016-05-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15311: Summary: Disallow DML on Non-temporary Tables when Using In-Memory Catalog (was: Disallow DML for

[jira] [Updated] (SPARK-15311) Disallow DML for Non-temporary Tables when Using In-Memory Catalog

2016-05-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15311: Description: So far, when using In-Memory Catalog, we allow DDL operations for non-temporary tables.

[jira] [Updated] (SPARK-15311) Disallow DML for Non-temporary Tables when Using In-Memory Catalog

2016-05-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15311: Summary: Disallow DML for Non-temporary Tables when Using In-Memory Catalog (was: Disallow Using

[jira] [Created] (SPARK-15311) Disallow Using Non-temporary Tables when Using In-Memory Catalog

2016-05-12 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15311: --- Summary: Disallow Using Non-temporary Tables when Using In-Memory Catalog Key: SPARK-15311 URL: https://issues.apache.org/jira/browse/SPARK-15311 Project: Spark

[jira] [Commented] (SPARK-15309) Bump master to version 2.1.0-SNAPSHOT

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282396#comment-15282396 ] Apache Spark commented on SPARK-15309: -- User 'lresende' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15309) Bump master to version 2.1.0-SNAPSHOT

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15309: Assignee: (was: Apache Spark) > Bump master to version 2.1.0-SNAPSHOT >

[jira] [Assigned] (SPARK-15309) Bump master to version 2.1.0-SNAPSHOT

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15309: Assignee: Apache Spark > Bump master to version 2.1.0-SNAPSHOT >

[jira] [Assigned] (SPARK-15310) Rename HiveTypeCoercion -> TypeCoercion

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15310: Assignee: Reynold Xin (was: Apache Spark) > Rename HiveTypeCoercion -> TypeCoercion >

[jira] [Assigned] (SPARK-15310) Rename HiveTypeCoercion -> TypeCoercion

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15310: Assignee: Apache Spark (was: Reynold Xin) > Rename HiveTypeCoercion -> TypeCoercion >

[jira] [Commented] (SPARK-15310) Rename HiveTypeCoercion -> TypeCoercion

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282394#comment-15282394 ] Apache Spark commented on SPARK-15310: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-15310) Rename HiveTypeCoercion -> TypeCoercion

2016-05-12 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-15310: --- Summary: Rename HiveTypeCoercion -> TypeCoercion Key: SPARK-15310 URL: https://issues.apache.org/jira/browse/SPARK-15310 Project: Spark Issue Type:

[jira] [Created] (SPARK-15309) Bump master to version 2.1.0-SNAPSHOT

2016-05-12 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-15309: --- Summary: Bump master to version 2.1.0-SNAPSHOT Key: SPARK-15309 URL: https://issues.apache.org/jira/browse/SPARK-15309 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-15306) Move object related expressions into expressions.objects

2016-05-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15306. - Resolution: Fixed Fix Version/s: 2.0.0 > Move object related expressions into

[jira] [Updated] (SPARK-15308) RowEncoder should preserve nested column name.

2016-05-12 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-15308: -- Description: The following code generates wrong schema: {code} val schema = new

[jira] [Assigned] (SPARK-15308) RowEncoder should preserve nested column name.

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15308: Assignee: (was: Apache Spark) > RowEncoder should preserve nested column name. >

[jira] [Assigned] (SPARK-15308) RowEncoder should preserve nested column name.

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15308: Assignee: Apache Spark > RowEncoder should preserve nested column name. >

[jira] [Commented] (SPARK-15308) RowEncoder should preserve nested column name.

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282390#comment-15282390 ] Apache Spark commented on SPARK-15308: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-15308) RowEncoder should preserve nested column name.

2016-05-12 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-15308: - Summary: RowEncoder should preserve nested column name. Key: SPARK-15308 URL: https://issues.apache.org/jira/browse/SPARK-15308 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-15101) Audit: ml.clustering and ml.recommendation

2016-05-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282347#comment-15282347 ] yuhao yang edited comment on SPARK-15101 at 5/13/16 2:48 AM: - new features in

[jira] [Comment Edited] (SPARK-15101) Audit: ml.clustering and ml.recommendation

2016-05-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282347#comment-15282347 ] yuhao yang edited comment on SPARK-15101 at 5/13/16 2:40 AM: - new features in

[jira] [Commented] (SPARK-15247) sqlCtx.read.parquet yields at least n_executors * n_cores tasks

2016-05-12 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282351#comment-15282351 ] Takeshi Yamamuro commented on SPARK-15247: -- We can easily fix this issue like

[jira] [Commented] (SPARK-15101) Audit: ml.clustering and ml.recommendation

2016-05-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282347#comment-15282347 ] yuhao yang commented on SPARK-15101: new features in clustering and recommendation: BisectingKMeans,

[jira] [Commented] (SPARK-10899) Support JDBC pushdown for additional commands

2016-05-12 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282346#comment-15282346 ] Takeshi Yamamuro commented on SPARK-10899: -- Yep, pushing down`COUNT` and `LIMIT` to datasources

[jira] [Commented] (SPARK-15236) No way to disable Hive support in REPL

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282337#comment-15282337 ] Apache Spark commented on SPARK-15236: -- User 'xwu0226' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15236) No way to disable Hive support in REPL

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15236: Assignee: Apache Spark > No way to disable Hive support in REPL >

[jira] [Assigned] (SPARK-15236) No way to disable Hive support in REPL

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15236: Assignee: (was: Apache Spark) > No way to disable Hive support in REPL >

[jira] [Commented] (SPARK-10899) Support JDBC pushdown for additional commands

2016-05-12 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282336#comment-15282336 ] Takeshi Yamamuro commented on SPARK-10899: -- Seems there are a lots of related tickets such as

[jira] [Commented] (SPARK-15236) No way to disable Hive support in REPL

2016-05-12 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282297#comment-15282297 ] Xin Wu commented on SPARK-15236: i am looking into this > No way to disable Hive support in REPL >

[jira] [Resolved] (SPARK-15202) add dapplyCollect() method for DataFrame in SparkR

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15202. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-15202) add dapplyCollect() method for DataFrame in SparkR

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15202: -- Assignee: Sun Rui > add dapplyCollect() method for DataFrame in SparkR >

[jira] [Assigned] (SPARK-15282) UDF functioin executed twice when filter on new column created by withColumn

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15282: Assignee: (was: Apache Spark) > UDF functioin executed twice when filter on new

[jira] [Commented] (SPARK-15282) UDF functioin executed twice when filter on new column created by withColumn

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282284#comment-15282284 ] Apache Spark commented on SPARK-15282: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-15282) UDF functioin executed twice when filter on new column created by withColumn

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15282: Assignee: Apache Spark > UDF functioin executed twice when filter on new column created

[jira] [Commented] (SPARK-15282) UDF functioin executed twice when filter on new column created by withColumn

2016-05-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282279#comment-15282279 ] Dongjoon Hyun commented on SPARK-15282: --- Hi, [~linbojin]. I think I can find solution for this

[jira] [Created] (SPARK-15307) Super slow to load a partitioned table from local disks

2016-05-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-15307: -- Summary: Super slow to load a partitioned table from local disks Key: SPARK-15307 URL: https://issues.apache.org/jira/browse/SPARK-15307 Project: Spark Issue

[jira] [Commented] (SPARK-15307) Super slow to load a partitioned table from local disks

2016-05-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282270#comment-15282270 ] Davies Liu commented on SPARK-15307: cc [~liancheng] > Super slow to load a partitioned table from

[jira] [Commented] (SPARK-15306) Move object related expressions into expressions.objects

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282258#comment-15282258 ] Apache Spark commented on SPARK-15306: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15306) Move object related expressions into expressions.objects

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15306: Assignee: Apache Spark (was: Reynold Xin) > Move object related expressions into

[jira] [Assigned] (SPARK-15306) Move object related expressions into expressions.objects

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15306: Assignee: Reynold Xin (was: Apache Spark) > Move object related expressions into

[jira] [Created] (SPARK-15306) Move object related expressions into expressions.objects

2016-05-12 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-15306: --- Summary: Move object related expressions into expressions.objects Key: SPARK-15306 URL: https://issues.apache.org/jira/browse/SPARK-15306 Project: Spark Issue

[jira] [Commented] (SPARK-14541) SQL function: IFNULL, NULLIF, NVL and NVL2

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282254#comment-15282254 ] Apache Spark commented on SPARK-14541: -- User 'rxin' has created a pull request for this issue:

[jira] [Closed] (SPARK-15287) Spark SQL partition filter clause with different literal type will scan all hive partitions

2016-05-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-15287. -- Resolution: Won't Fix > Spark SQL partition filter clause with different literal type will scan all >

[jira] [Commented] (SPARK-15287) Spark SQL partition filter clause with different literal type will scan all hive partitions

2016-05-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282247#comment-15282247 ] Davies Liu commented on SPARK-15287: By design, we can't compare two expression with different types

[jira] [Commented] (SPARK-10899) Support JDBC pushdown for additional commands

2016-05-12 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282239#comment-15282239 ] Nicholas Chammas commented on SPARK-10899: -- Is {{COUNT}} also something that can be pushed down?

[jira] [Assigned] (SPARK-15305) spark.ml document Bisectiong k-means has the incorrect format

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15305: Assignee: Apache Spark > spark.ml document Bisectiong k-means has the incorrect format >

[jira] [Commented] (SPARK-15305) spark.ml document Bisectiong k-means has the incorrect format

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282225#comment-15282225 ] Apache Spark commented on SPARK-15305: -- User 'wangmiao1981' has created a pull request for this

[jira] [Assigned] (SPARK-15305) spark.ml document Bisectiong k-means has the incorrect format

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15305: Assignee: (was: Apache Spark) > spark.ml document Bisectiong k-means has the

[jira] [Created] (SPARK-15305) spark.ml document Bisectiong k-means has the incorrect format

2016-05-12 Thread Miao Wang (JIRA)
Miao Wang created SPARK-15305: - Summary: spark.ml document Bisectiong k-means has the incorrect format Key: SPARK-15305 URL: https://issues.apache.org/jira/browse/SPARK-15305 Project: Spark

[jira] [Comment Edited] (SPARK-15269) Creating external table leaves empty directory under warehouse directory

2016-05-12 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282215#comment-15282215 ] Xin Wu edited comment on SPARK-15269 at 5/12/16 11:04 PM: -- FYI.. The reason why

[jira] [Commented] (SPARK-15269) Creating external table leaves empty directory under warehouse directory

2016-05-12 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282215#comment-15282215 ] Xin Wu commented on SPARK-15269: FYI.. The reason why the default database paths obtained by different

[jira] [Updated] (SPARK-13902) Make DAGScheduler not to create duplicate stage.

2016-05-12 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-13902: --- Fix Version/s: (was: 2.1.0) 2.0.0 > Make DAGScheduler not to create

[jira] [Resolved] (SPARK-15293) 'collect_list' function undefined

2016-05-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15293. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 I'm going to

[jira] [Resolved] (SPARK-10605) collect_list() and collect_set() should accept struct types as argument

2016-05-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10605. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 >

[jira] [Resolved] (SPARK-13902) Make DAGScheduler not to create duplicate stage.

2016-05-12 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-13902. Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.1.0 > Make

[jira] [Updated] (SPARK-14421) Kinesis deaggregation with PySpark

2016-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14421: -- Assignee: Brian O'Neil > Kinesis deaggregation with PySpark > -- > >

[jira] [Resolved] (SPARK-14421) Kinesis deaggregation with PySpark

2016-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14421. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13054

[jira] [Updated] (SPARK-14897) Upgrade Jetty to latest version of 8/9

2016-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14897: -- Assignee: Bo Meng > Upgrade Jetty to latest version of 8/9 > -- >

[jira] [Resolved] (SPARK-14897) Upgrade Jetty to latest version of 8/9

2016-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14897. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12916

[jira] [Commented] (SPARK-15302) Implement FK/PK "rely novalidate" constraints for better CBO

2016-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281925#comment-15281925 ] Sean Owen commented on SPARK-15302: --- Is this supposed to be a Spark issue? > Implement FK/PK "rely

[jira] [Deleted] (SPARK-15304) kung,1.844.844.2433, kindle fire game tech support number, kindle fire technical Support Phone Number,kindle fire CUSTOMER SUPPORT PHONE NUMBER

2016-05-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin deleted SPARK-15304: --- > kung,1.844.844.2433, kindle fire game tech support number, kindle fire > technical Support

[jira] [Created] (SPARK-15304) kung,1.844.844.2433, kindle fire game tech support number, kindle fire technical Support Phone Number,kindle fire CUSTOMER SUPPORT PHONE NUMBER

2016-05-12 Thread sdfsdf (JIRA)
sdfsdf created SPARK-15304: -- Summary: kung,1.844.844.2433, kindle fire game tech support number, kindle fire technical Support Phone Number,kindle fire CUSTOMER SUPPORT PHONE NUMBER Key: SPARK-15304 URL:

[jira] [Deleted] (SPARK-15303) kung,1.855-888.0376, gmail tech support number, gmail technical Support Phone Number,gmail CUSTOMER SUPPORT PHONE NUMBER

2016-05-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin deleted SPARK-15303: --- > kung,1.855-888.0376, gmail tech support number, gmail technical Support > Phone

[jira] [Created] (SPARK-15303) kung,1.855-888.0376, gmail tech support number, gmail technical Support Phone Number,gmail CUSTOMER SUPPORT PHONE NUMBER

2016-05-12 Thread sdfsdf (JIRA)
sdfsdf created SPARK-15303: -- Summary: kung,1.855-888.0376, gmail tech support number, gmail technical Support Phone Number,gmail CUSTOMER SUPPORT PHONE NUMBER Key: SPARK-15303 URL:

[jira] [Deleted] (SPARK-15301) kung,1.844.844.2433, pogo game tech support number, POGO technical Support Phone Number,POGO CUSTOMER SUPPORT PHONE NUMBER

2016-05-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin deleted SPARK-15301: --- > kung,1.844.844.2433, pogo game tech support number, POGO technical Support > Phone

[jira] [Updated] (SPARK-15302) Implement FK/PK "rely novalidate" constraints for better CBO

2016-05-12 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-15302: -- Description: Oracle has "RELY NOVALIDATE" option for constraints.. Could be easier for

[jira] [Created] (SPARK-15302) Implement FK/PK "rely novalidate" constraints for better CBO

2016-05-12 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SPARK-15302: - Summary: Implement FK/PK "rely novalidate" constraints for better CBO Key: SPARK-15302 URL: https://issues.apache.org/jira/browse/SPARK-15302 Project:

[jira] [Created] (SPARK-15301) kung,1.844.844.2433, pogo game tech support number, POGO technical Support Phone Number,POGO CUSTOMER SUPPORT PHONE NUMBER

2016-05-12 Thread sdfsdf (JIRA)
sdfsdf created SPARK-15301: -- Summary: kung,1.844.844.2433, pogo game tech support number, POGO technical Support Phone Number,POGO CUSTOMER SUPPORT PHONE NUMBER Key: SPARK-15301 URL:

[jira] [Updated] (SPARK-15300) Can't remove a block if it's under evicting

2016-05-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15300: --- Summary: Can't remove a block if it's under evicting (was: Can't remove a block if it's under

[jira] [Assigned] (SPARK-15300) Can't remove a block if it's under eviting

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15300: Assignee: Davies Liu (was: Apache Spark) > Can't remove a block if it's under eviting >

[jira] [Commented] (SPARK-15300) Can't remove a block if it's under eviting

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281885#comment-15281885 ] Apache Spark commented on SPARK-15300: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15300) Can't remove a block if it's under eviting

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15300: Assignee: Apache Spark (was: Davies Liu) > Can't remove a block if it's under eviting >

[jira] [Resolved] (SPARK-14684) Verification of partition specs in SessionCatalog

2016-05-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14684. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Verification of

[jira] [Resolved] (SPARK-15277) Checking Partition Spec Existence Before Dropping

2016-05-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15277. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 Target

[jira] [Updated] (SPARK-14684) Verification of partition specs in SessionCatalog

2016-05-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14684: -- Description: When attempting to drop partitions of a table, if the user provides an unknown column,

[jira] [Created] (SPARK-15300) Can't remove a block if it's under eviting

2016-05-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-15300: -- Summary: Can't remove a block if it's under eviting Key: SPARK-15300 URL: https://issues.apache.org/jira/browse/SPARK-15300 Project: Spark Issue Type: Bug

[jira] [Deleted] (SPARK-15299) 1844.887.9236 Quickbooks Desktop Support Phone Number

2016-05-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin deleted SPARK-15299: --- > 1844.887.9236 Quickbooks Desktop Support Phone Number >

[jira] [Commented] (SPARK-15271) Allow force pulling executor docker images

2016-05-12 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281838#comment-15281838 ] Michael Gummelt commented on SPARK-15271: - Much needed, thanks. > Allow force pulling executor

[jira] [Created] (SPARK-15299) 1844.887.9236 Quickbooks Desktop Support Phone Number

2016-05-12 Thread raman deep (JIRA)
raman deep created SPARK-15299: -- Summary: 1844.887.9236 Quickbooks Desktop Support Phone Number Key: SPARK-15299 URL: https://issues.apache.org/jira/browse/SPARK-15299 Project: Spark Issue

[jira] [Deleted] (SPARK-15298) 1844-887-9236 Quickbooks Customer Service Phone Number

2016-05-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin deleted SPARK-15298: --- > 1844-887-9236 Quickbooks Customer Service Phone Number >

[jira] [Created] (SPARK-15298) 1844-887-9236 Quickbooks Customer Service Phone Number

2016-05-12 Thread raman deep (JIRA)
raman deep created SPARK-15298: -- Summary: 1844-887-9236 Quickbooks Customer Service Phone Number Key: SPARK-15298 URL: https://issues.apache.org/jira/browse/SPARK-15298 Project: Spark Issue

[jira] [Commented] (SPARK-15294) Add pivot functionality to SparkR

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281807#comment-15281807 ] Shivaram Venkataraman commented on SPARK-15294: --- [~mhnatiuk] Thanks for opening this. I

[jira] [Commented] (SPARK-14209) Application failure during preemption.

2016-05-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281798#comment-15281798 ] Marcelo Vanzin commented on SPARK-14209: BTW this particular error looks like SPARK-9439,

[jira] [Assigned] (SPARK-15297) Fix Set -V Command

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15297: Assignee: Apache Spark > Fix Set -V Command > -- > > Key:

[jira] [Assigned] (SPARK-15297) Fix Set -V Command

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15297: Assignee: (was: Apache Spark) > Fix Set -V Command > -- > >

[jira] [Commented] (SPARK-15297) Fix Set -V Command

2016-05-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281796#comment-15281796 ] Apache Spark commented on SPARK-15297: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-15297) Fix Set -V Command

2016-05-12 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15297: --- Summary: Fix Set -V Command Key: SPARK-15297 URL: https://issues.apache.org/jira/browse/SPARK-15297 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-14803) A bug in EliminateSerialization rule in Catalyst Optimizer

2016-05-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14803: - Assignee: Liang-Chi Hsieh > A bug in EliminateSerialization rule in Catalyst Optimizer >

[jira] [Resolved] (SPARK-15094) CodeGenerator: failed to compile - when using dataset.rdd with generic case class

2016-05-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15094. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12926

[jira] [Updated] (SPARK-15094) CodeGenerator: failed to compile - when using dataset.rdd with generic case class

2016-05-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15094: - Assignee: Liang-Chi Hsieh > CodeGenerator: failed to compile - when using dataset.rdd with generic case

[jira] [Resolved] (SPARK-14803) A bug in EliminateSerialization rule in Catalyst Optimizer

2016-05-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14803. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12926

[jira] [Commented] (SPARK-15269) Creating external table leaves empty directory under warehouse directory

2016-05-12 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281748#comment-15281748 ] Xin Wu commented on SPARK-15269: Yes, I can . Thanks! > Creating external table leaves empty directory

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281746#comment-15281746 ] Shivaram Venkataraman commented on SPARK-14995: --- Technically entire SparkR component is

[jira] [Commented] (SPARK-14751) SparkR fails on Cassandra map with numeric key

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281700#comment-15281700 ] Shivaram Venkataraman commented on SPARK-14751: --- [~sunrui] That sounds fine to me. Can we

[jira] [Commented] (SPARK-15129) Clarify conventions for calling Spark and MLlib from R

2016-05-12 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281698#comment-15281698 ] Gayathri Murali commented on SPARK-15129: - I can work on this > Clarify conventions for calling

  1   2   >