[jira] [Commented] (SPARK-4199) Drop table if exists raises table not found exception in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194376#comment-14194376 ] Cheng Lian commented on SPARK-4199: --- Hi [~huangjs], which version/commit are you using?

[jira] [Updated] (SPARK-1442) Add Window function support

[ https://issues.apache.org/jira/browse/SPARK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guowei updated SPARK-1442: -- Attachment: (was: Window Function.pdf) Add Window function support ---

[jira] [Updated] (SPARK-1442) Add Window function support

[ https://issues.apache.org/jira/browse/SPARK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guowei updated SPARK-1442: -- Attachment: Window Function.pdf Add Window function support ---

[jira] [Created] (SPARK-4203) Partition directories in random order when inserting into hive table

Matthew Taylor created SPARK-4203: - Summary: Partition directories in random order when inserting into hive table Key: SPARK-4203 URL: https://issues.apache.org/jira/browse/SPARK-4203 Project: Spark

[jira] [Created] (SPARK-4204) Utils.exceptionString only return the information for the outermost exception

Shixiong Zhu created SPARK-4204: --- Summary: Utils.exceptionString only return the information for the outermost exception Key: SPARK-4204 URL: https://issues.apache.org/jira/browse/SPARK-4204 Project:

[jira] [Commented] (SPARK-4204) Utils.exceptionString only return the information for the outermost exception

[ https://issues.apache.org/jira/browse/SPARK-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194507#comment-14194507 ] Apache Spark commented on SPARK-4204: - User 'zsxwing' has created a pull request for

[jira] [Created] (SPARK-4205) Timestamp and Date objects with comparison operators

Marc Culler created SPARK-4205: -- Summary: Timestamp and Date objects with comparison operators Key: SPARK-4205 URL: https://issues.apache.org/jira/browse/SPARK-4205 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Heller updated SPARK-2691: Attachment: spark-docker.patch Here is the patch for the changes needed to support docker images in

[jira] [Comment Edited] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194513#comment-14194513 ] Chris Heller edited comment on SPARK-2691 at 11/3/14 1:08 PM: --

[jira] [Created] (SPARK-4206) BlockManager warnings in local mode: Block $blockId already exists on this machine; not re-adding it

Imran Rashid created SPARK-4206: --- Summary: BlockManager warnings in local mode: Block $blockId already exists on this machine; not re-adding it Key: SPARK-4206 URL: https://issues.apache.org/jira/browse/SPARK-4206

[jira] [Commented] (SPARK-4206) BlockManager warnings in local mode: Block $blockId already exists on this machine; not re-adding it

[ https://issues.apache.org/jira/browse/SPARK-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194550#comment-14194550 ] Sean Owen commented on SPARK-4206: -- I think there was a discussion about this and the

[jira] [Updated] (SPARK-4206) BlockManager warnings in local mode: Block $blockId already exists on this machine; not re-adding it

[ https://issues.apache.org/jira/browse/SPARK-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-4206: Description: When running in local mode, you often get log warning messages like: WARN

[jira] [Commented] (SPARK-4206) BlockManager warnings in local mode: Block $blockId already exists on this machine; not re-adding it

[ https://issues.apache.org/jira/browse/SPARK-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194574#comment-14194574 ] Imran Rashid commented on SPARK-4206: - thanks Sean -- sorry I accidentally created the

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194576#comment-14194576 ] Andre Schumacher commented on SPARK-2620: - I also bumped into this issue (on Spark

[jira] [Created] (SPARK-4207) Query which has syntax like 'not like' is not working in Spark SQL

Ravindra Pesala created SPARK-4207: -- Summary: Query which has syntax like 'not like' is not working in Spark SQL Key: SPARK-4207 URL: https://issues.apache.org/jira/browse/SPARK-4207 Project: Spark

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194625#comment-14194625 ] Eduardo Jimenez commented on SPARK-2691: Thanks! docker-cli format it is then, as

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194632#comment-14194632 ] Chris Heller commented on SPARK-2691: - That seems reasonable. In fact, the volumes

[jira] [Comment Edited] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194634#comment-14194634 ] Tom Arnfeld edited comment on SPARK-2691 at 11/3/14 3:42 PM: -

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194634#comment-14194634 ] Tom Arnfeld commented on SPARK-2691: Thanks so much for the patches here

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194637#comment-14194637 ] Chris Heller commented on SPARK-2691: - +1 on passing in environment. great idea.

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194646#comment-14194646 ] Tom Arnfeld commented on SPARK-2691: Awesome. We're keen to get spark up and running

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194649#comment-14194649 ] Tom Arnfeld commented on SPARK-2691: Also [~ChrisHeller] if you're not shipping spark

[jira] [Comment Edited] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194634#comment-14194634 ] Tom Arnfeld edited comment on SPARK-2691 at 11/3/14 3:57 PM: -

[jira] [Comment Edited] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194646#comment-14194646 ] Tom Arnfeld edited comment on SPARK-2691 at 11/3/14 3:56 PM: -

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194655#comment-14194655 ] Eduardo Jimenez commented on SPARK-2691: Go for it. It would be helpful if most of

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194669#comment-14194669 ] Eduardo Jimenez commented on SPARK-2691: I would also say don't only support

[jira] [Created] (SPARK-4208) stack over flow error while using sqlContext.sql

milq created SPARK-4208: --- Summary: stack over flow error while using sqlContext.sql Key: SPARK-4208 URL: https://issues.apache.org/jira/browse/SPARK-4208 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194679#comment-14194679 ] Chris Heller commented on SPARK-2691: - Ok here is the patch as a PR:

[jira] [Commented] (SPARK-4207) Query which has syntax like 'not like' is not working in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194714#comment-14194714 ] Apache Spark commented on SPARK-4207: - User 'ravipesala' has created a pull request

[jira] [Commented] (SPARK-4205) Timestamp and Date objects with comparison operators

[ https://issues.apache.org/jira/browse/SPARK-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194777#comment-14194777 ] Apache Spark commented on SPARK-4205: - User 'culler' has created a pull request for

[jira] [Created] (SPARK-4209) Support UDT in UDF

Xiangrui Meng created SPARK-4209: Summary: Support UDT in UDF Key: SPARK-4209 URL: https://issues.apache.org/jira/browse/SPARK-4209 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-4206) BlockManager warnings in local mode: Block $blockId already exists on this machine; not re-adding it

[ https://issues.apache.org/jira/browse/SPARK-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194793#comment-14194793 ] Imran Rashid commented on SPARK-4206: - a little more confirmation: If I change this

[jira] [Commented] (SPARK-4203) Partition directories in random order when inserting into hive table

[ https://issues.apache.org/jira/browse/SPARK-4203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194843#comment-14194843 ] Apache Spark commented on SPARK-4203: - User 'tbfenet' has created a pull request for

[jira] [Commented] (SPARK-4201) Can't use concat() on partition column in where condition (Hive compatibility problem)

[ https://issues.apache.org/jira/browse/SPARK-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194847#comment-14194847 ] Venkata Ramana G commented on SPARK-4201: - I found the same is working on latest

[jira] [Created] (SPARK-4210) Add Extra-Trees algorithm to MLlib

Vincent Botta created SPARK-4210: Summary: Add Extra-Trees algorithm to MLlib Key: SPARK-4210 URL: https://issues.apache.org/jira/browse/SPARK-4210 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-2426) Quadratic Minimization for MLlib ALS

[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das updated SPARK-2426: Affects Version/s: (was: 1.0.0) 1.2.0 Quadratic Minimization for MLlib

[jira] [Updated] (SPARK-2426) Quadratic Minimization for MLlib ALS

[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das updated SPARK-2426: Affects Version/s: (was: 1.2.0) 1.3.0 Quadratic Minimization for MLlib

[jira] [Commented] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194944#comment-14194944 ] Reynold Xin commented on SPARK-2938: I think we are still going to add it to 1.2

[jira] [Commented] (SPARK-1070) Add check for JIRA ticket in the Github pull request title/summary with CI

[ https://issues.apache.org/jira/browse/SPARK-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194952#comment-14194952 ] Nicholas Chammas commented on SPARK-1070: - [~hsaputra] - The [Spark PR Board |

[jira] [Commented] (SPARK-1070) Add check for JIRA ticket in the Github pull request title/summary with CI

[ https://issues.apache.org/jira/browse/SPARK-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194961#comment-14194961 ] Henry Saputra commented on SPARK-1070: -- [~nchammas], way back when Patrick propose

[jira] [Created] (SPARK-4211) Spark POM hive-0.13.1 profile sets incorrect hive version property

Fi created SPARK-4211: - Summary: Spark POM hive-0.13.1 profile sets incorrect hive version property Key: SPARK-4211 URL: https://issues.apache.org/jira/browse/SPARK-4211 Project: Spark Issue Type:

[jira] [Updated] (SPARK-4211) Spark POM hive-0.13.1 profile sets incorrect hive version property

[ https://issues.apache.org/jira/browse/SPARK-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fi updated SPARK-4211: -- Fix Version/s: 1.2.0 Spark POM hive-0.13.1 profile sets incorrect hive version property

[jira] [Commented] (SPARK-4211) Spark POM hive-0.13.1 profile sets incorrect hive version property

[ https://issues.apache.org/jira/browse/SPARK-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194973#comment-14194973 ] Apache Spark commented on SPARK-4211: - User 'coderfi' has created a pull request for

[jira] [Updated] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2938: --- Priority: Blocker (was: Major) Support SASL authentication in Netty network module

[jira] [Closed] (SPARK-4199) Drop table if exists raises table not found exception in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianshi Huang closed SPARK-4199. Resolution: Invalid Drop table if exists raises table not found exception in HiveContext

[jira] [Commented] (SPARK-4199) Drop table if exists raises table not found exception in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195045#comment-14195045 ] Jianshi Huang commented on SPARK-4199: -- Turned out it was caused by wrong version of

[jira] [Created] (SPARK-4212) Actor not found

Davies Liu created SPARK-4212: - Summary: Actor not found Key: SPARK-4212 URL: https://issues.apache.org/jira/browse/SPARK-4212 Project: Spark Issue Type: Bug Components: Spark Core

[jira] [Commented] (SPARK-4186) Support binaryFiles and binaryRecords API in Python

[ https://issues.apache.org/jira/browse/SPARK-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195054#comment-14195054 ] Apache Spark commented on SPARK-4186: - User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-4211) Spark POM hive-0.13.1 profile sets incorrect hive version property

[ https://issues.apache.org/jira/browse/SPARK-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4211. - Resolution: Fixed Issue resolved by pull request 3072

[jira] [Updated] (SPARK-3541) Improve ALS internal storage

[ https://issues.apache.org/jira/browse/SPARK-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3541: - Target Version/s: 1.3.0 (was: 1.2.0) Improve ALS internal storage

[jira] [Resolved] (SPARK-4207) Query which has syntax like 'not like' is not working in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4207. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3075

[jira] [Resolved] (SPARK-3594) try more rows during inferSchema

[ https://issues.apache.org/jira/browse/SPARK-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3594. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2716

[jira] [Commented] (SPARK-4210) Add Extra-Trees algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195108#comment-14195108 ] Manish Amde commented on SPARK-4210: [~0asa] Thanks for the creating the JIRA. From

[jira] [Commented] (SPARK-3146) Improve the flexibility of Spark Streaming Kafka API to offer user the ability to process message before storing into BM

[ https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195146#comment-14195146 ] Cody Koeninger commented on SPARK-3146: --- I think this PR is an elegant way to solve

[jira] [Commented] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195168#comment-14195168 ] Apache Spark commented on SPARK-1021: - User 'erikerlandson' has created a pull request

[jira] [Resolved] (SPARK-4152) Avoid data change in CTAS while table already existed

[ https://issues.apache.org/jira/browse/SPARK-4152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4152. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3013

[jira] [Created] (SPARK-4213) SparkSQL - ParquetFilters - No support for LT, LTE, GT, GTE operators

Terry Siu created SPARK-4213: Summary: SparkSQL - ParquetFilters - No support for LT, LTE, GT, GTE operators Key: SPARK-4213 URL: https://issues.apache.org/jira/browse/SPARK-4213 Project: Spark

[jira] [Updated] (SPARK-4213) SparkSQL - ParquetFilters - No support for LT, LTE, GT, GTE operators

[ https://issues.apache.org/jira/browse/SPARK-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4213: Priority: Blocker (was: Major) SparkSQL - ParquetFilters - No support for LT, LTE, GT,

[jira] [Resolved] (SPARK-3238) Commas/spaces/dashes are not escaped properly when transferring schema information to parquet readers

[ https://issues.apache.org/jira/browse/SPARK-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3238. - Resolution: Fixed Assignee: Cheng Lian I think this was fixed by the conversion to

[jira] [Updated] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2883: Target Version/s: 1.3.0 (was: 1.2.0) Spark Support for ORCFile format

[jira] [Assigned] (SPARK-3618) Store analyzed plans for temp tables

[ https://issues.apache.org/jira/browse/SPARK-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-3618: --- Assignee: Michael Armbrust Store analyzed plans for temp tables

[jira] [Resolved] (SPARK-3618) Store analyzed plans for temp tables

[ https://issues.apache.org/jira/browse/SPARK-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3618. - Resolution: Fixed Fix Version/s: 1.2.0 This was done as part of the caching

[jira] [Updated] (SPARK-3575) Hive Schema is ignored when using convertMetastoreParquet

[ https://issues.apache.org/jira/browse/SPARK-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3575: Target Version/s: 1.3.0 (was: 1.2.0) Hive Schema is ignored when using

[jira] [Updated] (SPARK-3575) Hive Schema is ignored when using convertMetastoreParquet

[ https://issues.apache.org/jira/browse/SPARK-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3575: Priority: Critical (was: Major) Hive Schema is ignored when using convertMetastoreParquet

[jira] [Updated] (SPARK-3575) Hive Schema is ignored when using convertMetastoreParquet

[ https://issues.apache.org/jira/browse/SPARK-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3575: Target Version/s: 1.2.0 (was: 1.3.0) Hive Schema is ignored when using

[jira] [Updated] (SPARK-3440) HiveServer2 and CLI should retrieve Hive result set schema

[ https://issues.apache.org/jira/browse/SPARK-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3440: Target Version/s: 1.3.0 (was: 1.2.0) HiveServer2 and CLI should retrieve Hive result set

[jira] [Commented] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard-coded case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195240#comment-14195240 ] Michael Armbrust commented on SPARK-2710: - Now that its been merged, it would be

[jira] [Updated] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard-coded case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2710: Target Version/s: 1.3.0 (was: 1.2.0) Build SchemaRDD from a JdbcRDD with MetaData (no

[jira] [Resolved] (SPARK-2902) Change default options to be more agressive

[ https://issues.apache.org/jira/browse/SPARK-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2902. - Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Michael Armbrust (was:

[jira] [Updated] (SPARK-2775) HiveContext does not support dots in column names.

[ https://issues.apache.org/jira/browse/SPARK-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2775: Target Version/s: 1.3.0 (was: 1.2.0) HiveContext does not support dots in column names.

[jira] [Commented] (SPARK-3720) support ORC in spark sql

[ https://issues.apache.org/jira/browse/SPARK-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195287#comment-14195287 ] René X Parra commented on SPARK-3720: - [~zhazhan] should this JIRA ticket be closed

[jira] [Resolved] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2360. - Resolution: Won't Fix Hey Hossein, I'm going to close this since I think we have decided

[jira] [Updated] (SPARK-2870) Thorough schema inference directly on RDDs of Python dictionaries

[ https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2870: Target Version/s: 1.3.0 (was: 1.2.0) Thorough schema inference directly on RDDs of Python

[jira] [Commented] (SPARK-4133) PARSING_ERROR(2) when upgrading issues from 1.0.2 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195294#comment-14195294 ] Josh Rosen commented on SPARK-4133: --- Do you happen to be creating multiple running

[jira] [Updated] (SPARK-2863) Emulate Hive type coercion in native reimplementations of Hive functions

[ https://issues.apache.org/jira/browse/SPARK-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2863: Target Version/s: 1.3.0 (was: 1.2.0) Emulate Hive type coercion in native

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195301#comment-14195301 ] René X Parra commented on SPARK-2883: - [~marmbrus] I see this was changed from Version

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195308#comment-14195308 ] Michael Armbrust commented on SPARK-2883: - The merge deadline for 1.2.0 was on

[jira] [Resolved] (SPARK-4178) Hadoop input metrics ignore bytes read in RecordReader instantiation

[ https://issues.apache.org/jira/browse/SPARK-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4178. Resolution: Fixed Assignee: Sandy Ryza Hadoop input metrics ignore bytes read in

[jira] [Created] (SPARK-4214) With dynamic allocation, avoid outstanding requests for more executors than pending tasks need

Sandy Ryza created SPARK-4214: - Summary: With dynamic allocation, avoid outstanding requests for more executors than pending tasks need Key: SPARK-4214 URL: https://issues.apache.org/jira/browse/SPARK-4214

[jira] [Commented] (SPARK-3720) support ORC in spark sql

[ https://issues.apache.org/jira/browse/SPARK-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195402#comment-14195402 ] Zhan Zhang commented on SPARK-3720: --- [~neoword] wangfei and me are working together to

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195427#comment-14195427 ] Zhan Zhang commented on SPARK-2883: --- [~neoword] , As [~marmbrus] mentioned, the PR need

[jira] [Commented] (SPARK-3797) Run the shuffle service inside the YARN NodeManager as an AuxiliaryService

[ https://issues.apache.org/jira/browse/SPARK-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195466#comment-14195466 ] Apache Spark commented on SPARK-3797: - User 'andrewor14' has created a pull request

[jira] [Created] (SPARK-4215) Allow requesting executors only on Yarn (for now)

Andrew Or created SPARK-4215: Summary: Allow requesting executors only on Yarn (for now) Key: SPARK-4215 URL: https://issues.apache.org/jira/browse/SPARK-4215 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4215) Allow requesting executors only on Yarn (for now)

[ https://issues.apache.org/jira/browse/SPARK-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4215: - Description: Currently if the user attempts to call `sc.requestExecutors` or enables dynamic allocation

[jira] [Commented] (SPARK-4213) SparkSQL - ParquetFilters - No support for LT, LTE, GT, GTE operators

[ https://issues.apache.org/jira/browse/SPARK-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195480#comment-14195480 ] Apache Spark commented on SPARK-4213: - User 'sarutak' has created a pull request for

[jira] [Commented] (SPARK-4216) Eliminate Jenkins GitHub posts from AMPLab

[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195482#comment-14195482 ] Nicholas Chammas commented on SPARK-4216: - cc [~shaneknapp] [~joshrosen]

[jira] [Updated] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4216: Summary: Eliminate duplicate Jenkins GitHub posts from AMPLab (was: Eliminate Jenkins

[jira] [Commented] (SPARK-4166) Display the executor ID in the Web UI when ExecutorLostFailure happens

[ https://issues.apache.org/jira/browse/SPARK-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195542#comment-14195542 ] Apache Spark commented on SPARK-4166: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-4210) Add Extra-Trees algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195552#comment-14195552 ] Joseph K. Bradley commented on SPARK-4210: -- [~0asa] For the API, do you plan for

[jira] [Commented] (SPARK-4163) When fetching blocks unsuccessfully, Web UI only displays Fetch failure

[ https://issues.apache.org/jira/browse/SPARK-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195575#comment-14195575 ] Apache Spark commented on SPARK-4163: - User 'zsxwing' has created a pull request for

[jira] [Updated] (SPARK-611) Allow JStack to be run from web UI

[ https://issues.apache.org/jira/browse/SPARK-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-611: Affects Version/s: 1.0.0 Allow JStack to be run from web UI --

[jira] [Closed] (SPARK-611) Allow JStack to be run from web UI

[ https://issues.apache.org/jira/browse/SPARK-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-611. --- Resolution: Fixed Fix Version/s: 1.2.0 Allow JStack to be run from web UI

[jira] [Commented] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195599#comment-14195599 ] Apache Spark commented on SPARK-2938: - User 'aarondav' has created a pull request for

[jira] [Updated] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2938: - Target Version/s: 1.2.0 Support SASL authentication in Netty network module

[jira] [Updated] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2938: - Affects Version/s: 1.1.0 Support SASL authentication in Netty network module

[jira] [Updated] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2938: - Affects Version/s: (was: 1.1.0) 1.2.0 Support SASL authentication in Netty

[jira] [Created] (SPARK-4217) Result of SparkSQL is incorrect after a table join and group by operation

peter.zhang created SPARK-4217: -- Summary: Result of SparkSQL is incorrect after a table join and group by operation Key: SPARK-4217 URL: https://issues.apache.org/jira/browse/SPARK-4217 Project: Spark

[jira] [Updated] (SPARK-4217) Result of SparkSQL is incorrect after a table join and group by operation

[ https://issues.apache.org/jira/browse/SPARK-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peter.zhang updated SPARK-4217: --- Description: I runed a test using same SQL script in SparkSQL, Shark and Hive environment as below

[jira] [Resolved] (SPARK-4192) Support UDT in Python

[ https://issues.apache.org/jira/browse/SPARK-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4192. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3068

[jira] [Commented] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195711#comment-14195711 ] shane knapp commented on SPARK-4216: actually, you got the 'real' and 'impostor'

  1   2   >