[jira] [Commented] (SPARK-4080) IOException: unexpected exception type while deserializing tasks

[ https://issues.apache.org/jira/browse/SPARK-4080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192977#comment-14192977 ] Kuldeep commented on SPARK-4080: Yes [~joshrosen], two sparkcontexts are being created

[jira] [Commented] (SPARK-4127) Streaming Linear Regression- Python bindings

[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192996#comment-14192996 ] Anant Daksh Asthana commented on SPARK-4127: [~mengxr][~freeman-lab] I am

[jira] [Comment Edited] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193007#comment-14193007 ] Eduardo Jimenez edited comment on SPARK-2691 at 11/1/14 7:32 AM:

[jira] [Created] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

Josh Rosen created SPARK-4180: - Summary: SparkContext constructor should throw exception if another SparkContext is already running Key: SPARK-4180 URL: https://issues.apache.org/jira/browse/SPARK-4180

[jira] [Updated] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4180: -- Description: Spark does not currently support multiple concurrently-running SparkContexts in the same

[jira] [Commented] (SPARK-4080) IOException: unexpected exception type while deserializing tasks

[ https://issues.apache.org/jira/browse/SPARK-4080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193017#comment-14193017 ] Josh Rosen commented on SPARK-4080: --- Spark does not currently support multiple

[jira] [Resolved] (SPARK-4142) Bad Default for GraphLoader Edge Partitions

[ https://issues.apache.org/jira/browse/SPARK-4142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4142. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Joseph E. Gonzalez Bad Default

[jira] [Resolved] (SPARK-4115) [GraphX] add overrided count for EdgeRDD

[ https://issues.apache.org/jira/browse/SPARK-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4115. Resolution: Fixed Fix Version/s: 1.2.0 [GraphX] add overrided count for EdgeRDD

[jira] [Commented] (SPARK-3708) Backticks aren't handled correctly is aliases

[ https://issues.apache.org/jira/browse/SPARK-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193051#comment-14193051 ] qiaohaijun commented on SPARK-3708: --- +1 Backticks aren't handled correctly is aliases

[jira] [Created] (SPARK-4181) Create separate options to control the client-mode AM resource allocation request

WangTaoTheTonic created SPARK-4181: -- Summary: Create separate options to control the client-mode AM resource allocation request Key: SPARK-4181 URL: https://issues.apache.org/jira/browse/SPARK-4181

[jira] [Commented] (SPARK-2420) Dependency changes for compatibility with Hive

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193165#comment-14193165 ] qiaohaijun commented on SPARK-2420: --- +1 Dependency changes for compatibility with Hive

[jira] [Commented] (SPARK-2848) Shade Guava in Spark deliverables

[ https://issues.apache.org/jira/browse/SPARK-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193172#comment-14193172 ] qiaohaijun commented on SPARK-2848: --- +1 Shade Guava in Spark deliverables

[jira] [Commented] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build when SPARK_PREPEND_CLASSES is set

[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193177#comment-14193177 ] qiaohaijun commented on SPARK-3217: --- +1 Shaded Guava jar doesn't play well with Maven

[jira] [Resolved] (SPARK-4164) spark.kryo.registrator shall use comma separated value to support multiple registrator

[ https://issues.apache.org/jira/browse/SPARK-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-4164. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0

[jira] [Resolved] (SPARK-4165) Actor with Companion throws ambiguous reference error in REPL

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-4165. Resolution: Duplicate Actor with Companion throws ambiguous reference error in REPL

[jira] [Created] (SPARK-4182) Caching tables containing boolean, binary, array, struct and/or map columns doesn't work

Cheng Lian created SPARK-4182: - Summary: Caching tables containing boolean, binary, array, struct and/or map columns doesn't work Key: SPARK-4182 URL: https://issues.apache.org/jira/browse/SPARK-4182

[jira] [Created] (SPARK-4183) Enable Netty-based BlockTransferService by default

Aaron Davidson created SPARK-4183: - Summary: Enable Netty-based BlockTransferService by default Key: SPARK-4183 URL: https://issues.apache.org/jira/browse/SPARK-4183 Project: Spark Issue

[jira] [Commented] (SPARK-4183) Enable Netty-based BlockTransferService by default

[ https://issues.apache.org/jira/browse/SPARK-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193271#comment-14193271 ] Apache Spark commented on SPARK-4183: - User 'aarondav' has created a pull request for

[jira] [Commented] (SPARK-3639) Kinesis examples set master as local

[ https://issues.apache.org/jira/browse/SPARK-3639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193285#comment-14193285 ] Chris Fregly commented on SPARK-3639: - great catch, aniket! for some background

[jira] [Commented] (SPARK-4161) Spark shell class path is not correctly set if spark.driver.extraClassPath is set in defaults.conf

[ https://issues.apache.org/jira/browse/SPARK-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193289#comment-14193289 ] Apache Spark commented on SPARK-4161: - User 'witgo' has created a pull request for

[jira] [Commented] (SPARK-4161) Spark shell class path is not correctly set if spark.driver.extraClassPath is set in defaults.conf

[ https://issues.apache.org/jira/browse/SPARK-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193291#comment-14193291 ] Apache Spark commented on SPARK-4161: - User 'witgo' has created a pull request for

[jira] [Updated] (SPARK-4161) Spark shell class path is not correctly set if spark.driver.extraClassPath is set in defaults.conf

[ https://issues.apache.org/jira/browse/SPARK-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4161: --- Affects Version/s: 1.2.0 Spark shell class path is not correctly set if spark.driver.extraClassPath

[jira] [Updated] (SPARK-4161) Spark shell class path is not correctly set if spark.driver.extraClassPath is set in defaults.conf

[ https://issues.apache.org/jira/browse/SPARK-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-4161: --- Target Version/s: 1.1.1, 1.2.0 Spark shell class path is not correctly set if

[jira] [Created] (SPARK-4184) Improve Spark Streaming documentation

Chris Fregly created SPARK-4184: --- Summary: Improve Spark Streaming documentation Key: SPARK-4184 URL: https://issues.apache.org/jira/browse/SPARK-4184 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-4185) JSON schema inference failed when dealing with type conflicts in arrays

Yin Huai created SPARK-4185: --- Summary: JSON schema inference failed when dealing with type conflicts in arrays Key: SPARK-4185 URL: https://issues.apache.org/jira/browse/SPARK-4185 Project: Spark

[jira] [Resolved] (SPARK-2759) The ability to read binary files into Spark

[ https://issues.apache.org/jira/browse/SPARK-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-2759. -- Resolution: Fixed Fix Version/s: 1.2.0 The ability to read binary files into Spark

[jira] [Created] (SPARK-4186) Support binaryFiles and binaryRecords API in Python

Matei Zaharia created SPARK-4186: Summary: Support binaryFiles and binaryRecords API in Python Key: SPARK-4186 URL: https://issues.apache.org/jira/browse/SPARK-4186 Project: Spark Issue

[jira] [Commented] (SPARK-4186) Support binaryFiles and binaryRecords API in Python

[ https://issues.apache.org/jira/browse/SPARK-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193363#comment-14193363 ] Matei Zaharia commented on SPARK-4186: -- [~davies] it would be great if you have a

[jira] [Resolved] (SPARK-4183) Enable Netty-based BlockTransferService by default

[ https://issues.apache.org/jira/browse/SPARK-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4183. Resolution: Fixed Fix Version/s: 1.2.0 Enable Netty-based BlockTransferService by

[jira] [Commented] (SPARK-4185) JSON schema inference failed when dealing with type conflicts in arrays

[ https://issues.apache.org/jira/browse/SPARK-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193491#comment-14193491 ] William Benton commented on SPARK-4185: --- I'm actually not sure this is a bug! My

[jira] [Resolved] (SPARK-3569) Add metadata field to StructField

[ https://issues.apache.org/jira/browse/SPARK-3569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3569. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2701

[jira] [Updated] (SPARK-4187) External shuffle service should not use Java serializer

[ https://issues.apache.org/jira/browse/SPARK-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson updated SPARK-4187: -- Component/s: Spark Core Affects Version/s: 1.2.0 External shuffle service should not

[jira] [Created] (SPARK-4187) External shuffle service should not use Java serializer

Aaron Davidson created SPARK-4187: - Summary: External shuffle service should not use Java serializer Key: SPARK-4187 URL: https://issues.apache.org/jira/browse/SPARK-4187 Project: Spark

[jira] [Created] (SPARK-4188) Shuffle fetches should be retried at a lower level

Aaron Davidson created SPARK-4188: - Summary: Shuffle fetches should be retried at a lower level Key: SPARK-4188 URL: https://issues.apache.org/jira/browse/SPARK-4188 Project: Spark Issue

[jira] [Created] (SPARK-4189) FileSegmentManagedBuffer should have a configurable memory map threshold

Aaron Davidson created SPARK-4189: - Summary: FileSegmentManagedBuffer should have a configurable memory map threshold Key: SPARK-4189 URL: https://issues.apache.org/jira/browse/SPARK-4189 Project:

[jira] [Resolved] (SPARK-4037) NPE in JDBC server when calling SET

[ https://issues.apache.org/jira/browse/SPARK-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4037. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2887

[jira] [Reopened] (SPARK-4183) Enable Netty-based BlockTransferService by default

[ https://issues.apache.org/jira/browse/SPARK-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-4183: Reverted this due to a test issue - seems like some state is not getting cleaned up. Enable

[jira] [Resolved] (SPARK-4121) Master build failures after shading commons-math3

[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4121. Resolution: Fixed Okay I merged this. Let's see how it goes. Master build failures after

[jira] [Created] (SPARK-4190) Allow users to provide transformation rules at JSON ingest

William Benton created SPARK-4190: - Summary: Allow users to provide transformation rules at JSON ingest Key: SPARK-4190 URL: https://issues.apache.org/jira/browse/SPARK-4190 Project: Spark

[jira] [Commented] (SPARK-4190) Allow users to provide transformation rules at JSON ingest

[ https://issues.apache.org/jira/browse/SPARK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193573#comment-14193573 ] William Benton commented on SPARK-4190: --- I'll take this, since I'm interested in

[jira] [Resolved] (SPARK-3161) Cache example-node map for DecisionTree training

[ https://issues.apache.org/jira/browse/SPARK-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3161. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2868

[jira] [Updated] (SPARK-4156) Add expectation maximization for Gaussian mixture models to MLLib clustering

[ https://issues.apache.org/jira/browse/SPARK-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4156: - Target Version/s: 1.3.0 Add expectation maximization for Gaussian mixture models to MLLib

[jira] [Updated] (SPARK-4156) Add expectation maximization for Gaussian mixture models to MLLib clustering

[ https://issues.apache.org/jira/browse/SPARK-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4156: - Assignee: Travis Galoppo Add expectation maximization for Gaussian mixture models to MLLib

[jira] [Commented] (SPARK-4190) Allow users to provide transformation rules at JSON ingest

[ https://issues.apache.org/jira/browse/SPARK-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193598#comment-14193598 ] Yin Huai commented on SPARK-4190: - Yeah, no problem Allow users to provide

[jira] [Commented] (SPARK-4185) JSON schema inference failed when dealing with type conflicts in arrays

[ https://issues.apache.org/jira/browse/SPARK-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193617#comment-14193617 ] Apache Spark commented on SPARK-4185: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-4185) JSON schema inference failed when dealing with type conflicts in arrays

[ https://issues.apache.org/jira/browse/SPARK-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193620#comment-14193620 ] Yin Huai commented on SPARK-4185: - [~willbenton] yeah, agreed. We need to have a better

[jira] [Created] (SPARK-4191) move wrapperFor to HiveInspectors to reuse them

wangfei created SPARK-4191: -- Summary: move wrapperFor to HiveInspectors to reuse them Key: SPARK-4191 URL: https://issues.apache.org/jira/browse/SPARK-4191 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4191) move wrapperFor to HiveInspectors to reuse them

[ https://issues.apache.org/jira/browse/SPARK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193624#comment-14193624 ] Apache Spark commented on SPARK-4191: - User 'scwf' has created a pull request for this

[jira] [Updated] (SPARK-4191) move wrapperFor to HiveInspectors to reuse them

[ https://issues.apache.org/jira/browse/SPARK-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-4191: --- Issue Type: Improvement (was: Bug) move wrapperFor to HiveInspectors to reuse them

[jira] [Updated] (SPARK-4179) Streaming Linear Regression example has type mismatch

[ https://issues.apache.org/jira/browse/SPARK-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4179: - Assignee: Anant Daksh Asthana Streaming Linear Regression example has type mismatch

[jira] [Updated] (SPARK-4179) Streaming Linear Regression example has type mismatch

[ https://issues.apache.org/jira/browse/SPARK-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4179: - Target Version/s: 1.1.1, 1.2.0 (was: 1.2.0) Affects Version/s: 1.1.0 Streaming Linear

[jira] [Commented] (SPARK-4179) Streaming Linear Regression example has type mismatch

[ https://issues.apache.org/jira/browse/SPARK-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193632#comment-14193632 ] Xiangrui Meng commented on SPARK-4179: -- It should be `predictOnValues`, could you

[jira] [Updated] (SPARK-4179) Streaming Linear Regression example has type mismatch

[ https://issues.apache.org/jira/browse/SPARK-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4179: - Target Version/s: 1.2.0 Streaming Linear Regression example has type mismatch

[jira] [Created] (SPARK-4192) Support UDT in Python

Xiangrui Meng created SPARK-4192: Summary: Support UDT in Python Key: SPARK-4192 URL: https://issues.apache.org/jira/browse/SPARK-4192 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-4192) Support UDT in Python

[ https://issues.apache.org/jira/browse/SPARK-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4192: - Assignee: Xiangrui Meng Support UDT in Python - Key:

[jira] [Created] (SPARK-4193) Disable doclint in Java 8 to prevent from build error.

Takuya Ueshin created SPARK-4193: Summary: Disable doclint in Java 8 to prevent from build error. Key: SPARK-4193 URL: https://issues.apache.org/jira/browse/SPARK-4193 Project: Spark Issue

[jira] [Commented] (SPARK-4193) Disable doclint in Java 8 to prevent from build error.

[ https://issues.apache.org/jira/browse/SPARK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193655#comment-14193655 ] Apache Spark commented on SPARK-4193: - User 'ueshin' has created a pull request for

[jira] [Resolved] (SPARK-3930) Add precision and scale to Spark SQL's Decimal type

[ https://issues.apache.org/jira/browse/SPARK-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3930. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2983

[jira] [Resolved] (SPARK-3933) Optimize decimal type in Spark SQL for those with small precision

[ https://issues.apache.org/jira/browse/SPARK-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3933. - Resolution: Fixed Optimize decimal type in Spark SQL for those with small precision

[jira] [Resolved] (SPARK-3932) Support reading fixed-precision decimals from Hive 0.13

[ https://issues.apache.org/jira/browse/SPARK-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-3932. -- Resolution: Fixed Fix Version/s: 1.2.0 Done in https://github.com/apache/spark/pull/2983

[jira] [Commented] (SPARK-3931) Support reading fixed-precision decimals from Parquet

[ https://issues.apache.org/jira/browse/SPARK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193666#comment-14193666 ] Matei Zaharia commented on SPARK-3931: -- Done in

[jira] [Resolved] (SPARK-3931) Support reading fixed-precision decimals from Parquet

[ https://issues.apache.org/jira/browse/SPARK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-3931. -- Resolution: Fixed Fix Version/s: 1.2.0 Support reading fixed-precision decimals from

[jira] [Resolved] (SPARK-3929) Support for fixed-precision decimal

[ https://issues.apache.org/jira/browse/SPARK-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-3929. -- Resolution: Fixed Fix Version/s: 1.2.0 Support for fixed-precision decimal

[jira] [Updated] (SPARK-4182) Caching tables containing boolean, binary, array, struct and/or map columns doesn't work

[ https://issues.apache.org/jira/browse/SPARK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-4182: -- Description: If a table contains a column whose type is binary, array, struct, map, and for some

[jira] [Updated] (SPARK-4182) Caching tables containing boolean, binary, array, struct and/or map columns doesn't work

[ https://issues.apache.org/jira/browse/SPARK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-4182: -- Description: If a table contains a column whose type is binary, array, struct, map, and for some

[jira] [Updated] (SPARK-4182) Caching tables containing boolean, binary, array, struct and/or map columns doesn't work

[ https://issues.apache.org/jira/browse/SPARK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-4182: -- Description: If a table contains a column whose type is binary, array, struct, map, and for some

[jira] [Updated] (SPARK-4182) Caching tables containing boolean, binary, array, struct and/or map columns doesn't work

[ https://issues.apache.org/jira/browse/SPARK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-4182: -- Description: If a table contains a column whose type is binary, array, struct, map, and for some