[jira] [Resolved] (SPARK-3886) Choose the batch size of serializer based on size of object

[ https://issues.apache.org/jira/browse/SPARK-3886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3886. --- Resolution: Fixed > Choose the batch size of serializer based on size of object >

[jira] [Resolved] (SPARK-3573) Dataset

[ https://issues.apache.org/jira/browse/SPARK-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3573. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3070 [https://githu

[jira] [Commented] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195724#comment-14195724 ] Nicholas Chammas commented on SPARK-4216: - Ah, well, I called them according to wh

[jira] [Updated] (SPARK-3954) source code optimization

[ https://issues.apache.org/jira/browse/SPARK-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 宿荣全 updated SPARK-3954: --- Description: about convert files to RDDS there are 3 loops with files sequence in spark source. loops files sequence:

[jira] [Updated] (SPARK-3954) source code optimization

[ https://issues.apache.org/jira/browse/SPARK-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 宿荣全 updated SPARK-3954: --- Summary: source code optimization (was: Optimization to FileInputDStream) > source code optimization > --

[jira] [Updated] (SPARK-3954) Optimization to FileInputDStream

[ https://issues.apache.org/jira/browse/SPARK-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 宿荣全 updated SPARK-3954: --- Description: about convert files to RDDS there are 3 loops with files sequence in spark source. loops files sequence:

[jira] [Commented] (SPARK-2624) Datanucleus jars not accessible in yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195712#comment-14195712 ] Jim Lim commented on SPARK-2624: Allow me to take a crack at this. > Datanucleus jars not

[jira] [Commented] (SPARK-4165) Using Companion Objects throws ambiguous reference error in REPL when an instance of Class is initialized

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195713#comment-14195713 ] Apache Spark commented on SPARK-4165: - User 'ScrapCodes' has created a pull request fo

[jira] [Commented] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195711#comment-14195711 ] shane knapp commented on SPARK-4216: actually, you got the 'real' and 'impostor' jenki

[jira] [Resolved] (SPARK-4192) Support UDT in Python

[ https://issues.apache.org/jira/browse/SPARK-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4192. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3068 [https://githu

[jira] [Updated] (SPARK-4217) Result of SparkSQL is incorrect after a table join and group by operation

[ https://issues.apache.org/jira/browse/SPARK-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peter.zhang updated SPARK-4217: --- Description: I runed a test using same SQL script in SparkSQL, Shark and Hive environment as below --

[jira] [Updated] (SPARK-4217) Result of SparkSQL is incorrect after a table join and group by operation

[ https://issues.apache.org/jira/browse/SPARK-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peter.zhang updated SPARK-4217: --- Attachment: saledata.zip TestScript.sql > Result of SparkSQL is incorrect after a tabl

[jira] [Created] (SPARK-4217) Result of SparkSQL is incorrect after a table join and group by operation

peter.zhang created SPARK-4217: -- Summary: Result of SparkSQL is incorrect after a table join and group by operation Key: SPARK-4217 URL: https://issues.apache.org/jira/browse/SPARK-4217 Project: Spark

[jira] [Updated] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2938: - Affects Version/s: 1.1.0 > Support SASL authentication in Netty network module > -

[jira] [Updated] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2938: - Affects Version/s: (was: 1.1.0) 1.2.0 > Support SASL authentication in Netty ne

[jira] [Updated] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2938: - Target Version/s: 1.2.0 > Support SASL authentication in Netty network module > --

[jira] [Commented] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195599#comment-14195599 ] Apache Spark commented on SPARK-2938: - User 'aarondav' has created a pull request for

[jira] [Updated] (SPARK-611) Allow JStack to be run from web UI

[ https://issues.apache.org/jira/browse/SPARK-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-611: Affects Version/s: 1.0.0 > Allow JStack to be run from web UI > -- > >

[jira] [Closed] (SPARK-611) Allow JStack to be run from web UI

[ https://issues.apache.org/jira/browse/SPARK-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-611. --- Resolution: Fixed Fix Version/s: 1.2.0 > Allow JStack to be run from web UI > --

[jira] [Commented] (SPARK-4163) When fetching blocks unsuccessfully, Web UI only displays "Fetch failure"

[ https://issues.apache.org/jira/browse/SPARK-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195575#comment-14195575 ] Apache Spark commented on SPARK-4163: - User 'zsxwing' has created a pull request for t

[jira] [Commented] (SPARK-4210) Add Extra-Trees algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195552#comment-14195552 ] Joseph K. Bradley commented on SPARK-4210: -- [~0asa] For the API, do you plan for

[jira] [Commented] (SPARK-4166) Display the executor ID in the Web UI when ExecutorLostFailure happens

[ https://issues.apache.org/jira/browse/SPARK-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195542#comment-14195542 ] Apache Spark commented on SPARK-4166: - User 'zsxwing' has created a pull request for t

[jira] [Commented] (SPARK-4216) Eliminate Jenkins GitHub posts from AMPLab

[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195482#comment-14195482 ] Nicholas Chammas commented on SPARK-4216: - cc [~shaneknapp] [~joshrosen] > Elimin

[jira] [Updated] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4216: Summary: Eliminate duplicate Jenkins GitHub posts from AMPLab (was: Eliminate Jenkins GitHu

[jira] [Created] (SPARK-4216) Eliminate Jenkins GitHub posts from AMPLab

Nicholas Chammas created SPARK-4216: --- Summary: Eliminate Jenkins GitHub posts from AMPLab Key: SPARK-4216 URL: https://issues.apache.org/jira/browse/SPARK-4216 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-4213) SparkSQL - ParquetFilters - No support for LT, LTE, GT, GTE operators

[ https://issues.apache.org/jira/browse/SPARK-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195480#comment-14195480 ] Apache Spark commented on SPARK-4213: - User 'sarutak' has created a pull request for t

[jira] [Updated] (SPARK-4215) Allow requesting executors only on Yarn (for now)

[ https://issues.apache.org/jira/browse/SPARK-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4215: - Description: Currently if the user attempts to call `sc.requestExecutors` or enables dynamic allocation on

[jira] [Created] (SPARK-4215) Allow requesting executors only on Yarn (for now)

Andrew Or created SPARK-4215: Summary: Allow requesting executors only on Yarn (for now) Key: SPARK-4215 URL: https://issues.apache.org/jira/browse/SPARK-4215 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3797) Run the shuffle service inside the YARN NodeManager as an AuxiliaryService

[ https://issues.apache.org/jira/browse/SPARK-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195466#comment-14195466 ] Apache Spark commented on SPARK-3797: - User 'andrewor14' has created a pull request fo

[jira] [Updated] (SPARK-3797) Run the shuffle service inside the YARN NodeManager as an AuxiliaryService

[ https://issues.apache.org/jira/browse/SPARK-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3797: - Affects Version/s: 1.1.0 > Run the shuffle service inside the YARN NodeManager as an AuxiliaryService > --

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195427#comment-14195427 ] Zhan Zhang commented on SPARK-2883: --- [~neoword] , As [~marmbrus] mentioned, the PR need

[jira] [Commented] (SPARK-3720) support ORC in spark sql

[ https://issues.apache.org/jira/browse/SPARK-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195402#comment-14195402 ] Zhan Zhang commented on SPARK-3720: --- [~neoword] wangfei and me are working together to s

[jira] [Created] (SPARK-4214) With dynamic allocation, avoid outstanding requests for more executors than pending tasks need

Sandy Ryza created SPARK-4214: - Summary: With dynamic allocation, avoid outstanding requests for more executors than pending tasks need Key: SPARK-4214 URL: https://issues.apache.org/jira/browse/SPARK-4214

[jira] [Resolved] (SPARK-4178) Hadoop input metrics ignore bytes read in RecordReader instantiation

[ https://issues.apache.org/jira/browse/SPARK-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4178. Resolution: Fixed Assignee: Sandy Ryza > Hadoop input metrics ignore bytes read in Rec

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195308#comment-14195308 ] Michael Armbrust commented on SPARK-2883: - The merge deadline for 1.2.0 was on Sat

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195301#comment-14195301 ] René X Parra commented on SPARK-2883: - [~marmbrus] I see this was changed from Version

[jira] [Updated] (SPARK-2863) Emulate Hive type coercion in native reimplementations of Hive functions

[ https://issues.apache.org/jira/browse/SPARK-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2863: Target Version/s: 1.3.0 (was: 1.2.0) > Emulate Hive type coercion in native reimplementatio

[jira] [Commented] (SPARK-4133) PARSING_ERROR(2) when upgrading issues from 1.0.2 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195294#comment-14195294 ] Josh Rosen commented on SPARK-4133: --- Do you happen to be creating multiple running Spark

[jira] [Updated] (SPARK-2870) Thorough schema inference directly on RDDs of Python dictionaries

[ https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2870: Target Version/s: 1.3.0 (was: 1.2.0) > Thorough schema inference directly on RDDs of Python

[jira] [Resolved] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2360. - Resolution: Won't Fix Hey Hossein, I'm going to close this since I think we have decided t

[jira] [Commented] (SPARK-3720) support ORC in spark sql

[ https://issues.apache.org/jira/browse/SPARK-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195287#comment-14195287 ] René X Parra commented on SPARK-3720: - [~zhazhan] should this JIRA ticket be closed (m

[jira] [Updated] (SPARK-2775) HiveContext does not support dots in column names.

[ https://issues.apache.org/jira/browse/SPARK-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2775: Target Version/s: 1.3.0 (was: 1.2.0) > HiveContext does not support dots in column names.

[jira] [Resolved] (SPARK-2902) Change default options to be more agressive

[ https://issues.apache.org/jira/browse/SPARK-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2902. - Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Michael Armbrust (was: Ch

[jira] [Updated] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard-coded case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2710: Target Version/s: 1.3.0 (was: 1.2.0) > Build SchemaRDD from a JdbcRDD with MetaData (no har

[jira] [Commented] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard-coded case class)

[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195240#comment-14195240 ] Michael Armbrust commented on SPARK-2710: - Now that its been merged, it would be g

[jira] [Updated] (SPARK-3440) HiveServer2 and CLI should retrieve Hive result set schema

[ https://issues.apache.org/jira/browse/SPARK-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3440: Target Version/s: 1.3.0 (was: 1.2.0) > HiveServer2 and CLI should retrieve Hive result set

[jira] [Updated] (SPARK-3575) Hive Schema is ignored when using convertMetastoreParquet

[ https://issues.apache.org/jira/browse/SPARK-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3575: Target Version/s: 1.2.0 (was: 1.3.0) > Hive Schema is ignored when using convertMetastorePa

[jira] [Updated] (SPARK-3575) Hive Schema is ignored when using convertMetastoreParquet

[ https://issues.apache.org/jira/browse/SPARK-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3575: Target Version/s: 1.3.0 (was: 1.2.0) > Hive Schema is ignored when using convertMetastorePa

[jira] [Updated] (SPARK-3575) Hive Schema is ignored when using convertMetastoreParquet

[ https://issues.apache.org/jira/browse/SPARK-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3575: Priority: Critical (was: Major) > Hive Schema is ignored when using convertMetastoreParquet

[jira] [Resolved] (SPARK-3618) Store analyzed plans for temp tables

[ https://issues.apache.org/jira/browse/SPARK-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3618. - Resolution: Fixed Fix Version/s: 1.2.0 This was done as part of the caching overhau

[jira] [Assigned] (SPARK-3618) Store analyzed plans for temp tables

[ https://issues.apache.org/jira/browse/SPARK-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-3618: --- Assignee: Michael Armbrust > Store analyzed plans for temp tables > -

[jira] [Updated] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2883: Target Version/s: 1.3.0 (was: 1.2.0) > Spark Support for ORCFile format > -

[jira] [Updated] (SPARK-3267) Deadlock between ScalaReflectionLock and Data type initialization

[ https://issues.apache.org/jira/browse/SPARK-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3267: Target Version/s: 1.3.0 (was: 1.2.0) > Deadlock between ScalaReflectionLock and Data type i

[jira] [Resolved] (SPARK-3248) Hooks for adding strategies to the planner

[ https://issues.apache.org/jira/browse/SPARK-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3248. - Resolution: Fixed Fix Version/s: 1.2.0 This was done in the Data Sources API PR: h

[jira] [Resolved] (SPARK-3238) Commas/spaces/dashes are not escaped properly when transferring schema information to parquet readers

[ https://issues.apache.org/jira/browse/SPARK-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3238. - Resolution: Fixed Assignee: Cheng Lian I think this was fixed by the conversion to J

[jira] [Updated] (SPARK-4213) SparkSQL - ParquetFilters - No support for LT, LTE, GT, GTE operators

[ https://issues.apache.org/jira/browse/SPARK-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4213: Priority: Blocker (was: Major) > SparkSQL - ParquetFilters - No support for LT, LTE, GT, GT

[jira] [Created] (SPARK-4213) SparkSQL - ParquetFilters - No support for LT, LTE, GT, GTE operators

Terry Siu created SPARK-4213: Summary: SparkSQL - ParquetFilters - No support for LT, LTE, GT, GTE operators Key: SPARK-4213 URL: https://issues.apache.org/jira/browse/SPARK-4213 Project: Spark

[jira] [Resolved] (SPARK-4152) Avoid data change in CTAS while table already existed

[ https://issues.apache.org/jira/browse/SPARK-4152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4152. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3013 [https:/

[jira] [Commented] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195168#comment-14195168 ] Apache Spark commented on SPARK-1021: - User 'erikerlandson' has created a pull request

[jira] [Commented] (SPARK-3146) Improve the flexibility of Spark Streaming Kafka API to offer user the ability to process message before storing into BM

[ https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195146#comment-14195146 ] Cody Koeninger commented on SPARK-3146: --- I think this PR is an elegant way to solve

[jira] [Commented] (SPARK-4210) Add Extra-Trees algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195108#comment-14195108 ] Manish Amde commented on SPARK-4210: [~0asa] Thanks for the creating the JIRA. >From

[jira] [Resolved] (SPARK-3594) try more rows during inferSchema

[ https://issues.apache.org/jira/browse/SPARK-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3594. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2716 [https:/

[jira] [Resolved] (SPARK-4207) Query which has syntax like 'not like' is not working in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4207. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3075 [https:/

[jira] [Updated] (SPARK-3541) Improve ALS internal storage

[ https://issues.apache.org/jira/browse/SPARK-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3541: - Target Version/s: 1.3.0 (was: 1.2.0) > Improve ALS internal storage > ---

[jira] [Resolved] (SPARK-4211) Spark POM hive-0.13.1 profile sets incorrect hive version property

[ https://issues.apache.org/jira/browse/SPARK-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4211. - Resolution: Fixed Issue resolved by pull request 3072 [https://github.com/apache/spark/pul

[jira] [Commented] (SPARK-975) Spark Replay Debugger

[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195059#comment-14195059 ] Apache Spark commented on SPARK-975: User 'dnprock' has created a pull request for this

[jira] [Commented] (SPARK-4186) Support binaryFiles and binaryRecords API in Python

[ https://issues.apache.org/jira/browse/SPARK-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195054#comment-14195054 ] Apache Spark commented on SPARK-4186: - User 'davies' has created a pull request for th

[jira] [Created] (SPARK-4212) Actor not found

Davies Liu created SPARK-4212: - Summary: Actor not found Key: SPARK-4212 URL: https://issues.apache.org/jira/browse/SPARK-4212 Project: Spark Issue Type: Bug Components: Spark Core

[jira] [Commented] (SPARK-4199) Drop table if exists raises "table not found" exception in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195045#comment-14195045 ] Jianshi Huang commented on SPARK-4199: -- Turned out it was caused by wrong version of

[jira] [Closed] (SPARK-4199) Drop table if exists raises "table not found" exception in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianshi Huang closed SPARK-4199. Resolution: Invalid > Drop table if exists raises "table not found" exception in HiveContext > -

[jira] [Updated] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2938: --- Priority: Blocker (was: Major) > Support SASL authentication in Netty network module > --

[jira] [Commented] (SPARK-4211) Spark POM hive-0.13.1 profile sets incorrect hive version property

[ https://issues.apache.org/jira/browse/SPARK-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194973#comment-14194973 ] Apache Spark commented on SPARK-4211: - User 'coderfi' has created a pull request for t

[jira] [Updated] (SPARK-4211) Spark POM hive-0.13.1 profile sets incorrect hive version property

[ https://issues.apache.org/jira/browse/SPARK-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fi updated SPARK-4211: -- Fix Version/s: 1.2.0 > Spark POM hive-0.13.1 profile sets incorrect hive version property >

[jira] [Created] (SPARK-4211) Spark POM hive-0.13.1 profile sets incorrect hive version property

Fi created SPARK-4211: - Summary: Spark POM hive-0.13.1 profile sets incorrect hive version property Key: SPARK-4211 URL: https://issues.apache.org/jira/browse/SPARK-4211 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-1070) Add check for JIRA ticket in the Github pull request title/summary with CI

[ https://issues.apache.org/jira/browse/SPARK-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194961#comment-14194961 ] Henry Saputra commented on SPARK-1070: -- [~nchammas], way back when Patrick propose th

[jira] [Commented] (SPARK-1070) Add check for JIRA ticket in the Github pull request title/summary with CI

[ https://issues.apache.org/jira/browse/SPARK-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194952#comment-14194952 ] Nicholas Chammas commented on SPARK-1070: - [~hsaputra] - The [Spark PR Board | htt

[jira] [Commented] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194944#comment-14194944 ] Reynold Xin commented on SPARK-2938: I think we are still going to add it to 1.2 (assu

[jira] [Updated] (SPARK-2938) Support SASL authentication in Netty network module

[ https://issues.apache.org/jira/browse/SPARK-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2938: --- Assignee: Aaron Davidson > Support SASL authentication in Netty network module > -

[jira] [Updated] (SPARK-2426) Quadratic Minimization for MLlib ALS

[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das updated SPARK-2426: Affects Version/s: (was: 1.2.0) 1.3.0 > Quadratic Minimization for MLlib

[jira] [Updated] (SPARK-2426) Quadratic Minimization for MLlib ALS

[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das updated SPARK-2426: Affects Version/s: (was: 1.0.0) 1.2.0 > Quadratic Minimization for MLlib

[jira] [Created] (SPARK-4210) Add Extra-Trees algorithm to MLlib

Vincent Botta created SPARK-4210: Summary: Add Extra-Trees algorithm to MLlib Key: SPARK-4210 URL: https://issues.apache.org/jira/browse/SPARK-4210 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-4201) Can't use concat() on partition column in where condition (Hive compatibility problem)

[ https://issues.apache.org/jira/browse/SPARK-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194847#comment-14194847 ] Venkata Ramana G commented on SPARK-4201: - I found the same is working on latest m

[jira] [Commented] (SPARK-4203) Partition directories in random order when inserting into hive table

[ https://issues.apache.org/jira/browse/SPARK-4203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194843#comment-14194843 ] Apache Spark commented on SPARK-4203: - User 'tbfenet' has created a pull request for t

[jira] [Commented] (SPARK-4206) BlockManager warnings in local mode: "Block $blockId already exists on this machine; not re-adding it

[ https://issues.apache.org/jira/browse/SPARK-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194793#comment-14194793 ] Imran Rashid commented on SPARK-4206: - a little more confirmation: If I change this li

[jira] [Created] (SPARK-4209) Support UDT in UDF

Xiangrui Meng created SPARK-4209: Summary: Support UDT in UDF Key: SPARK-4209 URL: https://issues.apache.org/jira/browse/SPARK-4209 Project: Spark Issue Type: New Feature Components

[jira] [Commented] (SPARK-4205) Timestamp and Date objects with comparison operators

[ https://issues.apache.org/jira/browse/SPARK-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194777#comment-14194777 ] Apache Spark commented on SPARK-4205: - User 'culler' has created a pull request for th

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194717#comment-14194717 ] Tom Arnfeld commented on SPARK-2691: Thanks Chris, this is really useful. Regarding r

[jira] [Commented] (SPARK-4207) Query which has syntax like 'not like' is not working in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194714#comment-14194714 ] Apache Spark commented on SPARK-4207: - User 'ravipesala' has created a pull request fo

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194679#comment-14194679 ] Chris Heller commented on SPARK-2691: - Ok here is the patch as a PR: https://github.co

[jira] [Created] (SPARK-4208) stack over flow error while using sqlContext.sql

milq created SPARK-4208: --- Summary: stack over flow error while using sqlContext.sql Key: SPARK-4208 URL: https://issues.apache.org/jira/browse/SPARK-4208 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194669#comment-14194669 ] Eduardo Jimenez commented on SPARK-2691: I would also say don't only support Docke

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194655#comment-14194655 ] Eduardo Jimenez commented on SPARK-2691: Go for it. It would be helpful if most of

[jira] [Comment Edited] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194646#comment-14194646 ] Tom Arnfeld edited comment on SPARK-2691 at 11/3/14 3:56 PM: -

[jira] [Comment Edited] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194634#comment-14194634 ] Tom Arnfeld edited comment on SPARK-2691 at 11/3/14 3:57 PM: -

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194649#comment-14194649 ] Tom Arnfeld commented on SPARK-2691: Also [~ChrisHeller] if you're not shipping spark

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194646#comment-14194646 ] Tom Arnfeld commented on SPARK-2691: Awesome. We're keen to get spark up and running o

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194637#comment-14194637 ] Chris Heller commented on SPARK-2691: - +1 on passing in environment. great idea. Ther

[jira] [Comment Edited] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194634#comment-14194634 ] Tom Arnfeld edited comment on SPARK-2691 at 11/3/14 3:42 PM: -

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194634#comment-14194634 ] Tom Arnfeld commented on SPARK-2691: Thanks so much for the patches here [~ChrisHeller

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194632#comment-14194632 ] Chris Heller commented on SPARK-2691: - That seems reasonable. In fact, the volumes fie

  1   2   >