[jira] [Commented] (SPARK-11464) Flaky test: Streaming CheckpointSuite

2015-12-07 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045767#comment-15045767 ] Rekha Joshi commented on SPARK-11464: - Hi [~kayousterhout] - I am on 1.6.0-SNAPSHOT

[jira] [Resolved] (SPARK-11464) Flaky test: Streaming CheckpointSuite

2015-12-07 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-11464. Resolution: Cannot Reproduce I'm going to close this -- I saw it on Jenkins a while ago (no

[jira] [Issue Comment Deleted] (SPARK-6725) Model export/import for Pipeline API

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6725: - Comment: was deleted (was: User 'anabranch' has created a pull request for this issue: htt

[jira] [Commented] (SPARK-6725) Model export/import for Pipeline API

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045801#comment-15045801 ] Apache Spark commented on SPARK-6725: - User 'anabranch' has created a pull request for

[jira] [Created] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-07 Thread Rohit Agarwal (JIRA)
Rohit Agarwal created SPARK-12186: - Summary: stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server Key: SPARK-12186 URL: https://issu

[jira] [Commented] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045897#comment-15045897 ] Apache Spark commented on SPARK-12186: -- User 'mindprince' has created a pull request

[jira] [Assigned] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12186: Assignee: (was: Apache Spark) > stage web URI will redirect to the wrong location if i

[jira] [Assigned] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12186: Assignee: Apache Spark > stage web URI will redirect to the wrong location if it is the fi

[jira] [Resolved] (SPARK-11884) Drop multiple columns in the DataFrame API

2015-12-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11884. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9862 [http

[jira] [Updated] (SPARK-12184) Make python api doc for pivot consistant with scala doc

2015-12-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12184: - Assignee: Andrew Ray > Make python api doc for pivot consistant with scala doc >

[jira] [Resolved] (SPARK-12184) Make python api doc for pivot consistant with scala doc

2015-12-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12184. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10176 [https://github.com/

[jira] [Commented] (SPARK-12181) Check Cached unaligned-access capability before using Unsafe

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045957#comment-15045957 ] Apache Spark commented on SPARK-12181: -- User 'ted-yu' has created a pull request for

[jira] [Commented] (SPARK-9502) ArrayTypes incorrect for DataFrames Java API

2015-12-07 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045984#comment-15045984 ] Jakob Odersky commented on SPARK-9502: -- Not sure if this is actually an error. As I s

[jira] [Commented] (SPARK-11046) Pass schema from R to JVM using JSON format

2015-12-07 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046004#comment-15046004 ] Nakul Jindal commented on SPARK-11046: -- [~shivaram], [~sunrui] - Is it ok to depend

[jira] [Created] (SPARK-12187) *MemoryPool classes should not be public

2015-12-07 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12187: - Summary: *MemoryPool classes should not be public Key: SPARK-12187 URL: https://issues.apache.org/jira/browse/SPARK-12187 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046014#comment-15046014 ] Davies Liu commented on SPARK-12179: This may be related to https://issues.apache.org

[jira] [Updated] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12179: --- Priority: Critical (was: Minor) > Spark SQL get different result with the same code > --

[jira] [Updated] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11605: -- Shepherd: Joseph K. Bradley > ML 1.6 QA: API: Java compatibility, docs > --

[jira] [Assigned] (SPARK-12187) *MemoryPool classes should not be public

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12187: Assignee: Apache Spark (was: Andrew Or) > *MemoryPool classes should not be public >

[jira] [Commented] (SPARK-12187) *MemoryPool classes should not be public

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046020#comment-15046020 ] Apache Spark commented on SPARK-12187: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-12187) *MemoryPool classes should not be public

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12187: Assignee: Andrew Or (was: Apache Spark) > *MemoryPool classes should not be public >

[jira] [Updated] (SPARK-11319) PySpark silently accepts null values in non-nullable DataFrame fields.

2015-12-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11319: Summary: PySpark silently accepts null values in non-nullable DataFrame fields. (was: PySpark sile

[jira] [Commented] (SPARK-12045) Use joda's DateTime to replace Calendar

2015-12-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046056#comment-15046056 ] Jeff Zhang commented on SPARK-12045: bq. Our general policy for exceptions is that we

[jira] [Updated] (SPARK-12160) spark.mllib should use SQLContext.getOrCreate

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12160: -- Fix Version/s: 1.6.1 > spark.mllib should use SQLContext.getOrCreate >

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046079#comment-15046079 ] Jean-Baptiste Onofré commented on SPARK-11193: -- I'm adding a test in KryoSer

[jira] [Commented] (SPARK-12160) spark.mllib should use SQLContext.getOrCreate

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046089#comment-15046089 ] Apache Spark commented on SPARK-12160: -- User 'jkbradley' has created a pull request

[jira] [Commented] (SPARK-12183) Remove spark.mllib tree, forest implementations and use spark.ml

2015-12-07 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046094#comment-15046094 ] Seth Hendrickson commented on SPARK-12183: -- Do you mean these are lower priority

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Commented] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046162#comment-15046162 ] Yuhang Chen commented on SPARK-12176: - I modified the descriptions, hope I've made my

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Updated] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12159: -- Assignee: Benjamin Fradet > Add user guide section for IndexToString transformer >

[jira] [Updated] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12159: -- Shepherd: Joseph K. Bradley > Add user guide section for IndexToString transformer > --

[jira] [Updated] (SPARK-10299) word2vec should allow users to specify the window size

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10299: -- Assignee: holdenk > word2vec should allow users to specify the window size > --

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Created] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

2015-12-07 Thread Xiao Li (JIRA)
Xiao Li created SPARK-12188: --- Summary: [SQL] Code refactoring and comment correction in Dataset APIs Key: SPARK-12188 URL: https://issues.apache.org/jira/browse/SPARK-12188 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12188: Assignee: (was: Apache Spark) > [SQL] Code refactoring and comment correction in Datas

[jira] [Commented] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046196#comment-15046196 ] Apache Spark commented on SPARK-12188: -- User 'gatorsmile' has created a pull request

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Assigned] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12188: Assignee: Apache Spark > [SQL] Code refactoring and comment correction in Dataset APIs > -

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Commented] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046205#comment-15046205 ] Marcelo Vanzin commented on SPARK-12176: As I tried to explain, you need to show

[jira] [Created] (SPARK-12189) UnifiedMemoryManager double counts storage memory freed

2015-12-07 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12189: - Summary: UnifiedMemoryManager double counts storage memory freed Key: SPARK-12189 URL: https://issues.apache.org/jira/browse/SPARK-12189 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12189) UnifiedMemoryManager double counts storage memory freed

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12189: Assignee: Apache Spark (was: Josh Rosen) > UnifiedMemoryManager double counts storage mem

[jira] [Commented] (SPARK-12189) UnifiedMemoryManager double counts storage memory freed

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046236#comment-15046236 ] Apache Spark commented on SPARK-12189: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-12189) UnifiedMemoryManager double counts storage memory freed

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12189: Assignee: Josh Rosen (was: Apache Spark) > UnifiedMemoryManager double counts storage mem

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046238#comment-15046238 ] Tao Li commented on SPARK-12179: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SP

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046240#comment-15046240 ] Tao Li commented on SPARK-12179: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SP

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046239#comment-15046239 ] Tao Li commented on SPARK-12179: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SP

[jira] [Issue Comment Deleted] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-12179: --- Comment: was deleted (was: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SPARK-11009 is already fixe

[jira] [Issue Comment Deleted] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-12179: --- Comment: was deleted (was: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SPARK-11009 is already fixe

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046243#comment-15046243 ] Tao Li commented on SPARK-12179: I see there was some exceptions in my executors stderr l

[jira] [Comment Edited] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046243#comment-15046243 ] Tao Li edited comment on SPARK-12179 at 12/8/15 3:00 AM: - I see t

[jira] [Created] (SPARK-12190) spark does not star cleanly windows 7 64 bit

2015-12-07 Thread stefan (JIRA)
stefan created SPARK-12190: -- Summary: spark does not star cleanly windows 7 64 bit Key: SPARK-12190 URL: https://issues.apache.org/jira/browse/SPARK-12190 Project: Spark Issue Type: Bug Co

[jira] [Issue Comment Deleted] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-12179: --- Comment: was deleted (was: I see there was some exceptions in my executors stderr log: 15/12/08 00:47:44 INF

[jira] [Commented] (SPARK-10802) Let ALS recommend for subset of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046264#comment-15046264 ] jinglei.chen commented on SPARK-10802: -- recommendProductsForUsers(num: Int): RDD[(In

[jira] [Updated] (SPARK-12190) spark does not star cleanly windows 7 64 bit

2015-12-07 Thread stefan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stefan updated SPARK-12190: --- Description: See environment description above for all my PATH info and ENV variables. Hadoop is not compiled

[jira] [Commented] (SPARK-11977) Support accessing a DataFrame column using its name without backticks if the name contains special character

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046267#comment-15046267 ] Yanbo Liang commented on SPARK-11977: - I think the check for interfere with the exist

[jira] [Commented] (SPARK-11046) Pass schema from R to JVM using JSON format

2015-12-07 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046269#comment-15046269 ] Nakul Jindal commented on SPARK-11046: -- I am trying to understand the benefit of doi

[jira] [Created] (SPARK-12191) Support "." character in DataFrame column name for ML

2015-12-07 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12191: --- Summary: Support "." character in DataFrame column name for ML Key: SPARK-12191 URL: https://issues.apache.org/jira/browse/SPARK-12191 Project: Spark Issue Typ

[jira] [Created] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
jinglei.chen created SPARK-12192: Summary: recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data Key: SPARK-12192 URL: https://issues.apache.org/jira/bro

[jira] [Updated] (SPARK-12191) Support "." character in DataFrame column name for ML

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12191: Description: Currently if you specify the inputCol/outputCol with names which include dot, it will

[jira] [Commented] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046278#comment-15046278 ] jinglei.chen commented on SPARK-12192: -- recommendProductsForUsers(num: Int) can run

[jira] [Comment Edited] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046278#comment-15046278 ] jinglei.chen edited comment on SPARK-12192 at 12/8/15 3:33 AM:

[jira] [Updated] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinglei.chen updated SPARK-12192: - Description: recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wr

[jira] [Updated] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinglei.chen updated SPARK-12192: - Description: recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wr

[jira] [Assigned] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12136: Assignee: (was: Apache Spark) > rddToFileName does not properly handle prefix and suff

[jira] [Assigned] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12136: Assignee: Apache Spark > rddToFileName does not properly handle prefix and suffix paramete

[jira] [Commented] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046290#comment-15046290 ] Apache Spark commented on SPARK-12136: -- User 'bomeng' has created a pull request for

[jira] [Closed] (SPARK-11987) Python API update for ChiSqSelector and QuantileDiscretizer

2015-12-07 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin closed SPARK-11987. - Resolution: Duplicate > Python API update for ChiSqSelector and QuantileDiscretizer > ---

[jira] [Comment Edited] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046278#comment-15046278 ] jinglei.chen edited comment on SPARK-12192 at 12/8/15 3:49 AM:

[jira] [Assigned] (SPARK-11923) Python API for ml.feature.ChiSqSelector

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11923: Assignee: Apache Spark > Python API for ml.feature.ChiSqSelector > ---

[jira] [Assigned] (SPARK-11923) Python API for ml.feature.ChiSqSelector

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11923: Assignee: (was: Apache Spark) > Python API for ml.feature.ChiSqSelector >

[jira] [Commented] (SPARK-11923) Python API for ml.feature.ChiSqSelector

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046301#comment-15046301 ] Apache Spark commented on SPARK-11923: -- User 'yinxusen' has created a pull request f

[jira] [Commented] (SPARK-12144) Implement DataFrameReader and DataFrameWriter API in SparkR

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046311#comment-15046311 ] Yanbo Liang commented on SPARK-12144: - I'm working on SPARK-12146 which is similar wi

[jira] [Created] (SPARK-12193) Spark-Submit from node.js and call the process

2015-12-07 Thread himanshu singhal (JIRA)
himanshu singhal created SPARK-12193: Summary: Spark-Submit from node.js and call the process Key: SPARK-12193 URL: https://issues.apache.org/jira/browse/SPARK-12193 Project: Spark Issue

[jira] [Updated] (SPARK-12190) spark does not start cleanly windows 7 64 bit

2015-12-07 Thread stefan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stefan updated SPARK-12190: --- Summary: spark does not start cleanly windows 7 64 bit (was: spark does not star cleanly windows 7 64 bit)

[jira] [Created] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Kapil Singh (JIRA)
Kapil Singh created SPARK-12194: --- Summary: Add Sink for reporting Spark Metrics to OpenTSDB Key: SPARK-12194 URL: https://issues.apache.org/jira/browse/SPARK-12194 Project: Spark Issue Type: Ne

[jira] [Commented] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Kapil Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046331#comment-15046331 ] Kapil Singh commented on SPARK-12194: - I'm working on this. > Add Sink for reporting

[jira] [Assigned] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12194: Assignee: (was: Apache Spark) > Add Sink for reporting Spark Metrics to OpenTSDB > ---

[jira] [Commented] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046359#comment-15046359 ] Apache Spark commented on SPARK-12194: -- User 'kapilsingh5050' has created a pull req

[jira] [Assigned] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12194: Assignee: Apache Spark > Add Sink for reporting Spark Metrics to OpenTSDB > --

[jira] [Created] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

2015-12-07 Thread Xiao Li (JIRA)
Xiao Li created SPARK-12195: --- Summary: Adding BigDecimal, Date and Timestamp into Encoder Key: SPARK-12195 URL: https://issues.apache.org/jira/browse/SPARK-12195 Project: Spark Issue Type: Improvem

[jira] [Assigned] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12195: Assignee: (was: Apache Spark) > Adding BigDecimal, Date and Timestamp into Encoder > -

[jira] [Assigned] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12195: Assignee: Apache Spark > Adding BigDecimal, Date and Timestamp into Encoder >

[jira] [Commented] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046365#comment-15046365 ] Apache Spark commented on SPARK-12195: -- User 'gatorsmile' has created a pull request

[jira] [Updated] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12172: - Summary: Consider removing SparkR internal RDD APIs (was: Remove SparkR internal RDD APIs) > Co

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046369#comment-15046369 ] Felix Cheung commented on SPARK-12172: -- Sure. What are the uses for RDD stuff you ha

[jira] [Commented] (SPARK-12144) Implement DataFrameReader and DataFrameWriter API in SparkR

2015-12-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046376#comment-15046376 ] Sun Rui commented on SPARK-12144: - [~yanboliang] go ahead. Could you please change the t

[jira] [Commented] (SPARK-11928) Master retry deadlock

2015-12-07 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046393#comment-15046393 ] Xu Chen commented on SPARK-11928: - hi guys this issue have fixed at newly version > Mas

[jira] [Assigned] (SPARK-12170) Deprecate the JAVA-specific deserialized storage levels

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12170: Assignee: (was: Apache Spark) > Deprecate the JAVA-specific deserialized storage level

[jira] [Assigned] (SPARK-12170) Deprecate the JAVA-specific deserialized storage levels

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12170: Assignee: Apache Spark > Deprecate the JAVA-specific deserialized storage levels > ---

[jira] [Commented] (SPARK-12170) Deprecate the JAVA-specific deserialized storage levels

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046429#comment-15046429 ] Apache Spark commented on SPARK-12170: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-11487) Spark Master shutdown automatically after some applications execution

2015-12-07 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046438#comment-15046438 ] Xu Chen commented on SPARK-11487: - {code} java.lang.OutOfMemoryError: Java heap space {

[jira] [Created] (SPARK-12196) Store blocks in storage devices with hierarchy way

2015-12-07 Thread yucai (JIRA)
yucai created SPARK-12196: - Summary: Store blocks in storage devices with hierarchy way Key: SPARK-12196 URL: https://issues.apache.org/jira/browse/SPARK-12196 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

2015-12-07 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: Problem: Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capaci

[jira] [Closed] (SPARK-10290) Spark can register temp table and hive table with the same table name

2015-12-07 Thread pin_zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pin_zhang closed SPARK-10290. - not a bug > Spark can register temp table and hive table with the same table name >

[jira] [Created] (SPARK-12197) Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository

2015-12-07 Thread Rotem Shaul (JIRA)
Rotem Shaul created SPARK-12197: --- Summary: Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository Key: SPARK-12197 URL: https://issues.apache.org/jira/browse/SPARK-12197 Project:

[jira] [Updated] (SPARK-12197) Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository

2015-12-07 Thread Rotem Shaul (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rotem Shaul updated SPARK-12197: Description: The original problem: Serializing GenericRecords in Spark Core results in a very high

[jira] [Resolved] (SPARK-11551) Replace example code in ml-features.md using include_example

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11551. --- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 10002 [https://g

[jira] [Updated] (SPARK-11551) Replace example code in ml-features.md using include_example

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11551: -- Assignee: somil deshmukh > Replace example code in ml-features.md using include_example > -

<    1   2   3   >