[jira] [Resolved] (SPARK-16214) fix the denominator of SparkPi

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16214. --- Resolution: Fixed Fix Version/s: 2.0.1 1.6.3 Issue resolved by pull request

[jira] [Created] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

2016-06-27 Thread Piotr Milanowski (JIRA)
Piotr Milanowski created SPARK-16224: Summary: Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit Key: SPARK-16224 URL: https://issues.apache.org/jir

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-06-27 Thread Piotr Milanowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350524#comment-15350524 ] Piotr Milanowski commented on SPARK-15345: -- Yes, hive-site.xml exists and contai

[jira] [Commented] (SPARK-16140) Group k-means method in generated doc

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350522#comment-15350522 ] Apache Spark commented on SPARK-16140: -- User 'keypointt' has created a pull request

[jira] [Comment Edited] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-06-27 Thread Piotr Milanowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350524#comment-15350524 ] Piotr Milanowski edited comment on SPARK-15345 at 6/27/16 7:37 AM:

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-06-27 Thread Piotr Milanowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350526#comment-15350526 ] Piotr Milanowski commented on SPARK-15345: -- I created a separate issue for this:

[jira] [Resolved] (SPARK-16219) Unable to run Python wordcount

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16219. --- Resolution: Not A Problem Fix Version/s: (was: 1.6.1) Target Version/s: (was: 1

[jira] [Resolved] (SPARK-16218) spark 1.4.1 "Storage Fraction Cached" was greater than 120%.And I recache the talbe in memory and find querying faster than before,May be its a bug.

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16218. --- Resolution: Duplicate Please search JIRA first and read https://cwiki.apache.org/confluence/display/

[jira] [Commented] (SPARK-11938) Expose numFeatures in all ML PredictionModel for PySpark

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350545#comment-15350545 ] Apache Spark commented on SPARK-11938: -- User 'vectorijk' has created a pull request

[jira] [Resolved] (SPARK-16169) Saving Intermediate dataframe increasing processing time upto 5 times.

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16169. --- Resolution: Not A Problem > Saving Intermediate dataframe increasing processing time upto 5 times. >

[jira] [Resolved] (SPARK-16172) SQL Context's

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16172. --- Resolution: Invalid > SQL Context's > -- > > Key: SPARK-16172 >

[jira] [Resolved] (SPARK-16047) Sort by status and id fields in Executors table

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16047. --- Resolution: Won't Fix > Sort by status and id fields in Executors table > ---

[jira] [Updated] (SPARK-16140) Group k-means method in generated doc

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16140: -- Priority: Minor (was: Major) > Group k-means method in generated doc > ---

[jira] [Commented] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

2016-06-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350574#comment-15350574 ] Yanbo Liang commented on SPARK-16000: - I can help on some sub-tasks after SPARK-16187

[jira] [Commented] (SPARK-14172) Hive table partition predicate not passed down correctly

2016-06-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350624#comment-15350624 ] Wenchen Fan commented on SPARK-14172: - I'm not sure if it's safe to push it down. For

[jira] [Created] (SPARK-16225) Spark Sql throws ArrayIndexOutOfBoundsException on accessing Null Value

2016-06-27 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created SPARK-16225: - Summary: Spark Sql throws ArrayIndexOutOfBoundsException on accessing Null Value Key: SPARK-16225 URL: https://issues.apache.org/jira/browse/SPARK-16225 Project: Sp

[jira] [Resolved] (SPARK-16225) Spark Sql throws ArrayIndexOutOfBoundsException on accessing Null Value

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16225. --- Resolution: Not A Problem The bug is in your code, because: {code} scala> "a,b,c,,,".split(",") res0

[jira] [Resolved] (SPARK-16065) Throw a exception "java.lang.ClassNotFoundException" when run the spark-submit

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16065. --- Resolution: Cannot Reproduce > Throw a exception "java.lang.ClassNotFoundException" when run the spar

[jira] [Resolved] (SPARK-16067) Spark overriding JAAS privilege using keytab

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16067. --- Resolution: Not A Problem > Spark overriding JAAS privilege using keytab > -

[jira] [Commented] (SPARK-14172) Hive table partition predicate not passed down correctly

2016-06-27 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350704#comment-15350704 ] Jiang Xingbo commented on SPARK-14172: -- Yes you are right. I thought the determinist

[jira] [Commented] (SPARK-16225) Spark Sql throws ArrayIndexOutOfBoundsException on accessing Null Value

2016-06-27 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350718#comment-15350718 ] Prabhu Joseph commented on SPARK-16225: --- Thanks [~srowen] > Spark Sql throws Array

[jira] [Comment Edited] (SPARK-16225) Spark Sql throws ArrayIndexOutOfBoundsException on accessing Null Value

2016-06-27 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350718#comment-15350718 ] Prabhu Joseph edited comment on SPARK-16225 at 6/27/16 10:00 AM: --

[jira] [Commented] (SPARK-16093) Spark2.0 take no effect after set spark.sql.autoBroadcastJoinThreshold = 1

2016-06-27 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350763#comment-15350763 ] marymwu commented on SPARK-16093: - Any body help? > Spark2.0 take no effect after set sp

[jira] [Commented] (SPARK-16092) Spark2.0 take no effect after set hive.exec.dynamic.partition.mode=nonstrict as a global variable in Spark2.0 configuration file while Spark1.6 does

2016-06-27 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350764#comment-15350764 ] marymwu commented on SPARK-16092: - Any body help? > Spark2.0 take no effect after set hi

[jira] [Commented] (SPARK-16089) Spark2.0 doesn't support the certain static partition SQL statment as "insert overwrite table targetTB PARTITION (partition field=xx) select field1,field2,...,partitio

2016-06-27 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350765#comment-15350765 ] marymwu commented on SPARK-16089: - Any body help? > Spark2.0 doesn't support the certain

[jira] [Updated] (SPARK-10591) False negative in QueryTest.checkAnswer

2016-06-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10591: --- Assignee: Dongjoon Hyun > False negative in QueryTest.checkAnswer > -

[jira] [Resolved] (SPARK-10591) False negative in QueryTest.checkAnswer

2016-06-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-10591. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13913 [https://github.

[jira] [Updated] (SPARK-10591) False negative in QueryTest.checkAnswer

2016-06-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10591: --- Fix Version/s: (was: 2.0.0) 2.1.0 2.0.1 > False negative in

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2016-06-27 Thread Ian Hellstrom (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350837#comment-15350837 ] Ian Hellstrom commented on SPARK-8332: -- Is there a solution for this? I'm running 1.

[jira] [Reopened] (SPARK-15731) orc writer directory permissions

2016-06-27 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Haim reopened SPARK-15731: -- Hi, MapR upgraded Spark to 1.6.1 and I still get this behavior described. Did you test it on a file standal

[jira] [Commented] (SPARK-2984) FileNotFoundException on _temporary directory

2016-06-27 Thread Ashish Shrowty (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350954#comment-15350954 ] Ashish Shrowty commented on SPARK-2984: --- Hi, I would echo Sandeep's comments. I am

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350977#comment-15350977 ] Sean Owen commented on SPARK-15731: --- We still have a can't-reproduce here, and you're n

[jira] [Commented] (SPARK-15643) ML 2.0 QA: migration guide update

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350978#comment-15350978 ] Apache Spark commented on SPARK-15643: -- User 'MLnick' has created a pull request for

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-27 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350983#comment-15350983 ] Ran Haim commented on SPARK-15731: -- You did not answer any of my questions, it will help

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350987#comment-15350987 ] Sean Owen commented on SPARK-15731: --- Are you addressing Kevin Yu? He's clearly using a

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-27 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351003#comment-15351003 ] Ran Haim commented on SPARK-15731: -- wait a minute, you are not addressing any issues on

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-27 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350996#comment-15350996 ] Ran Haim commented on SPARK-15731: -- Yes, I will try it locally. But this might be the pr

[jira] [Resolved] (SPARK-16135) Implement hashCode and euqals in UnsafeMapData

2016-06-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16135. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13847 [https://githu

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-27 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351026#comment-15351026 ] Ran Haim commented on SPARK-15731: -- Oh, OK - I will try to do this on 1.6 locally and th

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351012#comment-15351012 ] Sean Owen commented on SPARK-15731: --- What do you mean? I'm trying to bridge the gap bet

[jira] [Updated] (SPARK-16135) Remove hashCode and euqals in ArrayBasedMapData

2016-06-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16135: Summary: Remove hashCode and euqals in ArrayBasedMapData (was: Implement hashCode and euqals in Un

[jira] [Updated] (SPARK-16135) Remove hashCode and euqals in ArrayBasedMapData

2016-06-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16135: Assignee: Takeshi Yamamuro > Remove hashCode and euqals in ArrayBasedMapData >

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-06-27 Thread Semet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351074#comment-15351074 ] Semet commented on SPARK-13587: --- I back this proposal and willing to work on it. > Support

[jira] [Created] (SPARK-16226) change the way of JDBC commit

2016-06-27 Thread lihongli (JIRA)
lihongli created SPARK-16226: Summary: change the way of JDBC commit Key: SPARK-16226 URL: https://issues.apache.org/jira/browse/SPARK-16226 Project: Spark Issue Type: Bug Components: S

[jira] [Commented] (SPARK-16219) Unable to run Python wordcount

2016-06-27 Thread Chaitanya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351098#comment-15351098 ] Chaitanya commented on SPARK-16219: --- Thank you Sean for pointing that out. I solved tha

[jira] [Comment Edited] (SPARK-16219) Unable to run Python wordcount

2016-06-27 Thread Chaitanya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351098#comment-15351098 ] Chaitanya edited comment on SPARK-16219 at 6/27/16 2:19 PM: T

[jira] [Commented] (SPARK-16226) change the way of JDBC commit

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1535#comment-1535 ] Sean Owen commented on SPARK-16226: --- Then, however, committing a partition wouldn't be

[jira] [Reopened] (SPARK-16219) Unable to run Python wordcount

2016-06-27 Thread Chaitanya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaitanya reopened SPARK-16219: --- The previous issue has been solved. Still estimation of pi works and wordcount doesn't. > Unable to run

[jira] [Assigned] (SPARK-16226) change the way of JDBC commit

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16226: Assignee: Apache Spark > change the way of JDBC commit > - > >

[jira] [Commented] (SPARK-16226) change the way of JDBC commit

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351162#comment-15351162 ] Apache Spark commented on SPARK-16226: -- User 'lihongliustc' has created a pull reque

[jira] [Assigned] (SPARK-16226) change the way of JDBC commit

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16226: Assignee: (was: Apache Spark) > change the way of JDBC commit > --

[jira] [Issue Comment Deleted] (SPARK-16219) Unable to run Python wordcount

2016-06-27 Thread Chaitanya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaitanya updated SPARK-16219: -- Comment: was deleted (was: The previous issue has been solved. Still estimation of pi works and wordco

[jira] [Commented] (SPARK-16219) Unable to run Python wordcount

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351202#comment-15351202 ] Sean Owen commented on SPARK-16219: --- [~chaitanya2692] this is still just an environment

[jira] [Commented] (SPARK-16219) Unable to run Python wordcount

2016-06-27 Thread Chaitanya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351205#comment-15351205 ] Chaitanya commented on SPARK-16219: --- I'm sorry for the situation. I will try to find ou

[jira] [Commented] (SPARK-16164) CombineFilters should keep the ordering in the logical plan

2016-06-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351244#comment-15351244 ] Cheng Lian commented on SPARK-16164: I'm not saying that we should make this explicit

[jira] [Created] (SPARK-16227) Json schema inference fails when `:` exists in file path

2016-06-27 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-16227: --- Summary: Json schema inference fails when `:` exists in file path Key: SPARK-16227 URL: https://issues.apache.org/jira/browse/SPARK-16227 Project: Spark Issue

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-06-27 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351311#comment-15351311 ] Timothy Hunter commented on SPARK-12922: [~Narine] while working on a similar fun

[jira] [Commented] (SPARK-10597) MultivariateOnlineSummarizer for weighted instances

2016-06-27 Thread Martin Mauch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351316#comment-15351316 ] Martin Mauch commented on SPARK-10597: -- Is there any news on this or another way to

[jira] [Updated] (SPARK-16052) Improve `CollapseRepartition` optimizer for Repartition/RepartitionBy

2016-06-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16052: -- Description: This issue improves `CollapseRepartition` to optimize the adjacent combinations o

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-06-27 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351478#comment-15351478 ] Kai Jiang commented on SPARK-15767: --- Here is detailed comparison: ✓ means MLlib matchs

[jira] [Created] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-16228: Summary: "Percentile" needs explicit cast to double Key: SPARK-16228 URL: https://issues.apache.org/jira/browse/SPARK-16228 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov updated SPARK-16228: - Description: {quote} select percentile(cast(id as bigint), cast(0.5 as double)) from temp.bla {q

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2016-06-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351512#comment-15351512 ] Jeff Zhang commented on SPARK-13587: Thanks [~gae...@xeberon.net] Have you take a loo

[jira] [Created] (SPARK-16229) Empty Table Remains After CREATE TABLE AS SELECT fails

2016-06-27 Thread Xiao Li (JIRA)
Xiao Li created SPARK-16229: --- Summary: Empty Table Remains After CREATE TABLE AS SELECT fails Key: SPARK-16229 URL: https://issues.apache.org/jira/browse/SPARK-16229 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

2016-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-16224: Assignee: Yin Huai > Hive context created by HiveContext can't access Hive databases when used in

[jira] [Updated] (SPARK-16229) Empty Table Remains After CREATE TABLE AS SELECT fails

2016-06-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-16229: Description: {noformat} CREATE TABLE tab STORED AS TEXTFILE SELECT 1 AS a, (SELECT a FROM (SELECT 1 AS a UN

[jira] [Assigned] (SPARK-16229) Empty Table Remains After CREATE TABLE AS SELECT fails

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16229: Assignee: (was: Apache Spark) > Empty Table Remains After CREATE TABLE AS SELECT fails

[jira] [Resolved] (SPARK-13666) Annoying warnings from SQLConf in log output

2016-06-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-13666. Resolution: Duplicate SPARK-15012 removed the warning altogether. > Annoying warnings from

[jira] [Commented] (SPARK-16229) Empty Table Remains After CREATE TABLE AS SELECT fails

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351538#comment-15351538 ] Apache Spark commented on SPARK-16229: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-16229) Empty Table Remains After CREATE TABLE AS SELECT fails

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16229: Assignee: Apache Spark > Empty Table Remains After CREATE TABLE AS SELECT fails >

[jira] [Commented] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

2016-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351564#comment-15351564 ] Yin Huai commented on SPARK-16224: -- oh, seems that {{HiveContext}} is not using metastor

[jira] [Updated] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16228: -- Priority: Major (was: Blocker) OK, not sure at this stage this is a Blocker though. > "Percentile" ne

[jira] [Created] (SPARK-16230) Executors self-killing after being assigned tasks while still in init

2016-06-27 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-16230: --- Summary: Executors self-killing after being assigned tasks while still in init Key: SPARK-16230 URL: https://issues.apache.org/jira/browse/SPARK-16230 Project: Spark

[jira] [Assigned] (SPARK-16143) Group survival analysis methods in generated doc

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16143: Assignee: Apache Spark (was: Junyang Qian) > Group survival analysis methods in generated

[jira] [Commented] (SPARK-16143) Group survival analysis methods in generated doc

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351618#comment-15351618 ] Apache Spark commented on SPARK-16143: -- User 'junyangq' has created a pull request f

[jira] [Assigned] (SPARK-16143) Group survival analysis methods in generated doc

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16143: Assignee: Junyang Qian (was: Apache Spark) > Group survival analysis methods in generated

[jira] [Commented] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

2016-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351625#comment-15351625 ] Yin Huai commented on SPARK-16224: -- I'd say it is a blocker since it breaks the compatib

[jira] [Updated] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

2016-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16224: - Target Version/s: 2.0.0 Priority: Blocker (was: Major) > Hive context created by HiveContext

[jira] [Commented] (SPARK-16230) Executors self-killing after being assigned tasks while still in init

2016-06-27 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351636#comment-15351636 ] Tejas Patil commented on SPARK-16230: - For now, I can think of these two options: *

[jira] [Created] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-16231: Summary: PySpark ML DataFrame example fails on Vector conversion Key: SPARK-16231 URL: https://issues.apache.org/jira/browse/SPARK-16231 Project: Spark Issue

[jira] [Updated] (SPARK-16187) Implement util method for ML Matrix conversion in scala/java

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16187: -- Assignee: yuhao yang > Implement util method for ML Matrix conversion in scala/java > -

[jira] [Resolved] (SPARK-16187) Implement util method for ML Matrix conversion in scala/java

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16187. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Assigned] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16231: Assignee: Apache Spark > PySpark ML DataFrame example fails on Vector conversion > ---

[jira] [Assigned] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16231: Assignee: (was: Apache Spark) > PySpark ML DataFrame example fails on Vector conversio

[jira] [Commented] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351652#comment-15351652 ] Apache Spark commented on SPARK-16231: -- User 'BryanCutler' has created a pull reques

[jira] [Commented] (SPARK-16232) Getting error by making columns using DataFrame

2016-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351655#comment-15351655 ] Sean Owen commented on SPARK-16232: --- This isn't nearly enough information, doesn't show

[jira] [Created] (SPARK-16232) Getting error by making columns using DataFrame

2016-06-27 Thread Inam Ur Rehman (JIRA)
Inam Ur Rehman created SPARK-16232: -- Summary: Getting error by making columns using DataFrame Key: SPARK-16232 URL: https://issues.apache.org/jira/browse/SPARK-16232 Project: Spark Issue Ty

[jira] [Commented] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

2016-06-27 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351686#comment-15351686 ] Bill Chambers commented on SPARK-16220: --- [~hvanhovell] I imagine I should just reso

[jira] [Comment Edited] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

2016-06-27 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351686#comment-15351686 ] Bill Chambers edited comment on SPARK-16220 at 6/27/16 7:53 PM: ---

[jira] [Commented] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351697#comment-15351697 ] Egor Pahomov commented on SPARK-16228: -- [~srowen] "blocker" is questionable, I agree

[jira] [Resolved] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16231. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16231: -- Assignee: Bryan Cutler > PySpark ML DataFrame example fails on Vector conversion >

[jira] [Created] (SPARK-16233) test_sparkSQL.R is failing

2016-06-27 Thread Xin Ren (JIRA)
Xin Ren created SPARK-16233: --- Summary: test_sparkSQL.R is failing Key: SPARK-16233 URL: https://issues.apache.org/jira/browse/SPARK-16233 Project: Spark Issue Type: Bug Components: SparkR

[jira] [Commented] (SPARK-16233) test_sparkSQL.R is failing

2016-06-27 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351703#comment-15351703 ] Xin Ren commented on SPARK-16233: - I'm working on this > test_sparkSQL.R is failing > --

[jira] [Commented] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351705#comment-15351705 ] Apache Spark commented on SPARK-16220: -- User 'hvanhovell' has created a pull request

[jira] [Commented] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351708#comment-15351708 ] Dongjoon Hyun commented on SPARK-16228: --- Hi, [~epahomov] and [~srowen]. The root ca

[jira] [Assigned] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16228: Assignee: Apache Spark > "Percentile" needs explicit cast to double >

[jira] [Assigned] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16228: Assignee: (was: Apache Spark) > "Percentile" needs explicit cast to double > -

[jira] [Commented] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15351727#comment-15351727 ] Apache Spark commented on SPARK-16228: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Updated] (SPARK-15581) MLlib 2.1 Roadmap

2016-06-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15581: -- Description: This is a master list for MLlib improvements we are working on for the nex

  1   2   >