[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-07-13 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376444#comment-15376444 ] Tathagata Das commented on SPARK-16534: --- @koeninger are you working on this? > K

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-07-13 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376432#comment-15376432 ] Saisai Shao commented on SPARK-16534: - Is there anyone working on this? > Kafka 0.10

[jira] [Comment Edited] (SPARK-15687) Columnar execution engine

2016-07-13 Thread Evan Chan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376418#comment-15376418 ] Evan Chan edited comment on SPARK-15687 at 7/14/16 6:41 AM: [

[jira] [Commented] (SPARK-15687) Columnar execution engine

2016-07-13 Thread Evan Chan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376418#comment-15376418 ] Evan Chan commented on SPARK-15687: --- [~rxin] I like the idea of an Iterator[ColumnBatch

[jira] [Resolved] (SPARK-16343) Improve the PushDownPredicate rule to pushdown predicates currectly in non-deterministic condition

2016-07-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-16343. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14012 [https://github.

[jira] [Resolved] (SPARK-16503) SparkSession should provide Spark version

2016-07-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16503. - Resolution: Fixed Assignee: Liwei Lin Fix Version/s: 2.0.0 > SparkSession should

[jira] [Resolved] (SPARK-16536) Expose `sql` in PySpark shell

2016-07-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16536. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > Expose `sql` in

[jira] [Commented] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-13 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376323#comment-15376323 ] Jacek Lewandowski commented on SPARK-16528: --- Ok, I'll fix it today > HiveClien

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376313#comment-15376313 ] Felix Cheung commented on SPARK-16538: -- Thanks for reporting this! > Cannot use "Sp

[jira] [Assigned] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16538: Assignee: (was: Apache Spark) > Cannot use "SparkR::sql" > >

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376312#comment-15376312 ] Apache Spark commented on SPARK-16538: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16538: Assignee: Apache Spark > Cannot use "SparkR::sql" > > >

[jira] [Commented] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-13 Thread Shuai Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376291#comment-15376291 ] Shuai Lin commented on SPARK-16485: --- [~josephkb] I fixed a math formatting for {{MinMax

[jira] [Commented] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376284#comment-15376284 ] Apache Spark commented on SPARK-16485: -- User 'lins05' has created a pull request for

[jira] [Created] (SPARK-16539) When worker is killed driver continues to run causing issues in supervise mode

2016-07-13 Thread Noorul Islam K M (JIRA)
Noorul Islam K M created SPARK-16539: Summary: When worker is killed driver continues to run causing issues in supervise mode Key: SPARK-16539 URL: https://issues.apache.org/jira/browse/SPARK-16539

[jira] [Comment Edited] (SPARK-16510) Move SparkR test JAR into Spark, include its source code

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376273#comment-15376273 ] Felix Cheung edited comment on SPARK-16510 at 7/14/16 3:55 AM:

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376275#comment-15376275 ] Felix Cheung commented on SPARK-16538: -- Investigating... > Cannot use "SparkR::sql"

[jira] [Commented] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376274#comment-15376274 ] Felix Cheung commented on SPARK-15124: -- I think the main ones are covered, in this a

[jira] [Commented] (SPARK-16510) Move SparkR test JAR into Spark, include its source code

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376273#comment-15376273 ] Felix Cheung commented on SPARK-16510: -- I see. I think Jenkins is optimizing out wha

[jira] [Comment Edited] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376225#comment-15376225 ] Shivaram Venkataraman edited comment on SPARK-16538 at 7/14/16 3:15 AM: ---

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376244#comment-15376244 ] Shivaram Venkataraman commented on SPARK-16538: --- So it looks like what is g

[jira] [Commented] (SPARK-16217) Support SELECT INTO statement

2016-07-13 Thread GuangFancui(ISCAS) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376234#comment-15376234 ] GuangFancui(ISCAS) commented on SPARK-16217: Sorry to reply so late.I rewrite

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376225#comment-15376225 ] Shivaram Venkataraman commented on SPARK-16538: --- This also affects other fu

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16538: -- Priority: Critical (was: Major) > Cannot use "SparkR::sql" > -

[jira] [Assigned] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16509: Assignee: Apache Spark > Rename window.partitionBy and window.orderBy > --

[jira] [Commented] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376211#comment-15376211 ] Apache Spark commented on SPARK-16509: -- User 'sun-rui' has created a pull request fo

[jira] [Assigned] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16509: Assignee: (was: Apache Spark) > Rename window.partitionBy and window.orderBy > ---

[jira] [Commented] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376204#comment-15376204 ] Sun Rui commented on SPARK-16509: - I will send the PR > Rename window.partitionBy and wi

[jira] [Updated] (SPARK-16217) Support SELECT INTO statement

2016-07-13 Thread GuangFancui(ISCAS) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangFancui(ISCAS) updated SPARK-16217: --- Description: The *SELECT INTO* statement selects data from one table and inserts it i

[jira] [Commented] (SPARK-16217) Support SELECT INTO statement

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376195#comment-15376195 ] Apache Spark commented on SPARK-16217: -- User 'wuxianxingkong' has created a pull req

[jira] [Assigned] (SPARK-16217) Support SELECT INTO statement

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16217: Assignee: (was: Apache Spark) > Support SELECT INTO statement > --

[jira] [Assigned] (SPARK-16217) Support SELECT INTO statement

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16217: Assignee: Apache Spark > Support SELECT INTO statement > - > >

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376169#comment-15376169 ] Sun Rui commented on SPARK-16522: - [~mgummelt] The commit is e50efd53f073890d789a8448f850

[jira] [Updated] (SPARK-16527) Scala Error:Type Arguments

2016-07-13 Thread Z.yinze (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Z.yinze updated SPARK-16527: Labels: Api build document windows (was: build windows) > Scala Error:Type Arguments > ---

[jira] [Updated] (SPARK-16527) Scala Error:Type Arguments

2016-07-13 Thread Z.yinze (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Z.yinze updated SPARK-16527: Description: I want to process image by HIPI on Spark.So i use hadoopfile to creat RDD. There are my Code.

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Weiluo Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiluo Ren updated SPARK-16538: --- Description: When call "SparkR::sql", an error pops up. For instance {code} SparkR::sql("") Error i

[jira] [Created] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Weiluo Ren (JIRA)
Weiluo Ren created SPARK-16538: -- Summary: Cannot use "SparkR::sql" Key: SPARK-16538 URL: https://issues.apache.org/jira/browse/SPARK-16538 Project: Spark Issue Type: Bug Components: Sp

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Weiluo Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376132#comment-15376132 ] Weiluo Ren commented on SPARK-16538: Ping [~felixcheung] > Cannot use "SparkR::sql"

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-13 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376125#comment-15376125 ] Michael Gummelt commented on SPARK-16522: - I've seen some stack traces recently t

[jira] [Created] (SPARK-16537) Extracting partition columns from the hive table.

2016-07-13 Thread Kshitij Kulshrestha (JIRA)
Kshitij Kulshrestha created SPARK-16537: --- Summary: Extracting partition columns from the hive table. Key: SPARK-16537 URL: https://issues.apache.org/jira/browse/SPARK-16537 Project: Spark

[jira] [Commented] (SPARK-16518) Schema Compatibility of Parquet Data Source

2016-07-13 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376097#comment-15376097 ] Hyukjin Kwon commented on SPARK-16518: -- [~dongjoon], [~smilegator] Thank you! then,

[jira] [Commented] (SPARK-4240) Refine Tree Predictions in Gradient Boosting to Improve Prediction Accuracy.

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376056#comment-15376056 ] Joseph K. Bradley commented on SPARK-4240: -- Thanks for the detailed survey and de

[jira] [Resolved] (SPARK-16511) SparkLauncher should allow setting working directory for spark-submit process

2016-07-13 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16511. Resolution: Duplicate I'm gonna mark this as a duplicate since the other bug is a more gene

[jira] [Commented] (SPARK-14808) Spark MLlib, GraphX, SparkR 2.0 QA umbrella

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376025#comment-15376025 ] Joseph K. Bradley commented on SPARK-14808: --- Changing priority to Critical from

[jira] [Updated] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15124: -- Assignee: Yanbo Liang > R 2.0 QA: New R APIs and API docs > ---

[jira] [Updated] (SPARK-14808) Spark MLlib, GraphX, SparkR 2.0 QA umbrella

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14808: -- Priority: Critical (was: Blocker) > Spark MLlib, GraphX, SparkR 2.0 QA umbrella >

[jira] [Resolved] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-15124. --- Resolution: Done Fix Version/s: 2.0.0 I'll mark this complete for now, but [~f

[jira] [Commented] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376019#comment-15376019 ] Shivaram Venkataraman commented on SPARK-16509: --- Thats good to know -- [~fe

[jira] [Commented] (SPARK-16536) Expose `sql` in PySpark shell

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376016#comment-15376016 ] Apache Spark commented on SPARK-16536: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-16536) Expose `sql` in PySpark shell

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16536: Assignee: (was: Apache Spark) > Expose `sql` in PySpark shell > --

[jira] [Assigned] (SPARK-16536) Expose `sql` in PySpark shell

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16536: Assignee: Apache Spark > Expose `sql` in PySpark shell > - > >

[jira] [Updated] (SPARK-16536) Expose `sql` in PySpark shell

2016-07-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16536: -- Component/s: SQL > Expose `sql` in PySpark shell > - > >

[jira] [Commented] (SPARK-2605) Drop Hive Table If Exists Throw out Error by Spark

2016-07-13 Thread Aaron Steers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376011#comment-15376011 ] Aaron Steers commented on SPARK-2605: - I am also receiving this (false positive) error

[jira] [Created] (SPARK-16536) Expose `sql` in PySpark shell

2016-07-13 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-16536: - Summary: Expose `sql` in PySpark shell Key: SPARK-16536 URL: https://issues.apache.org/jira/browse/SPARK-16536 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-16510) Move SparkR test JAR into Spark, include its source code

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376010#comment-15376010 ] Shivaram Venkataraman commented on SPARK-16510: --- For (a) the assumption is

[jira] [Updated] (SPARK-16309) SparkR csv source should have the same default na.string as R

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16309: - Affects Version/s: (was: 1.6.2) > SparkR csv source should have the same default na.string as

[jira] [Commented] (SPARK-16519) Handle SparkR RDD generics that create warnings in R CMD check

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376004#comment-15376004 ] Felix Cheung commented on SPARK-16519: -- +1 on removing RDD APIs... > Handle SparkR

[jira] [Commented] (SPARK-16510) Move SparkR test JAR into Spark, include its source code

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376000#comment-15376000 ] Felix Cheung commented on SPARK-16510: -- I suspect (a) is problematic though? Could w

[jira] [Commented] (SPARK-14816) Update MLlib, GraphX, SparkR websites for 2.0

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375996#comment-15375996 ] Felix Cheung commented on SPARK-14816: -- This was added in the SparkR programming gui

[jira] [Commented] (SPARK-12965) Indexer setInputCol() doesn't resolve column names like DataFrame.col()

2016-07-13 Thread Kevin Ushey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375995#comment-15375995 ] Kevin Ushey commented on SPARK-12965: - I'm also seeing this issue. > Indexer setInpu

[jira] [Commented] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375994#comment-15375994 ] Felix Cheung commented on SPARK-16509: -- These were added in 2.0.0 > Rename window.p

[jira] [Assigned] (SPARK-16535) pom.xml warning: "Definition of groupId is redundant, because it's inherited from the parent"

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16535: Assignee: Apache Spark > pom.xml warning: "Definition of groupId is redundant, because it'

[jira] [Assigned] (SPARK-16535) pom.xml warning: "Definition of groupId is redundant, because it's inherited from the parent"

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16535: Assignee: (was: Apache Spark) > pom.xml warning: "Definition of groupId is redundant,

[jira] [Commented] (SPARK-16535) pom.xml warning: "Definition of groupId is redundant, because it's inherited from the parent"

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375991#comment-15375991 ] Apache Spark commented on SPARK-16535: -- User 'keypointt' has created a pull request

[jira] [Updated] (SPARK-16535) pom.xml warning: "Definition of groupId is redundant, because it's inherited from the parent"

2016-07-13 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16535: Attachment: Screen Shot 2016-07-13 at 3.13.11 PM.png > pom.xml warning: "Definition of groupId is redundant

[jira] [Created] (SPARK-16535) pom.xml warning: "Definition of groupId is redundant, because it's inherited from the parent"

2016-07-13 Thread Xin Ren (JIRA)
Xin Ren created SPARK-16535: --- Summary: pom.xml warning: "Definition of groupId is redundant, because it's inherited from the parent" Key: SPARK-16535 URL: https://issues.apache.org/jira/browse/SPARK-16535 P

[jira] [Resolved] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-16485. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved

[jira] [Comment Edited] (SPARK-16365) Ideas for moving "mllib-local" forward

2016-07-13 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375928#comment-15375928 ] RJ Nowling edited comment on SPARK-16365 at 7/13/16 10:40 PM: -

[jira] [Commented] (SPARK-16365) Ideas for moving "mllib-local" forward

2016-07-13 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375928#comment-15375928 ] RJ Nowling commented on SPARK-16365: I'm really looking forward to this feature. Spar

[jira] [Resolved] (SPARK-16482) If a table's schema is inferred at runtime, describe table command does not show the schema

2016-07-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16482. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14148 [https://github.com/

[jira] [Updated] (SPARK-16482) If a table's schema is inferred at runtime, describe table command does not show the schema

2016-07-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16482: - Assignee: Xiao Li > If a table's schema is inferred at runtime, describe table command does not > show t

[jira] [Created] (SPARK-16534) Kafka 0.10 Python support

2016-07-13 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-16534: - Summary: Kafka 0.10 Python support Key: SPARK-16534 URL: https://issues.apache.org/jira/browse/SPARK-16534 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-13258) --conf properties not honored in Mesos cluster mode

2016-07-13 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375797#comment-15375797 ] Michael Gummelt commented on SPARK-13258: - Nope, this is still a bug. > --conf p

[jira] [Created] (SPARK-16533) Spark application not handling preemption messages

2016-07-13 Thread Lucas Winkelmann (JIRA)
Lucas Winkelmann created SPARK-16533: Summary: Spark application not handling preemption messages Key: SPARK-16533 URL: https://issues.apache.org/jira/browse/SPARK-16533 Project: Spark Is

[jira] [Assigned] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16485: Assignee: Joseph K. Bradley (was: Apache Spark) > Additional fixes to Mllib 2.0 documenta

[jira] [Assigned] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16485: Assignee: Apache Spark (was: Joseph K. Bradley) > Additional fixes to Mllib 2.0 documenta

[jira] [Commented] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375737#comment-15375737 ] Apache Spark commented on SPARK-16485: -- User 'jkbradley' has created a pull request

[jira] [Commented] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375725#comment-15375725 ] Joseph K. Bradley commented on SPARK-16485: --- Will fix: * GeneralizedLinearRegre

[jira] [Commented] (SPARK-16428) Spark file system watcher not working on Windows

2016-07-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375707#comment-15375707 ] Dongjoon Hyun commented on SPARK-16428: --- Sounds Great, [~hghina0]! > Spark file sy

[jira] [Commented] (SPARK-16513) Spark executor deadlocks itself in memory management

2016-07-13 Thread Steven Lowenthal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375688#comment-15375688 ] Steven Lowenthal commented on SPARK-16513: -- It looks like it happened again. Th

[jira] [Comment Edited] (SPARK-16418) DataFrame.filter fails if it references a window function

2016-07-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375680#comment-15375680 ] Dongjoon Hyun edited comment on SPARK-16418 at 7/13/16 8:28 PM: ---

[jira] [Commented] (SPARK-16418) DataFrame.filter fails if it references a window function

2016-07-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375680#comment-15375680 ] Dongjoon Hyun commented on SPARK-16418: --- Hi, [~erikwright]. I think the following i

[jira] [Commented] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375672#comment-15375672 ] Shivaram Venkataraman commented on SPARK-15124: --- I think we covered everyth

[jira] [Commented] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375667#comment-15375667 ] Joseph K. Bradley commented on SPARK-15124: --- Is there anything else remaining h

[jira] [Created] (SPARK-16532) Provide a REST API for submitting and tracking status of jobs

2016-07-13 Thread Joao Vasques (JIRA)
Joao Vasques created SPARK-16532: Summary: Provide a REST API for submitting and tracking status of jobs Key: SPARK-16532 URL: https://issues.apache.org/jira/browse/SPARK-16532 Project: Spark

[jira] [Resolved] (SPARK-16531) Remove TimeZone from DataFrameTimeWindowingSuite

2016-07-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-16531. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14170 [htt

[jira] [Comment Edited] (SPARK-16466) names() function allows creation of column name containing "-". filter() function subsequently fails

2016-07-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375629#comment-15375629 ] Dongjoon Hyun edited comment on SPARK-16466 at 7/13/16 7:53 PM: ---

[jira] [Created] (SPARK-16531) Remove TimeZone from DataFrameTimeWindowingSuite

2016-07-13 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-16531: --- Summary: Remove TimeZone from DataFrameTimeWindowingSuite Key: SPARK-16531 URL: https://issues.apache.org/jira/browse/SPARK-16531 Project: Spark Issue Type: Te

[jira] [Commented] (SPARK-16466) names() function allows creation of column name containing "-". filter() function subsequently fails

2016-07-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375629#comment-15375629 ] Dongjoon Hyun commented on SPARK-16466: --- Hi, [~n...@dewar-us.com]. Could you close

[jira] [Assigned] (SPARK-16531) Remove TimeZone from DataFrameTimeWindowingSuite

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16531: Assignee: Apache Spark > Remove TimeZone from DataFrameTimeWindowingSuite > --

[jira] [Commented] (SPARK-16531) Remove TimeZone from DataFrameTimeWindowingSuite

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375628#comment-15375628 ] Apache Spark commented on SPARK-16531: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-16531) Remove TimeZone from DataFrameTimeWindowingSuite

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16531: Assignee: (was: Apache Spark) > Remove TimeZone from DataFrameTimeWindowingSuite > ---

[jira] [Resolved] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14812. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14147 [h

[jira] [Updated] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14812: -- Fix Version/s: (was: 2.0.0) 2.1.0 2.0.1 > ML,

[jira] [Assigned] (SPARK-16530) Wrong Keyword in ALTER TABLE CHANGE COLUMN

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16530: Assignee: (was: Apache Spark) > Wrong Keyword in ALTER TABLE CHANGE COLUMN > -

[jira] [Commented] (SPARK-14816) Update MLlib, GraphX, SparkR websites for 2.0

2016-07-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375574#comment-15375574 ] Sean Owen commented on SPARK-14816: --- I am still not quite sure what it means to have up

[jira] [Assigned] (SPARK-16530) Wrong Keyword in ALTER TABLE CHANGE COLUMN

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16530: Assignee: Apache Spark > Wrong Keyword in ALTER TABLE CHANGE COLUMN >

[jira] [Commented] (SPARK-16530) Wrong Keyword in ALTER TABLE CHANGE COLUMN

2016-07-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375581#comment-15375581 ] Apache Spark commented on SPARK-16530: -- User 'gatorsmile' has created a pull request

[jira] [Updated] (SPARK-16529) SQLTestUtils.withTempDatabase should set `default` database before dropping

2016-07-13 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16529: -- Description: `withTempDatabase` is a frequently used test harness to setup a temporary table a

[jira] [Commented] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15375572#comment-15375572 ] Joseph K. Bradley commented on SPARK-16485: --- I appreciate it, but I want to rus

  1   2   3   >