[jira] [Resolved] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-26 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11997. Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved by pull reque

[jira] [Commented] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix

2015-11-26 Thread Karl Higley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029442#comment-15029442 ] Karl Higley commented on SPARK-8614: After reading the description and referenced code

[jira] [Comment Edited] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029431#comment-15029431 ] Saisai Shao edited comment on SPARK-12009 at 11/27/15 3:50 AM:

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029431#comment-15029431 ] Saisai Shao commented on SPARK-12009: - Alright, my code is master branch. Anyway I un

[jira] [Created] (SPARK-12022) spark-shell cannot run on master created with spark-ec2

2015-11-26 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-12022: --- Summary: spark-shell cannot run on master created with spark-ec2 Key: SPARK-12022 URL: https://issues.apache.org/jira/browse/SPARK-12022 Project: Spark

[jira] [Commented] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-26 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029429#comment-15029429 ] yuhao yang commented on SPARK-12000: Scala API can be generated. > `sbt publishLocal

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029427#comment-15029427 ] SuYan commented on SPARK-12009: --- run on the spark 1.4.0, and check current 1.5.2, that prob

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029425#comment-15029425 ] Saisai Shao commented on SPARK-12009: - So I guess your problem is that after you call

[jira] [Commented] (SPARK-12002) offsetRanges attribute missing in Kafka RDD when resuming from checkpoint

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029421#comment-15029421 ] Saisai Shao commented on SPARK-12002: - Looks like because Python `KafkaTransformDStre

[jira] [Assigned] (SPARK-12021) Fishy test of "don't call ssc.stop in listener"

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12021: Assignee: (was: Apache Spark) > Fishy test of "don't call ssc.stop in listener" > ---

[jira] [Commented] (SPARK-12021) Fishy test of "don't call ssc.stop in listener"

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029420#comment-15029420 ] Apache Spark commented on SPARK-12021: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-12021) Fishy test of "don't call ssc.stop in listener"

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12021: Assignee: Apache Spark > Fishy test of "don't call ssc.stop in listener" > --

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029416#comment-15029416 ] Saisai Shao commented on SPARK-12009: - So what actually version of Spark you're runni

[jira] [Comment Edited] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029416#comment-15029416 ] Saisai Shao edited comment on SPARK-12009 at 11/27/15 3:30 AM:

[jira] [Updated] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SuYan updated SPARK-12009: -- Description: Log based 1.4.0 2015-11-26,03:05:16,176 WARN org.spark-project.jetty.util.thread.QueuedThreadPoo

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029410#comment-15029410 ] SuYan commented on SPARK-12009: --- = =, the log is based 1.4.0 {code} override def onDis

[jira] [Updated] (SPARK-11991) spark_ec2.py does not perform sanity checks on hostnames

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11991: Fix Version/s: 2.0.0 > spark_ec2.py does not perform sanity checks on hostnames > -

[jira] [Updated] (SPARK-11991) spark_ec2.py does not perform sanity checks on hostnames

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11991: Assignee: Jeremy Derr > spark_ec2.py does not perform sanity checks on hostnames >

[jira] [Resolved] (SPARK-11991) spark_ec2.py does not perform sanity checks on hostnames

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11991. - Resolution: Fixed > spark_ec2.py does not perform sanity checks on hostnames > --

[jira] [Resolved] (SPARK-11917) Add SQLContext#dropTempTable to PySpark

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11917. - Resolution: Fixed Assignee: Jeff Zhang Fix Version/s: 1.6.0 > Add SQLContext#drop

[jira] [Resolved] (SPARK-11881) [SQL] JDBC Postgres fetchsize parameter ignored

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11881. - Resolution: Fixed Assignee: Marius Van Niekerk Fix Version/s: 1.6.0 > [SQL] JDBC

[jira] [Updated] (SPARK-11989) Spark JDBC write only works on techologies with transaction support

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11989: Assignee: Christian Kurz > Spark JDBC write only works on techologies with transaction support > --

[jira] [Resolved] (SPARK-12011) Stddev/Variance etc should support columnName as arguments

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12011. - Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 1.6.0 > Stddev/Variance et

[jira] [Resolved] (SPARK-11996) Executor thread dump is broken

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11996. - Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 > Executor thread d

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-26 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029361#comment-15029361 ] Peng Cheng commented on SPARK-10625: Hi committers, after 1.5.2 release this is still

[jira] [Commented] (SPARK-11206) Support SQL UI on the history server

2015-11-26 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029357#comment-15029357 ] Carson Wang commented on SPARK-11206: - Yes, this is being fixed by https://github.com

[jira] [Created] (SPARK-12021) Fishy test of "don't call ssc.stop in listener"

2015-11-26 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-12021: --- Summary: Fishy test of "don't call ssc.stop in listener" Key: SPARK-12021 URL: https://issues.apache.org/jira/browse/SPARK-12021 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029328#comment-15029328 ] Apache Spark commented on SPARK-12020: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12020: Assignee: Apache Spark (was: Yin Huai) > PR builder cannot trigger hadoop 2.0 test >

[jira] [Assigned] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12020: Assignee: Yin Huai (was: Apache Spark) > PR builder cannot trigger hadoop 2.0 test >

[jira] [Created] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-26 Thread Yin Huai (JIRA)
Yin Huai created SPARK-12020: Summary: PR builder cannot trigger hadoop 2.0 test Key: SPARK-12020 URL: https://issues.apache.org/jira/browse/SPARK-12020 Project: Spark Issue Type: Bug C

[jira] [Resolved] (SPARK-11998) Branch 1.6's hadoop 2.2 tests always fail the entire VersionsSuite

2015-11-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11998. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9979 [https://github.com/a

[jira] [Assigned] (SPARK-11998) Branch 1.6's hadoop 2.2 tests always fail the entire VersionsSuite

2015-11-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-11998: Assignee: Yin Huai > Branch 1.6's hadoop 2.2 tests always fail the entire VersionsSuite >

[jira] [Updated] (SPARK-12019) SparkR.init have wrong example

2015-11-26 Thread liushiqi9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liushiqi9 updated SPARK-12019: -- Component/s: R > SparkR.init have wrong example > -- > > Ke

[jira] [Created] (SPARK-12019) SparkR.init have wrong example

2015-11-26 Thread liushiqi9 (JIRA)
liushiqi9 created SPARK-12019: - Summary: SparkR.init have wrong example Key: SPARK-12019 URL: https://issues.apache.org/jira/browse/SPARK-12019 Project: Spark Issue Type: Bug Affects Versions

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Villu Ruusmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029321#comment-15029321 ] Villu Ruusmann commented on SPARK-11988: On a related note, I am developing an Ap

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029320#comment-15029320 ] Vincenzo Selvaggio commented on SPARK-11988: OK thanks! > Update JPMML to 1.

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Villu Ruusmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029319#comment-15029319 ] Villu Ruusmann commented on SPARK-11988: PMML@version is a required attribute. Yo

[jira] [Comment Edited] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-11-26 Thread Karl Higley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029318#comment-15029318 ] Karl Higley edited comment on SPARK-5992 at 11/26/15 11:20 PM: -

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-11-26 Thread Karl Higley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029318#comment-15029318 ] Karl Higley commented on SPARK-5992: I'm a bit confused by this section of the design

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029313#comment-15029313 ] Vincenzo Selvaggio commented on SPARK-11988: [~vfed] I have a related questio

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029310#comment-15029310 ] Sean Owen commented on SPARK-11988: --- Yeah Java 7 is the minimum now. > Update JPMML to

[jira] [Assigned] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12018: Assignee: (was: Apache Spark) > Refactor common subexpression elimination code > -

[jira] [Assigned] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12018: Assignee: Apache Spark > Refactor common subexpression elimination code >

[jira] [Commented] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029308#comment-15029308 ] Apache Spark commented on SPARK-12018: -- User 'viirya' has created a pull request for

[jira] [Updated] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-26 Thread Radoslaw Gruchalski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radoslaw Gruchalski updated SPARK-11638: Attachment: 1.6.0.patch Updated 1.6.0 patch to include NettyRpcEnv. > Apache Spark

[jira] [Updated] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-12018: Description: The code of common subexpression elimination can be factored and simplified.

[jira] [Updated] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-26 Thread Radoslaw Gruchalski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radoslaw Gruchalski updated SPARK-11638: Attachment: (was: 1.6.0-master.patch) > Apache Spark in Docker with Bridge netw

[jira] [Created] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-12018: --- Summary: Refactor common subexpression elimination code Key: SPARK-12018 URL: https://issues.apache.org/jira/browse/SPARK-12018 Project: Spark Issue Ty

[jira] [Commented] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-26 Thread Radoslaw Gruchalski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029304#comment-15029304 ] Radoslaw Gruchalski commented on SPARK-11638: - I have added a change to enabl

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029303#comment-15029303 ] Vincenzo Selvaggio commented on SPARK-11988: [~srowen] [~vfed] We did discuss

[jira] [Commented] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029293#comment-15029293 ] Reynold Xin commented on SPARK-11707: - cc [~vanzin] do you want to look into it? >

[jira] [Updated] (SPARK-12015) Auto convert int to Double when required in pyspark.ml

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12015: -- Fix Version/s: (was: 1.6.0) [~jamartinh] don't set fix version > Auto convert int to Double when r

[jira] [Updated] (SPARK-11863) Unable to resolve order by if it contains mixture of aliases and real columns.

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11863: -- Assignee: Wenchen Fan > Unable to resolve order by if it contains mixture of aliases and real columns.

[jira] [Commented] (SPARK-6644) After adding new columns to a partitioned table and inserting data to an old partition, data of newly added columns are all NULL

2015-11-26 Thread Xiu(Joe) Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029226#comment-15029226 ] Xiu(Joe) Guo commented on SPARK-6644: - With the current master branch code line (1.6.0

[jira] [Resolved] (SPARK-11863) Unable to resolve order by if it contains mixture of aliases and real columns.

2015-11-26 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11863. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9961 [http

[jira] [Commented] (SPARK-11206) Support SQL UI on the history server

2015-11-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029183#comment-15029183 ] Ted Yu commented on SPARK-11206: Looks like SQLListenerMemoryLeakSuite fails on maven Jen

[jira] [Commented] (SPARK-9137) Unified label verification for Classifier

2015-11-26 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029170#comment-15029170 ] Maciej Szymkiewicz commented on SPARK-9137: --- [~josephkb] Could you take a look a

[jira] [Updated] (SPARK-11373) Add metrics to the History Server and providers

2015-11-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-11373: --- Affects Version/s: (was: 1.5.1) 1.6.0 > Add metrics to the History

[jira] [Commented] (SPARK-12017) Java Doc Publishing Broken

2015-11-26 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029153#comment-15029153 ] Michael Armbrust commented on SPARK-12017: -- /cc [~joshrosen] > Java Doc Publish

[jira] [Created] (SPARK-12017) Java Doc Publishing Broken

2015-11-26 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-12017: Summary: Java Doc Publishing Broken Key: SPARK-12017 URL: https://issues.apache.org/jira/browse/SPARK-12017 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12013) Add a Hive context method to retrieve the database Names

2015-11-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029140#comment-15029140 ] Xiao Li commented on SPARK-12013: - I am not sure whether we should add such an interface.

[jira] [Resolved] (SPARK-11990) DataFrame recompute UDF in some situation.

2015-11-26 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11990. -- Resolution: Duplicate Fix Version/s: 1.6.0 This is already fixed in Spark 1.6 by

[jira] [Commented] (SPARK-2572) Can't delete local dir on executor automatically when running spark over Mesos.

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029131#comment-15029131 ] Sean Owen commented on SPARK-2572: -- Try 1.6/master? I don't know about Mesos, myself. >

[jira] [Commented] (SPARK-12016) word2vec load model can't use findSynonyms to get words

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029129#comment-15029129 ] Sean Owen commented on SPARK-12016: --- This isn't nearly enough info. Please provide more

[jira] [Comment Edited] (SPARK-12013) Add a Hive context method to retrieve the database Names

2015-11-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029114#comment-15029114 ] Xiao Li edited comment on SPARK-12013 at 11/26/15 5:07 PM: --- [~g

[jira] [Commented] (SPARK-12013) Add a Hive context method to retrieve the database Names

2015-11-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029114#comment-15029114 ] Xiao Li commented on SPARK-12013: - [~getaceres] Hive does not provide such an interface.

[jira] [Comment Edited] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-26 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029073#comment-15029073 ] yuhao yang edited comment on SPARK-12000 at 11/26/15 4:43 PM: -

[jira] [Comment Edited] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-26 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029073#comment-15029073 ] yuhao yang edited comment on SPARK-12000 at 11/26/15 4:43 PM: -

[jira] [Commented] (SPARK-12013) Add a Hive context method to retrieve the database Names

2015-11-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029087#comment-15029087 ] Xiao Li commented on SPARK-12013: - I can work on it. Thanks! > Add a Hive context method

[jira] [Commented] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-26 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029073#comment-15029073 ] yuhao yang commented on SPARK-12000: Met that with "./build/sbt unidoc" no-symbol d

[jira] [Commented] (SPARK-12002) offsetRanges attribute missing in Kafka RDD when resuming from checkpoint

2015-11-26 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029058#comment-15029058 ] Cody Koeninger commented on SPARK-12002: Just to be clear, this is a only an issu

[jira] [Commented] (SPARK-11987) Python API update for ChiSqSelector and QuantileDiscretizer

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029024#comment-15029024 ] Apache Spark commented on SPARK-11987: -- User 'yinxusen' has created a pull request f

[jira] [Assigned] (SPARK-11987) Python API update for ChiSqSelector and QuantileDiscretizer

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11987: Assignee: Apache Spark > Python API update for ChiSqSelector and QuantileDiscretizer > ---

[jira] [Assigned] (SPARK-11987) Python API update for ChiSqSelector and QuantileDiscretizer

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11987: Assignee: (was: Apache Spark) > Python API update for ChiSqSelector and QuantileDiscre

[jira] [Commented] (SPARK-11987) Python API update for ChiSqSelector and QuantileDiscretizer

2015-11-26 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029011#comment-15029011 ] Xusen Yin commented on SPARK-11987: --- I remove the API doc job. Let's postpone it before

[jira] [Updated] (SPARK-11987) Python API update for ChiSqSelector and QuantileDiscretizer

2015-11-26 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-11987: -- Summary: Python API update for ChiSqSelector and QuantileDiscretizer (was: Python API/Programming guid

[jira] [Updated] (SPARK-11987) Python API update for ChiSqSelector and QuantileDiscretizer

2015-11-26 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-11987: -- Description: Add Python APIs for QuantileDiscretizer and ChiSqSelector in the ML package. ~~Then add Py

[jira] [Updated] (SPARK-11987) Python API update for ChiSqSelector and QuantileDiscretizer

2015-11-26 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-11987: -- Description: Add Python APIs for QuantileDiscretizer and ChiSqSelector in the ML package. (was: Add Py

[jira] [Commented] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

2015-11-26 Thread Nicolas PHUNG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15028966#comment-15028966 ] Nicolas PHUNG commented on SPARK-7122: -- I'm confirming it works now in Spark 1.5.2 >

[jira] [Created] (SPARK-12016) word2vec load model can't use findSynonyms to get words

2015-11-26 Thread yuangang.liu (JIRA)
yuangang.liu created SPARK-12016: Summary: word2vec load model can't use findSynonyms to get words Key: SPARK-12016 URL: https://issues.apache.org/jira/browse/SPARK-12016 Project: Spark Issu

[jira] [Commented] (SPARK-11957) SQLTransformer docs are unclear about generality of SQL statements

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15028857#comment-15028857 ] Apache Spark commented on SPARK-11957: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-11957) SQLTransformer docs are unclear about generality of SQL statements

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11957: Assignee: Apache Spark > SQLTransformer docs are unclear about generality of SQL statement

[jira] [Assigned] (SPARK-11958) Create user guide section for SQLTransformer

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11958: Assignee: (was: Apache Spark) > Create user guide section for SQLTransformer > ---

[jira] [Assigned] (SPARK-11958) Create user guide section for SQLTransformer

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11958: Assignee: Apache Spark > Create user guide section for SQLTransformer > --

[jira] [Assigned] (SPARK-11957) SQLTransformer docs are unclear about generality of SQL statements

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11957: Assignee: (was: Apache Spark) > SQLTransformer docs are unclear about generality of SQ

[jira] [Commented] (SPARK-11958) Create user guide section for SQLTransformer

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15028856#comment-15028856 ] Apache Spark commented on SPARK-11958: -- User 'yanboliang' has created a pull request

[jira] [Created] (SPARK-12015) Auto convert int to Double when required in pyspark.ml

2015-11-26 Thread Jose Antonio (JIRA)
Jose Antonio created SPARK-12015: Summary: Auto convert int to Double when required in pyspark.ml Key: SPARK-12015 URL: https://issues.apache.org/jira/browse/SPARK-12015 Project: Spark Issue

[jira] [Updated] (SPARK-12013) Add a Hive context method to retrieve the database Names

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12013: -- Target Version/s: (was: 1.6.0) Priority: Minor (was: Major) Fix Version/s: (wa

[jira] [Updated] (SPARK-11405) ROW_NUMBER function does not adhere to window ORDER BY, when joining

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11405: -- Assignee: Josh Rosen > ROW_NUMBER function does not adhere to window ORDER BY, when joining > -

[jira] [Commented] (SPARK-11960) User guide section for streaming a/b testing

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15028801#comment-15028801 ] Apache Spark commented on SPARK-11960: -- User 'feynmanliang' has created a pull reque

[jira] [Assigned] (SPARK-11960) User guide section for streaming a/b testing

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11960: Assignee: Feynman Liang (was: Apache Spark) > User guide section for streaming a/b testin

[jira] [Assigned] (SPARK-11960) User guide section for streaming a/b testing

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11960: Assignee: Apache Spark (was: Feynman Liang) > User guide section for streaming a/b testin

[jira] [Updated] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2015-11-26 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12014: - Description: Actually it is known hive issue: https://issues.apache.org/jira/browse/HIVE-11100 patch av

[jira] [Created] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2015-11-26 Thread Teng Qiu (JIRA)
Teng Qiu created SPARK-12014: Summary: Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100) Key: SPARK-12014 URL: https://issues.apache.org/jira/browse/SPARK-12014 Project: Sp

[jira] [Updated] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2015-11-26 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12014: - Description: Actually it is known hive issue: https://issues.apache.org/jira/browse/HIVE-11100 patch av

[jira] [Updated] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-11-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12012: --- Description: Currently a {{PhysicalRDD}} operator is just visualized as a node with nothing but a lab

[jira] [Assigned] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12012: Assignee: Cheng Lian (was: Apache Spark) > Show more comprehensive PhysicalRDD metadata w

[jira] [Commented] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15028679#comment-15028679 ] Apache Spark commented on SPARK-12012: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12012: Assignee: Apache Spark (was: Cheng Lian) > Show more comprehensive PhysicalRDD metadata w

  1   2   >