[jira] [Updated] (SPARK-12015) Auto convert int to Double when required in pyspark.ml

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12015: -- Fix Version/s: (was: 1.6.0) [~jamartinh] don't set fix version > Auto convert int to Double when

[jira] [Commented] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029293#comment-15029293 ] Reynold Xin commented on SPARK-11707: - cc [~vanzin] do you want to look into it? >

[jira] [Commented] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029308#comment-15029308 ] Apache Spark commented on SPARK-12018: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-26 Thread Radoslaw Gruchalski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radoslaw Gruchalski updated SPARK-11638: Attachment: 1.6.0.patch Updated 1.6.0 patch to include NettyRpcEnv. > Apache

[jira] [Assigned] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12018: Assignee: Apache Spark > Refactor common subexpression elimination code >

[jira] [Assigned] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12018: Assignee: (was: Apache Spark) > Refactor common subexpression elimination code >

[jira] [Updated] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-12018: Description: The code of common subexpression elimination can be factored and simplified.

[jira] [Updated] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-26 Thread Radoslaw Gruchalski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radoslaw Gruchalski updated SPARK-11638: Attachment: (was: 1.6.0-master.patch) > Apache Spark in Docker with Bridge

[jira] [Created] (SPARK-12018) Refactor common subexpression elimination code

2015-11-26 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-12018: --- Summary: Refactor common subexpression elimination code Key: SPARK-12018 URL: https://issues.apache.org/jira/browse/SPARK-12018 Project: Spark Issue

[jira] [Updated] (SPARK-11863) Unable to resolve order by if it contains mixture of aliases and real columns.

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11863: -- Assignee: Wenchen Fan > Unable to resolve order by if it contains mixture of aliases and real columns.

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029303#comment-15029303 ] Vincenzo Selvaggio commented on SPARK-11988: [~srowen] [~vfed] We did discuss this on my pull

[jira] [Commented] (SPARK-6644) After adding new columns to a partitioned table and inserting data to an old partition, data of newly added columns are all NULL

2015-11-26 Thread Xiu(Joe) Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029226#comment-15029226 ] Xiu(Joe) Guo commented on SPARK-6644: - With the current master branch code line (1.6.0-snapshot), this

[jira] [Commented] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-26 Thread Radoslaw Gruchalski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029304#comment-15029304 ] Radoslaw Gruchalski commented on SPARK-11638: - I have added a change to enable

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029310#comment-15029310 ] Sean Owen commented on SPARK-11988: --- Yeah Java 7 is the minimum now. > Update JPMML to 1.2.7 >

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-11-26 Thread Karl Higley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029318#comment-15029318 ] Karl Higley commented on SPARK-5992: I'm a bit confused by this section of the design doc: {quote} It

[jira] [Assigned] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12020: Assignee: Apache Spark (was: Yin Huai) > PR builder cannot trigger hadoop 2.0 test >

[jira] [Assigned] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12020: Assignee: Yin Huai (was: Apache Spark) > PR builder cannot trigger hadoop 2.0 test >

[jira] [Commented] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029328#comment-15029328 ] Apache Spark commented on SPARK-12020: -- User 'yhuai' has created a pull request for this issue:

[jira] [Resolved] (SPARK-11996) Executor thread dump is broken

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11996. - Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 > Executor thread

[jira] [Resolved] (SPARK-12011) Stddev/Variance etc should support columnName as arguments

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12011. - Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 1.6.0 > Stddev/Variance

[jira] [Resolved] (SPARK-11881) [SQL] JDBC Postgres fetchsize parameter ignored

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11881. - Resolution: Fixed Assignee: Marius Van Niekerk Fix Version/s: 1.6.0 > [SQL] JDBC

[jira] [Commented] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-26 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029429#comment-15029429 ] yuhao yang commented on SPARK-12000: Scala API can be generated. > `sbt publishLocal` hits a Scala

[jira] [Created] (SPARK-12022) spark-shell cannot run on master created with spark-ec2

2015-11-26 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-12022: --- Summary: spark-shell cannot run on master created with spark-ec2 Key: SPARK-12022 URL: https://issues.apache.org/jira/browse/SPARK-12022 Project: Spark

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029313#comment-15029313 ] Vincenzo Selvaggio commented on SPARK-11988: [~vfed] I have a related question, if we do

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Villu Ruusmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029319#comment-15029319 ] Villu Ruusmann commented on SPARK-11988: PMML@version is a required attribute. Your IDE should

[jira] [Assigned] (SPARK-11998) Branch 1.6's hadoop 2.2 tests always fail the entire VersionsSuite

2015-11-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-11998: Assignee: Yin Huai > Branch 1.6's hadoop 2.2 tests always fail the entire VersionsSuite >

[jira] [Resolved] (SPARK-11998) Branch 1.6's hadoop 2.2 tests always fail the entire VersionsSuite

2015-11-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11998. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9979

[jira] [Created] (SPARK-12020) PR builder cannot trigger hadoop 2.0 test

2015-11-26 Thread Yin Huai (JIRA)
Yin Huai created SPARK-12020: Summary: PR builder cannot trigger hadoop 2.0 test Key: SPARK-12020 URL: https://issues.apache.org/jira/browse/SPARK-12020 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11991) spark_ec2.py does not perform sanity checks on hostnames

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11991: Fix Version/s: 2.0.0 > spark_ec2.py does not perform sanity checks on hostnames >

[jira] [Resolved] (SPARK-11991) spark_ec2.py does not perform sanity checks on hostnames

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11991. - Resolution: Fixed > spark_ec2.py does not perform sanity checks on hostnames >

[jira] [Updated] (SPARK-11991) spark_ec2.py does not perform sanity checks on hostnames

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11991: Assignee: Jeremy Derr > spark_ec2.py does not perform sanity checks on hostnames >

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029425#comment-15029425 ] Saisai Shao commented on SPARK-12009: - So I guess your problem is that after you call {{sc.stop()}}

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029427#comment-15029427 ] SuYan commented on SPARK-12009: --- run on the spark 1.4.0, and check current 1.5.2, that problem still exist,

[jira] [Comment Edited] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-11-26 Thread Karl Higley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029318#comment-15029318 ] Karl Higley edited comment on SPARK-5992 at 11/26/15 11:20 PM: --- I'm a bit

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Vincenzo Selvaggio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029320#comment-15029320 ] Vincenzo Selvaggio commented on SPARK-11988: OK thanks! > Update JPMML to 1.2.7 >

[jira] [Created] (SPARK-12019) SparkR.init have wrong example

2015-11-26 Thread liushiqi9 (JIRA)
liushiqi9 created SPARK-12019: - Summary: SparkR.init have wrong example Key: SPARK-12019 URL: https://issues.apache.org/jira/browse/SPARK-12019 Project: Spark Issue Type: Bug Affects

[jira] [Created] (SPARK-12021) Fishy test of "don't call ssc.stop in listener"

2015-11-26 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-12021: --- Summary: Fishy test of "don't call ssc.stop in listener" Key: SPARK-12021 URL: https://issues.apache.org/jira/browse/SPARK-12021 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029410#comment-15029410 ] SuYan commented on SPARK-12009: --- = =, the log is based 1.4.0 {code} override def

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029416#comment-15029416 ] Saisai Shao commented on SPARK-12009: - So what actually version of Spark you're running? 1.4.0 or

[jira] [Comment Edited] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029416#comment-15029416 ] Saisai Shao edited comment on SPARK-12009 at 11/27/15 3:30 AM: --- So what

[jira] [Commented] (SPARK-11988) Update JPMML to 1.2.7

2015-11-26 Thread Villu Ruusmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029321#comment-15029321 ] Villu Ruusmann commented on SPARK-11988: On a related note, I am developing an Apache Spark

[jira] [Updated] (SPARK-12019) SparkR.init have wrong example

2015-11-26 Thread liushiqi9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liushiqi9 updated SPARK-12019: -- Component/s: R > SparkR.init have wrong example > -- > >

[jira] [Commented] (SPARK-11206) Support SQL UI on the history server

2015-11-26 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029357#comment-15029357 ] Carson Wang commented on SPARK-11206: - Yes, this is being fixed by

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

2015-11-26 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029361#comment-15029361 ] Peng Cheng commented on SPARK-10625: Hi committers, after 1.5.2 release this is still not merged, now

[jira] [Updated] (SPARK-11989) Spark JDBC write only works on techologies with transaction support

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11989: Assignee: Christian Kurz > Spark JDBC write only works on techologies with transaction support >

[jira] [Resolved] (SPARK-11917) Add SQLContext#dropTempTable to PySpark

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11917. - Resolution: Fixed Assignee: Jeff Zhang Fix Version/s: 1.6.0 > Add

[jira] [Updated] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SuYan updated SPARK-12009: -- Description: Log based 1.4.0 2015-11-26,03:05:16,176 WARN

[jira] [Assigned] (SPARK-12021) Fishy test of "don't call ssc.stop in listener"

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12021: Assignee: (was: Apache Spark) > Fishy test of "don't call ssc.stop in listener" >

[jira] [Commented] (SPARK-12021) Fishy test of "don't call ssc.stop in listener"

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029420#comment-15029420 ] Apache Spark commented on SPARK-12021: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-12002) offsetRanges attribute missing in Kafka RDD when resuming from checkpoint

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029421#comment-15029421 ] Saisai Shao commented on SPARK-12002: - Looks like because Python `KafkaTransformDStream` specific

[jira] [Assigned] (SPARK-12021) Fishy test of "don't call ssc.stop in listener"

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12021: Assignee: Apache Spark > Fishy test of "don't call ssc.stop in listener" >

[jira] [Comment Edited] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029431#comment-15029431 ] Saisai Shao edited comment on SPARK-12009 at 11/27/15 3:50 AM: --- Alright, my

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029431#comment-15029431 ] Saisai Shao commented on SPARK-12009: - Alright, my code is master branch. Anyway I understood your

[jira] [Commented] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix

2015-11-26 Thread Karl Higley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029442#comment-15029442 ] Karl Higley commented on SPARK-8614: After reading the description and referenced code, I think I can

[jira] [Resolved] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-26 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11997. Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved by pull

[jira] [Commented] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-26 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028334#comment-15028334 ] Dilip Biswal commented on SPARK-11997: -- I would like to work on this issue. > NPE when save a

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028340#comment-15028340 ] Saisai Shao commented on SPARK-12009: - Looking at the code again, {{onDisconnected}} in

[jira] [Commented] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2015-11-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028349#comment-15028349 ] Jeff Zhang commented on SPARK-4924: --- [~vanzin] Is there any user document about it ? I didn't find it on

[jira] [Resolved] (SPARK-11973) Filter pushdown does not work with aggregation with alias

2015-11-26 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11973. Resolution: Fixed Fix Version/s: 1.6.0 > Filter pushdown does not work with aggregation

[jira] [Commented] (SPARK-11987) Python API/Programming guide update for ChiSqSelector and QuantileDiscretizer

2015-11-26 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028358#comment-15028358 ] Xusen Yin commented on SPARK-11987: --- I am working on it > Python API/Programming guide update for

[jira] [Comment Edited] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-26 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028334#comment-15028334 ] Dilip Biswal edited comment on SPARK-11997 at 11/26/15 8:32 AM: I would

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028363#comment-15028363 ] SuYan commented on SPARK-12009: --- AM is not exit, it will exit while driver execute its usercode in

[jira] [Comment Edited] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028363#comment-15028363 ] SuYan edited comment on SPARK-12009 at 11/26/15 8:42 AM: - AM is not exit, it will

[jira] [Comment Edited] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028363#comment-15028363 ] SuYan edited comment on SPARK-12009 at 11/26/15 8:42 AM: - AM is not exit, it will

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028370#comment-15028370 ] Saisai Shao commented on SPARK-12009: - If I understood correctly, this log should come from

[jira] [Created] (SPARK-12011) Stddev/Variance etc should support columnName as arguments

2015-11-26 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12011: --- Summary: Stddev/Variance etc should support columnName as arguments Key: SPARK-12011 URL: https://issues.apache.org/jira/browse/SPARK-12011 Project: Spark

[jira] [Commented] (SPARK-12011) Stddev/Variance etc should support columnName as arguments

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028378#comment-15028378 ] Apache Spark commented on SPARK-12011: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12011) Stddev/Variance etc should support columnName as arguments

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12011: Assignee: (was: Apache Spark) > Stddev/Variance etc should support columnName as

[jira] [Commented] (SPARK-12009) Avoid re-allocate yarn container while driver want to stop all Executors

2015-11-26 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028375#comment-15028375 ] Saisai Shao commented on SPARK-12009: - Looks like you're running on yarn-cluster mode, but this log

[jira] [Assigned] (SPARK-12011) Stddev/Variance etc should support columnName as arguments

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12011: Assignee: Apache Spark > Stddev/Variance etc should support columnName as arguments >

[jira] [Commented] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

2015-11-26 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028381#comment-15028381 ] Huaxin Gao commented on SPARK-12010: I would like to work on this problem. > Spark JDBC requires

[jira] [Commented] (SPARK-11973) Filter pushdown does not work with aggregation with alias

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028393#comment-15028393 ] Apache Spark commented on SPARK-11973: -- User 'rxin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12005) VerifyError in HyperLogLogPlusPlus with newer JDKs

2015-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12005. - Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 > VerifyError in

[jira] [Commented] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

2015-11-26 Thread Christian Kurz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028404#comment-15028404 ] Christian Kurz commented on SPARK-12010: Hi Huaxin, thank you for your kind offer. Actually I

[jira] [Commented] (SPARK-8369) Support dependency jar and files on HDFS in standalone cluster mode

2015-11-26 Thread tawan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028437#comment-15028437 ] tawan commented on SPARK-8369: -- I am working on it now and will post a PR for it. > Support dependency jar

[jira] [Resolved] (SPARK-11950) Exception throws when executing “exit;” in spark-sql

2015-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11950. --- Resolution: Duplicate > Exception throws when executing “exit;” in spark-sql >

[jira] [Commented] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-26 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028451#comment-15028451 ] Stavros Kontopoulos commented on SPARK-11638: - I verified the example for spark version spark

[jira] [Comment Edited] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-26 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028451#comment-15028451 ] Stavros Kontopoulos edited comment on SPARK-11638 at 11/26/15 9:52 AM:

[jira] [Comment Edited] (SPARK-11638) Apache Spark in Docker with Bridge networking / run Spark on Mesos, in Docker with Bridge networking

2015-11-26 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028451#comment-15028451 ] Stavros Kontopoulos edited comment on SPARK-11638 at 11/26/15 9:54 AM:

[jira] [Assigned] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11997: Assignee: Apache Spark > NPE when save a DataFrame as parquet and partitioned by long

[jira] [Commented] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028539#comment-15028539 ] Apache Spark commented on SPARK-11997: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-11997) NPE when save a DataFrame as parquet and partitioned by long column

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11997: Assignee: (was: Apache Spark) > NPE when save a DataFrame as parquet and partitioned

[jira] [Commented] (SPARK-11405) ROW_NUMBER function does not adhere to window ORDER BY, when joining

2015-11-26 Thread Jarno Seppanen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028626#comment-15028626 ] Jarno Seppanen commented on SPARK-11405: Hi, I had a chance of trying this on Spark 1.5.2 and

[jira] [Closed] (SPARK-11405) ROW_NUMBER function does not adhere to window ORDER BY, when joining

2015-11-26 Thread Jarno Seppanen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarno Seppanen closed SPARK-11405. -- Resolution: Fixed Fix Version/s: 1.5.2 Works in Spark 1.5.2 > ROW_NUMBER function does

[jira] [Created] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-11-26 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12012: -- Summary: Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan Key: SPARK-12012 URL: https://issues.apache.org/jira/browse/SPARK-12012 Project:

[jira] [Commented] (SPARK-11551) Replace example code in ml-features.md using include_example

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028647#comment-15028647 ] Apache Spark commented on SPARK-11551: -- User 'somideshmukh' has created a pull request for this

[jira] [Created] (SPARK-12013) Add a Hive context method to retrieve the database Names

2015-11-26 Thread Jose Antonio (JIRA)
Jose Antonio created SPARK-12013: Summary: Add a Hive context method to retrieve the database Names Key: SPARK-12013 URL: https://issues.apache.org/jira/browse/SPARK-12013 Project: Spark

[jira] [Commented] (SPARK-2572) Can't delete local dir on executor automatically when running spark over Mesos.

2015-11-26 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028657#comment-15028657 ] Meethu Mathew commented on SPARK-2572: -- [~srowen] We are facing this issue with Mesos fine grained

[jira] [Commented] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028672#comment-15028672 ] Apache Spark commented on SPARK-12010: -- User 'CK50' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12010: Assignee: (was: Apache Spark) > Spark JDBC requires support for column-name-free

[jira] [Assigned] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12010: Assignee: Apache Spark > Spark JDBC requires support for column-name-free INSERT syntax >

[jira] [Assigned] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12012: Assignee: Apache Spark (was: Cheng Lian) > Show more comprehensive PhysicalRDD metadata

[jira] [Assigned] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12012: Assignee: Cheng Lian (was: Apache Spark) > Show more comprehensive PhysicalRDD metadata

[jira] [Commented] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028679#comment-15028679 ] Apache Spark commented on SPARK-12012: -- User 'liancheng' has created a pull request for this issue:

[jira] [Updated] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-11-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12012: --- Description: Currently a {{PhysicalRDD}} operator is just visualized as a node with nothing but a

[jira] [Updated] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2015-11-26 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12014: - Description: Actually it is known hive issue: https://issues.apache.org/jira/browse/HIVE-11100 patch

[jira] [Created] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2015-11-26 Thread Teng Qiu (JIRA)
Teng Qiu created SPARK-12014: Summary: Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100) Key: SPARK-12014 URL: https://issues.apache.org/jira/browse/SPARK-12014 Project:

[jira] [Updated] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2015-11-26 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12014: - Description: Actually it is known hive issue: https://issues.apache.org/jira/browse/HIVE-11100 patch

[jira] [Assigned] (SPARK-11960) User guide section for streaming a/b testing

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11960: Assignee: Apache Spark (was: Feynman Liang) > User guide section for streaming a/b

[jira] [Commented] (SPARK-11960) User guide section for streaming a/b testing

2015-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028801#comment-15028801 ] Apache Spark commented on SPARK-11960: -- User 'feynmanliang' has created a pull request for this

  1   2   >