[jira] [Commented] (SPARK-8471) Implement Discrete Cosine Transform feature transformer

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050608#comment-15050608 ] Apache Spark commented on SPARK-8471: - User 'feynmanliang' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12254) Spark with Tahchyon and Swift as underFS executor gets killed for unkown reason

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12254. --- Resolution: Invalid This isn't actionable, as you're not showing the real cause -- executor logs.

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051351#comment-15051351 ] Shivaram Venkataraman commented on SPARK-12232: --- Yeah I'm not sure we should expose

[jira] [Updated] (SPARK-12266) cannot handle postgis raster type

2015-12-10 Thread Severin Thaler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Severin Thaler updated SPARK-12266: --- Description: on server postgis server running with a table that has a column of type raster

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051438#comment-15051438 ] Shivaram Venkataraman commented on SPARK-6270: -- FWIW this problem happens 1.5.2 as well --

[jira] [Updated] (SPARK-12266) cannot handle postgis raster type

2015-12-10 Thread Severin Thaler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Severin Thaler updated SPARK-12266: --- Environment: PostGIS Server: Ubuntu-14.04 Postgres 9.4.5 PostGIS 2.2.1 Spark standalone

[jira] [Updated] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12198: -- Assignee: Yanbo Liang > SparkR support read.parquet and deprecate parquetFile

[jira] [Commented] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

2015-12-10 Thread Sunita Koppar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051286#comment-15051286 ] Sunita Koppar commented on SPARK-5281: -- We tried this workaround as well and the application works

[jira] [Resolved] (SPARK-11602) ML 1.6 QA: API: New Scala APIs, docs

2015-12-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11602. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Resolved] (SPARK-12234) SparkR subset throw error when only set "select" argument

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12234. --- Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 1.6.0

[jira] [Resolved] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-12-10 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12012. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10250

[jira] [Updated] (SPARK-12270) JDBC Where clause comparison doesn't work for DB2 char(n)

2015-12-10 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-12270: --- Description: I am doing some Spark jdbc test against DB2. My test is like this: {code}

[jira] [Commented] (SPARK-12270) JDBC Where clause comparison doesn't work for DB2 char(n)

2015-12-10 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051989#comment-15051989 ] Huaxin Gao commented on SPARK-12270: I will submit a PR soon > JDBC Where clause comparison doesn't

[jira] [Commented] (SPARK-4974) Circular dependency in pyspark/context.py causes import failure.

2015-12-10 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052060#comment-15052060 ] Gabor Liptak commented on SPARK-4974: - I have also seen this with ```python3``` (and when I tried to

[jira] [Commented] (SPARK-12266) cannot handle postgis raster type

2015-12-10 Thread Severin Thaler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052074#comment-15052074 ] Severin Thaler commented on SPARK-12266: but this is the same error as in and there it says it is

[jira] [Created] (SPARK-12272) Gradient boosted trees: too slow at the first finding best siplts

2015-12-10 Thread Wenmin Wu (JIRA)
Wenmin Wu created SPARK-12272: - Summary: Gradient boosted trees: too slow at the first finding best siplts Key: SPARK-12272 URL: https://issues.apache.org/jira/browse/SPARK-12272 Project: Spark

[jira] [Commented] (SPARK-8855) Python API for Association Rules

2015-12-10 Thread Caique Rodrigues Marques (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051971#comment-15051971 ] Caique Rodrigues Marques commented on SPARK-8855: - Thanks for the reply. I got to return

[jira] [Created] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

2015-12-10 Thread Nong Li (JIRA)
Nong Li created SPARK-12271: --- Summary: Improve error message for Dataset.as[] when the schema is incompatible. Key: SPARK-12271 URL: https://issues.apache.org/jira/browse/SPARK-12271 Project: Spark

[jira] [Commented] (SPARK-12270) JDBC Where clause comparison doesn't work for DB2 char(n)

2015-12-10 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052033#comment-15052033 ] Huaxin Gao commented on SPARK-12270:

[jira] [Issue Comment Deleted] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

2015-12-10 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Odersky updated SPARK-12271: -- Comment: was deleted (was: I'm just starting out with Datasets, will be glad to try fixing

[jira] [Commented] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

2015-12-10 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052084#comment-15052084 ] Xiao Li commented on SPARK-12271: - https://github.com/apache/spark/pull/10260 You can check the test

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052085#comment-15052085 ] Marcelo Vanzin commented on SPARK-12267: Hi [~zsxwing], [~andrewor14], I uploaded my code to

[jira] [Updated] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

2015-12-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-12148: Priority: Major (was: Critical) > SparkR: rename DataFrame to SparkDataFrame >

[jira] [Updated] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

2015-12-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-12148: Priority: Critical (was: Minor) > SparkR: rename DataFrame to SparkDataFrame >

[jira] [Updated] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

2015-12-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-12148: Issue Type: Improvement (was: Wish) > SparkR: rename DataFrame to SparkDataFrame >

[jira] [Updated] (SPARK-12270) JDBC Where clause comparison doesn't work for DB2 char(n)

2015-12-10 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-12270: --- Description: I am doing some Spark jdbc test against DB2. My test is like this: {code}

[jira] [Created] (SPARK-12270) JDBC Where clause comparison doesn't work for DB2 char(n)

2015-12-10 Thread Huaxin Gao (JIRA)
Huaxin Gao created SPARK-12270: -- Summary: JDBC Where clause comparison doesn't work for DB2 char(n) Key: SPARK-12270 URL: https://issues.apache.org/jira/browse/SPARK-12270 Project: Spark Issue

[jira] [Commented] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

2015-12-10 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052003#comment-15052003 ] Jakob Odersky commented on SPARK-12271: --- I'm just starting out with DataSets, will be glad to try

[jira] [Commented] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

2015-12-10 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052017#comment-15052017 ] Jakob Odersky commented on SPARK-12271: --- What's the exact use-case and error you encounter? >

[jira] [Closed] (SPARK-10608) turn off reduce tasks locality as default to avoid bad cases

2015-12-10 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang, Liye closed SPARK-10608. --- Resolution: Later > turn off reduce tasks locality as default to avoid bad cases >

[jira] [Comment Edited] (SPARK-12266) cannot handle postgis raster type

2015-12-10 Thread Severin Thaler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052074#comment-15052074 ] Severin Thaler edited comment on SPARK-12266 at 12/11/15 3:04 AM: -- but

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051995#comment-15051995 ] Marcelo Vanzin commented on SPARK-12267: My first approach was starting to get unwieldy, so I'm

[jira] [Comment Edited] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

2015-12-10 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052003#comment-15052003 ] Jakob Odersky edited comment on SPARK-12271 at 12/11/15 1:57 AM: - I'm

[jira] [Comment Edited] (SPARK-12270) JDBC Where clause comparison doesn't work for DB2 char(n)

2015-12-10 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052033#comment-15052033 ] Huaxin Gao edited comment on SPARK-12270 at 12/11/15 2:19 AM: --

[jira] [Issue Comment Deleted] (SPARK-12266) cannot handle postgis raster type

2015-12-10 Thread Severin Thaler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Severin Thaler updated SPARK-12266: --- Comment: was deleted (was: yes, not spark is to blame but the jdbc postgis driver. ill file

[jira] [Closed] (SPARK-12227) Support drop multiple columns specified by Column class in DataFrame API

2015-12-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon closed SPARK-12227. Resolution: Won't Fix This would not be fixed

[jira] [Comment Edited] (SPARK-12266) cannot handle postgis raster type

2015-12-10 Thread Severin Thaler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052074#comment-15052074 ] Severin Thaler edited comment on SPARK-12266 at 12/11/15 3:08 AM: -- but

[jira] [Commented] (SPARK-12258) Hive Timestamp UDF is binded with '1969-12-31 15:59:59.999999' for null value

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050930#comment-15050930 ] Apache Spark commented on SPARK-12258: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Resolved] (SPARK-11530) Return eigenvalues with PCA model

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11530. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9736

[jira] [Updated] (SPARK-11530) Return eigenvalues with PCA model

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11530: -- Priority: Minor (was: Major) > Return eigenvalues with PCA model > -

[jira] [Updated] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12263: -- Affects Version/s: (was: 1.6.0) Priority: Trivial (was: Major) Component/s:

[jira] [Assigned] (SPARK-12260) Graceful Shutdown with In-Memory State

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12260: Assignee: (was: Apache Spark) > Graceful Shutdown with In-Memory State >

[jira] [Assigned] (SPARK-12260) Graceful Shutdown with In-Memory State

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12260: Assignee: Apache Spark > Graceful Shutdown with In-Memory State >

[jira] [Commented] (SPARK-12231) Failed to generate predicate Error when using dropna

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050928#comment-15050928 ] Apache Spark commented on SPARK-12231: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12231) Failed to generate predicate Error when using dropna

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12231: Assignee: (was: Apache Spark) > Failed to generate predicate Error when using dropna

[jira] [Commented] (SPARK-12222) deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050945#comment-15050945 ] Apache Spark commented on SPARK-1: -- User 'adrian-wang' has created a pull request for this

[jira] [Resolved] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12136. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Updated] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12136: -- Assignee: Bo Meng > rddToFileName does not properly handle prefix and suffix parameters >

[jira] [Commented] (SPARK-3461) Support external groupByKey using repartitionAndSortWithinPartitions

2015-12-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050964#comment-15050964 ] Reynold Xin commented on SPARK-3461: It performs external sorting and traverse through the sorted

[jira] [Created] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

2015-12-10 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12263: --- Summary: IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit Key: SPARK-12263 URL: https://issues.apache.org/jira/browse/SPARK-12263

[jira] [Commented] (SPARK-12012) Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050929#comment-15050929 ] Apache Spark commented on SPARK-12012: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12231) Failed to generate predicate Error when using dropna

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12231: Assignee: Apache Spark > Failed to generate predicate Error when using dropna >

[jira] [Commented] (SPARK-12260) Graceful Shutdown with In-Memory State

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050927#comment-15050927 ] Apache Spark commented on SPARK-12260: -- User 'mwws' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12258) Hive Timestamp UDF is binded with '1969-12-31 15:59:59.999999' for null value

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12258: Assignee: Apache Spark > Hive Timestamp UDF is binded with '1969-12-31 15:59:59.99'

[jira] [Assigned] (SPARK-12258) Hive Timestamp UDF is binded with '1969-12-31 15:59:59.999999' for null value

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12258: Assignee: (was: Apache Spark) > Hive Timestamp UDF is binded with '1969-12-31

[jira] [Updated] (SPARK-9576) DataFrame API improvement umbrella ticket (Spark 2.0)

2015-12-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9576: --- Summary: DataFrame API improvement umbrella ticket (Spark 2.0) (was: DataFrame API improvement

[jira] [Commented] (SPARK-12273) Spark Streaming Web UI does not list Receivers in order

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052340#comment-15052340 ] Apache Spark commented on SPARK-12273: -- User 'proflin' has created a pull request for this issue:

[jira] [Commented] (SPARK-12274) WrapOption should not have type constraint for child

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052296#comment-15052296 ] Apache Spark commented on SPARK-12274: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-10991) LogisticRegressionTrainingSummary should dynamically add prediction col if there is no prediction col set

2015-12-10 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-10991. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9037

[jira] [Resolved] (SPARK-9465) Could not read parquet table after recreating it with the same table name

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9465. -- Resolution: Cannot Reproduce > Could not read parquet table after recreating it with the same table

[jira] [Created] (SPARK-12265) Spark calls System.exit inside driver instead of throwing exception

2015-12-10 Thread Iulian Dragos (JIRA)
Iulian Dragos created SPARK-12265: - Summary: Spark calls System.exit inside driver instead of throwing exception Key: SPARK-12265 URL: https://issues.apache.org/jira/browse/SPARK-12265 Project: Spark

[jira] [Commented] (SPARK-12264) Could DataType provide a TypeTag?

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051150#comment-15051150 ] Sean Owen commented on SPARK-12264: --- Maybe this should be a question on user@, or else rephrased as a

[jira] [Commented] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

2015-12-10 Thread Michael Han (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052197#comment-15052197 ] Michael Han commented on SPARK-2356: I follows this work around to fix this issue:

[jira] [Created] (SPARK-12276) Prevent RejectedExecutionException by checking if ThreadPoolExecutor is shutdown and its capacity

2015-12-10 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-12276: --- Summary: Prevent RejectedExecutionException by checking if ThreadPoolExecutor is shutdown and its capacity Key: SPARK-12276 URL:

[jira] [Created] (SPARK-12277) Use sparkIMain to compile and interpret string throw java.lang.ClassNotFoundException.

2015-12-10 Thread emma001 (JIRA)
emma001 created SPARK-12277: --- Summary: Use sparkIMain to compile and interpret string throw java.lang.ClassNotFoundException. Key: SPARK-12277 URL: https://issues.apache.org/jira/browse/SPARK-12277

[jira] [Commented] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

2015-12-10 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052181#comment-15052181 ] Xiao Li commented on SPARK-12218: - Yeah, I hope so. > Boolean logic in sql does not work "not (A and

[jira] [Created] (SPARK-12274) WrapOption should not have type constraint for child

2015-12-10 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12274: --- Summary: WrapOption should not have type constraint for child Key: SPARK-12274 URL: https://issues.apache.org/jira/browse/SPARK-12274 Project: Spark Issue

[jira] [Commented] (SPARK-12258) Hive Timestamp UDF is binded with '1969-12-31 15:59:59.999999' for null value

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1505#comment-1505 ] Apache Spark commented on SPARK-12258: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12276) Prevent RejectedExecutionException by checking if ThreadPoolExecutor is shutdown and its capacity

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12276: Assignee: (was: Apache Spark) > Prevent RejectedExecutionException by checking if

[jira] [Assigned] (SPARK-12275) No plan for BroadcastHint in some condition

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12275: Assignee: Apache Spark > No plan for BroadcastHint in some condition >

[jira] [Assigned] (SPARK-12275) No plan for BroadcastHint in some condition

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12275: Assignee: (was: Apache Spark) > No plan for BroadcastHint in some condition >

[jira] [Commented] (SPARK-12225) Support adding or replacing multiple columns at once in DataFrame API

2015-12-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052162#comment-15052162 ] Hyukjin Kwon commented on SPARK-12225: -- I also agree with adding this feature. I have seen several

[jira] [Created] (SPARK-12273) Spark Streaming Web UI does not list Receivers in order

2015-12-10 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-12273: - Summary: Spark Streaming Web UI does not list Receivers in order Key: SPARK-12273 URL: https://issues.apache.org/jira/browse/SPARK-12273 Project: Spark Issue

[jira] [Updated] (SPARK-12273) Spark Streaming Web UI does not list Receivers in order

2015-12-10 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-12273: -- Attachment: Spark-12273.png > Spark Streaming Web UI does not list Receivers in order >

[jira] [Commented] (SPARK-12267) Standalone master keeps references to disassociated workers until they sent no heartbeats

2015-12-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052169#comment-15052169 ] Shixiong Zhu commented on SPARK-12267: -- I saw the follow exception when following the steps: {code}

[jira] [Commented] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

2015-12-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052172#comment-15052172 ] Hyukjin Kwon commented on SPARK-12218: -- Then, does this mean closing this issue? [~smilegator] >

[jira] [Updated] (SPARK-12273) Spark Streaming Web UI does not list Receivers in order

2015-12-10 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-12273: -- Description: Currently the Streaming web UI does NOT list Receivers in order, while it seems more

[jira] [Assigned] (SPARK-12274) WrapOption should not have type constraint for child

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12274: Assignee: Apache Spark > WrapOption should not have type constraint for child >

[jira] [Updated] (SPARK-12275) No plan for BroadcastHint in some condition

2015-12-10 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12275: -- Description: *Summary* No plan for BroadcastHint is generated in some condition. *Test Case* {code} val

[jira] [Created] (SPARK-12275) No plan for BroadcastHint in some condition

2015-12-10 Thread yucai (JIRA)
yucai created SPARK-12275: - Summary: No plan for BroadcastHint in some condition Key: SPARK-12275 URL: https://issues.apache.org/jira/browse/SPARK-12275 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-12276) Prevent RejectedExecutionException by checking if ThreadPoolExecutor is shutdown and its capacity

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12276: Assignee: Apache Spark > Prevent RejectedExecutionException by checking if

[jira] [Assigned] (SPARK-3847) Enum.hashCode is only consistent within the same JVM

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3847: --- Assignee: (was: Apache Spark) > Enum.hashCode is only consistent within the same JVM >

[jira] [Commented] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051029#comment-15051029 ] Sean Owen commented on SPARK-12263: --- The message already gives you the solution though. Yes, I'm also

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051045#comment-15051045 ] Sean Owen commented on SPARK-4816: -- I don't know why it would be different -- are you sure you did a

[jira] [Comment Edited] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-10 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051056#comment-15051056 ] RJ Nowling edited comment on SPARK-4816 at 12/10/15 2:52 PM: - Hi [~srowen], I

[jira] [Commented] (SPARK-12263) IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

2015-12-10 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051017#comment-15051017 ] Jacek Laskowski commented on SPARK-12263: - Well, let's call it a doc issue. I don't mind unless

[jira] [Resolved] (SPARK-12242) DataFrame.transform function

2015-12-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12242. - Resolution: Fixed Fix Version/s: 1.6.0 > DataFrame.transform function >

[jira] [Assigned] (SPARK-3847) Enum.hashCode is only consistent within the same JVM

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3847: --- Assignee: Apache Spark > Enum.hashCode is only consistent within the same JVM >

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051059#comment-15051059 ] Apache Spark commented on SPARK-8333: - User 'navis' has created a pull request for this issue:

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-10 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051056#comment-15051056 ] RJ Nowling commented on SPARK-4816: --- Hi [~srowen], I haven't tried master yet but that wouldn't address

[jira] [Commented] (SPARK-1565) Spark examples should be changed given spark-submit

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051081#comment-15051081 ] Apache Spark commented on SPARK-1565: - User 'ScrapCodes' has created a pull request for this issue:

[jira] [Commented] (SPARK-2118) If tools jar is not present, MIMA build should exit with an exception

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051077#comment-15051077 ] Apache Spark commented on SPARK-2118: - User 'ScrapCodes' has created a pull request for this issue:

[jira] [Commented] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051088#comment-15051088 ] Apache Spark commented on SPARK-1199: - User 'ScrapCodes' has created a pull request for this issue:

[jira] [Commented] (SPARK-1776) Have Spark's SBT build read dependencies from Maven

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051073#comment-15051073 ] Apache Spark commented on SPARK-1776: - User 'ScrapCodes' has created a pull request for this issue:

[jira] [Commented] (SPARK-1322) Fix ordering of top() in Python

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051085#comment-15051085 ] Apache Spark commented on SPARK-1322: - User 'ScrapCodes' has created a pull request for this issue:

[jira] [Commented] (SPARK-1168) Add foldByKey to PySpark

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051089#comment-15051089 ] Apache Spark commented on SPARK-1168: - User 'ScrapCodes' has created a pull request for this issue:

[jira] [Commented] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051087#comment-15051087 ] Apache Spark commented on SPARK-1199: - User 'ScrapCodes' has created a pull request for this issue:

[jira] [Commented] (SPARK-1820) Make GenerateMimaIgnore @DeveloperApi annotation aware.

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051080#comment-15051080 ] Apache Spark commented on SPARK-1820: - User 'ScrapCodes' has created a pull request for this issue:

[jira] [Commented] (SPARK-2437) Rename MAVEN_PROFILES to SBT_MAVEN_PROFILES and add SBT_MAVEN_PROPERTIES

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051075#comment-15051075 ] Apache Spark commented on SPARK-2437: - User 'ScrapCodes' has created a pull request for this issue:

[jira] [Commented] (SPARK-1563) Add package-info.java and package.scala files for all packages that appear in docs

2015-12-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051082#comment-15051082 ] Apache Spark commented on SPARK-1563: - User 'ScrapCodes' has created a pull request for this issue:

<    1   2   3   >