[jira] [Assigned] (SPARK-15914) Add deprecated method back to SQLContext for backward compatiblity

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15914: Assignee: (was: Apache Spark) > Add deprecated method back to SQLContext for backward

[jira] [Assigned] (SPARK-15914) Add deprecated method back to SQLContext for backward compatiblity

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15914: Assignee: Apache Spark > Add deprecated method back to SQLContext for backward compatiblit

[jira] [Commented] (SPARK-15914) Add deprecated method back to SQLContext for backward compatiblity

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326901#comment-15326901 ] Apache Spark commented on SPARK-15914: -- User 'clockfly' has created a pull request f

[jira] [Updated] (SPARK-15914) Add deprecated method back to SQLContext for backward compatiblity

2016-06-12 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated SPARK-15914: --- Summary: Add deprecated method back to SQLContext for backward compatiblity (was: Add deprecated met

[jira] [Created] (SPARK-15914) Add deprecated method back to SQLContext for compatiblity

2016-06-12 Thread Sean Zhong (JIRA)
Sean Zhong created SPARK-15914: -- Summary: Add deprecated method back to SQLContext for compatiblity Key: SPARK-15914 URL: https://issues.apache.org/jira/browse/SPARK-15914 Project: Spark Issue T

[jira] [Commented] (SPARK-15637) SparkR tests failing on R 3.2.2

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326896#comment-15326896 ] Apache Spark commented on SPARK-15637: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-15159) SparkSession R API

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15159: Assignee: (was: Apache Spark) > SparkSession R API > -- > >

[jira] [Assigned] (SPARK-15159) SparkSession R API

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15159: Assignee: Apache Spark > SparkSession R API > -- > > Key:

[jira] [Commented] (SPARK-15159) SparkSession R API

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326885#comment-15326885 ] Apache Spark commented on SPARK-15159: -- User 'felixcheung' has created a pull reques

[jira] [Updated] (SPARK-15913) Dispatcher.stopped should be enclosed by synchronized block.

2016-06-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15913: -- Priority: Minor (was: Major) > Dispatcher.stopped should be enclosed by synchronized block. >

[jira] [Assigned] (SPARK-15913) Dispatcher.stopped should be enclosed by synchronized block.

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15913: Assignee: (was: Apache Spark) > Dispatcher.stopped should be enclosed by synchronized

[jira] [Assigned] (SPARK-15913) Dispatcher.stopped should be enclosed by synchronized block.

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15913: Assignee: Apache Spark > Dispatcher.stopped should be enclosed by synchronized block. > --

[jira] [Commented] (SPARK-15913) Dispatcher.stopped should be enclosed by synchronized block.

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326867#comment-15326867 ] Apache Spark commented on SPARK-15913: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Created] (SPARK-15913) Dispatcher.stopped should be enclosed by synchronized block.

2016-06-12 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-15913: - Summary: Dispatcher.stopped should be enclosed by synchronized block. Key: SPARK-15913 URL: https://issues.apache.org/jira/browse/SPARK-15913 Project: Spark

[jira] [Commented] (SPARK-15912) Replace getPartitionsByFilter by getPartitions in inputFiles of MetastoreRelation

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326854#comment-15326854 ] Apache Spark commented on SPARK-15912: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-15912) Replace getPartitionsByFilter by getPartitions in inputFiles of MetastoreRelation

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15912: Assignee: (was: Apache Spark) > Replace getPartitionsByFilter by getPartitions in inpu

[jira] [Assigned] (SPARK-15912) Replace getPartitionsByFilter by getPartitions in inputFiles of MetastoreRelation

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15912: Assignee: Apache Spark > Replace getPartitionsByFilter by getPartitions in inputFiles of

[jira] [Created] (SPARK-15912) Replace getPartitionsByFilter by getPartitions in inputFiles of MetastoreRelation

2016-06-12 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15912: --- Summary: Replace getPartitionsByFilter by getPartitions in inputFiles of MetastoreRelation Key: SPARK-15912 URL: https://issues.apache.org/jira/browse/SPARK-15912 Project: Spar

[jira] [Commented] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2016-06-12 Thread Fan Du (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326823#comment-15326823 ] Fan Du commented on SPARK-6707: --- Thanks alot! [~ankurcha] > Mesos Scheduler should allow th

[jira] [Commented] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2016-06-12 Thread Ankur Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326822#comment-15326822 ] Ankur Chauhan commented on SPARK-6707: -- Yes that is exactly what was what is wanted t

[jira] [Resolved] (SPARK-15898) DataFrameReader.text should return DataFrame

2016-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15898. - Resolution: Fixed Fix Version/s: 2.0.0 > DataFrameReader.text should return DataFrame > --

[jira] [Assigned] (SPARK-15910) Schema is not checked when converting DataFrame to Dataset using Kryo encoder

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15910: Assignee: (was: Apache Spark) > Schema is not checked when converting DataFrame to Dat

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2016-06-12 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326793#comment-15326793 ] Russell Alexander Spitzer commented on SPARK-11415: --- I honestly am supe

[jira] [Commented] (SPARK-15910) Schema is not checked when converting DataFrame to Dataset using Kryo encoder

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326794#comment-15326794 ] Apache Spark commented on SPARK-15910: -- User 'clockfly' has created a pull request f

[jira] [Assigned] (SPARK-15910) Schema is not checked when converting DataFrame to Dataset using Kryo encoder

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15910: Assignee: Apache Spark > Schema is not checked when converting DataFrame to Dataset using

[jira] [Commented] (SPARK-15911) Remove additional Project to be consistent with SQL when insert into table

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326789#comment-15326789 ] Apache Spark commented on SPARK-15911: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-15911) Remove additional Project to be consistent with SQL when insert into table

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15911: Assignee: Apache Spark > Remove additional Project to be consistent with SQL when insert i

[jira] [Assigned] (SPARK-15911) Remove additional Project to be consistent with SQL when insert into table

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15911: Assignee: (was: Apache Spark) > Remove additional Project to be consistent with SQL wh

[jira] [Created] (SPARK-15911) Remove additional Project to be consistent with SQL when insert into table

2016-06-12 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-15911: --- Summary: Remove additional Project to be consistent with SQL when insert into table Key: SPARK-15911 URL: https://issues.apache.org/jira/browse/SPARK-15911 Proj

[jira] [Created] (SPARK-15910) Schema is not checked when converting DataFrame to Dataset using Kryo encoder

2016-06-12 Thread Sean Zhong (JIRA)
Sean Zhong created SPARK-15910: -- Summary: Schema is not checked when converting DataFrame to Dataset using Kryo encoder Key: SPARK-15910 URL: https://issues.apache.org/jira/browse/SPARK-15910 Project: Sp

[jira] [Updated] (SPARK-15909) PySpark classpath uri incorrectly set

2016-06-12 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liam Fisk updated SPARK-15909: -- Description: PySpark behaves differently if the SparkContext is created within the REPL (vs initialise

[jira] [Updated] (SPARK-15909) PySpark classpath uri incorrectly set

2016-06-12 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liam Fisk updated SPARK-15909: -- Description: PySpark behaves differently if the SparkContext is created within the REPL (vs initialise

[jira] [Updated] (SPARK-15909) PySpark classpath uri incorrectly set

2016-06-12 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liam Fisk updated SPARK-15909: -- Description: PySpark behaves differently if the SparkContext is created within the REPL (vs initialise

[jira] [Commented] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326768#comment-15326768 ] Josh Rosen commented on SPARK-15613: After some more digging, I think that {{threadL

[jira] [Updated] (SPARK-15909) PySpark classpath uri incorrectly set

2016-06-12 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liam Fisk updated SPARK-15909: -- Description: PySpark behaves differently if the SparkContext is created within the REPL (vs initialise

[jira] [Created] (SPARK-15909) PySpark classpath uri incorrectly set

2016-06-12 Thread Liam Fisk (JIRA)
Liam Fisk created SPARK-15909: - Summary: PySpark classpath uri incorrectly set Key: SPARK-15909 URL: https://issues.apache.org/jira/browse/SPARK-15909 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326762#comment-15326762 ] Josh Rosen commented on SPARK-11415: On the other hand, it seems clear that for a sin

[jira] [Comment Edited] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326762#comment-15326762 ] Josh Rosen edited comment on SPARK-11415 at 6/13/16 3:03 AM: -

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326758#comment-15326758 ] Josh Rosen commented on SPARK-11415: Note that {{Date.valueOf}} appears to be impacte

[jira] [Commented] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326757#comment-15326757 ] Josh Rosen commented on SPARK-15613: Note that {{Date.valueOf}} appears to be impacte

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326754#comment-15326754 ] Josh Rosen commented on SPARK-11415: Hey [~rspitzer], do you mean the opposite, that

[jira] [Created] (SPARK-15908) Add varargs-type dropDuplicates() function in SparkR

2016-06-12 Thread Sun Rui (JIRA)
Sun Rui created SPARK-15908: --- Summary: Add varargs-type dropDuplicates() function in SparkR Key: SPARK-15908 URL: https://issues.apache.org/jira/browse/SPARK-15908 Project: Spark Issue Type: New Fe

[jira] [Commented] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326748#comment-15326748 ] Apache Spark commented on SPARK-15892: -- User 'HyukjinKwon' has created a pull reques

[jira] [Comment Edited] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326745#comment-15326745 ] Josh Rosen edited comment on SPARK-15613 at 6/13/16 2:09 AM: -

[jira] [Comment Edited] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326745#comment-15326745 ] Josh Rosen edited comment on SPARK-15613 at 6/13/16 2:05 AM: -

[jira] [Commented] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326745#comment-15326745 ] Josh Rosen commented on SPARK-15613: The current code also appears to violate the inv

[jira] [Comment Edited] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326745#comment-15326745 ] Josh Rosen edited comment on SPARK-15613 at 6/13/16 1:59 AM: -

[jira] [Updated] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-15613: --- Priority: Critical (was: Major) > Incorrect days to millis conversion > ---

[jira] [Updated] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-15613: --- Affects Version/s: 2.0.0 > Incorrect days to millis conversion > ---

[jira] [Commented] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326727#comment-15326727 ] Josh Rosen commented on SPARK-15613: For anyone else investigating this, it's importa

[jira] [Commented] (SPARK-15613) Incorrect days to millis conversion

2016-06-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326721#comment-15326721 ] Josh Rosen commented on SPARK-15613: I've added a regression test to Spark's DateTime

[jira] [Commented] (SPARK-15370) Some correlated subqueries return incorrect answers

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326699#comment-15326699 ] Apache Spark commented on SPARK-15370: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-15907) Issue Exception when Not Enough Input Columns for Dynamic Partitioning

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15907: Assignee: Apache Spark > Issue Exception when Not Enough Input Columns for Dynamic Partiti

[jira] [Commented] (SPARK-15907) Issue Exception when Not Enough Input Columns for Dynamic Partitioning

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326693#comment-15326693 ] Apache Spark commented on SPARK-15907: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-15907) Issue Exception when Not Enough Input Columns for Dynamic Partitioning

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15907: Assignee: (was: Apache Spark) > Issue Exception when Not Enough Input Columns for Dyna

[jira] [Updated] (SPARK-15870) DataFrame can't execute after uncacheTable.

2016-06-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15870: Assignee: Takuya Ueshin > DataFrame can't execute after uncacheTable. > ---

[jira] [Resolved] (SPARK-15870) DataFrame can't execute after uncacheTable.

2016-06-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15870. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13596 [https://githu

[jira] [Commented] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-12 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326685#comment-15326685 ] MIN-FU YANG commented on SPARK-15906: - tilumi has pr: https://github.com/apache/spark

[jira] [Issue Comment Deleted] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-12 Thread MIN-FU YANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MIN-FU YANG updated SPARK-15906: Comment: was deleted (was: tilumi has pr: https://github.com/apache/spark/pull/13627 for this issue

[jira] [Created] (SPARK-15907) Issue Exception when Not Enough Input Columns for Dynamic Partitioning

2016-06-12 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15907: --- Summary: Issue Exception when Not Enough Input Columns for Dynamic Partitioning Key: SPARK-15907 URL: https://issues.apache.org/jira/browse/SPARK-15907 Project: Spark

[jira] [Commented] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326677#comment-15326677 ] Apache Spark commented on SPARK-15906: -- User 'tilumi' has created a pull request for

[jira] [Assigned] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15906: Assignee: Apache Spark > Complementary Naive Bayes Algorithm Implementation >

[jira] [Assigned] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15906: Assignee: (was: Apache Spark) > Complementary Naive Bayes Algorithm Implementation > -

[jira] [Created] (SPARK-15906) Complementary Naive Bayes Algorithm Implementation

2016-06-12 Thread MIN-FU YANG (JIRA)
MIN-FU YANG created SPARK-15906: --- Summary: Complementary Naive Bayes Algorithm Implementation Key: SPARK-15906 URL: https://issues.apache.org/jira/browse/SPARK-15906 Project: Spark Issue Type:

[jira] [Created] (SPARK-15905) Driver hung while writing to console progress bar

2016-06-12 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-15905: --- Summary: Driver hung while writing to console progress bar Key: SPARK-15905 URL: https://issues.apache.org/jira/browse/SPARK-15905 Project: Spark Issue Type: B

[jira] [Updated] (SPARK-15905) Driver hung while writing to console progress bar

2016-06-12 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-15905: Description: This leads to driver being not able to get heartbeats from its executors and job bein

[jira] [Commented] (SPARK-15370) Some correlated subqueries return incorrect answers

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326652#comment-15326652 ] Apache Spark commented on SPARK-15370: -- User 'hvanhovell' has created a pull request

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326648#comment-15326648 ] Shivaram Venkataraman commented on SPARK-15799: --- [~sunrui] Your proposal so

[jira] [Commented] (SPARK-15370) Some correlated subqueries return incorrect answers

2016-06-12 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326643#comment-15326643 ] Herman van Hovell commented on SPARK-15370: --- [~freiss] For some reason I cannot

[jira] [Resolved] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

2016-06-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-15892. --- Resolution: Fixed Fix Version/s: 1.6.2 2.0.0 Issue resolved

[jira] [Resolved] (SPARK-15832) Embedded IN/EXISTS predicate subquery throws TreeNodeException

2016-06-12 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-15832. --- Resolution: Resolved Assignee: Ioana Delaney Fix Version/s: 2.0.0 > E

[jira] [Updated] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

2016-06-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15892: -- Target Version/s: 1.6.2, 2.0.0 > Incorrectly merged AFTAggregator with zero total count

[jira] [Resolved] (SPARK-15370) Some correlated subqueries return incorrect answers

2016-06-12 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-15370. --- Resolution: Resolved > Some correlated subqueries return incorrect answers >

[jira] [Commented] (SPARK-15781) Misleading deprecated property in standalone cluster configuration documentation

2016-06-12 Thread Jonathan Taws (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326595#comment-15326595 ] Jonathan Taws commented on SPARK-15781: --- Sure, we'll see if any update can be done

[jira] [Commented] (SPARK-15479) Spark job doesn't shut gracefully in yarn mode.

2016-06-12 Thread Elizabeth Keddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326589#comment-15326589 ] Elizabeth Keddy commented on SPARK-15479: - Thanks [~srowen]. I have that code in

[jira] [Commented] (SPARK-15479) Spark job doesn't shut gracefully in yarn mode.

2016-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326585#comment-15326585 ] Sean Owen commented on SPARK-15479: --- The best way is to call stop() on the streaming co

[jira] [Updated] (SPARK-15904) High Memory Pressure using MLlib K-means

2016-06-12 Thread Alessio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessio updated SPARK-15904: Description: Running MLlib K-Means on a ~400MB dataset (12 partitions), persisted on Memory and Disk. Ever

[jira] [Resolved] (SPARK-15876) Remove support for "zk://" master URL

2016-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15876. - Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 > Remove support for "

[jira] [Updated] (SPARK-11806) Spark 2.0 deprecations and removals

2016-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11806: Fix Version/s: 2.0.0 > Spark 2.0 deprecations and removals > --- >

[jira] [Updated] (SPARK-15876) Remove support for "zk://" master URL

2016-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15876: Issue Type: Sub-task (was: Task) Parent: SPARK-11806 > Remove support for "zk://" master U

[jira] [Resolved] (SPARK-15086) Update Java API once the Scala one is finalized

2016-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15086. - Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 > Update Java API once

[jira] [Updated] (SPARK-15904) High Memory Pressure using MLlib K-means

2016-06-12 Thread Alessio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessio updated SPARK-15904: Description: Running MLlib K-Means on a ~400MB dataset (12 partitions), persisted on Memory and Disk. Ever

[jira] [Updated] (SPARK-15904) High Memory Pressure using MLlib K-means

2016-06-12 Thread Alessio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alessio updated SPARK-15904: Description: Running MLlib K-Means on a ~400MB dataset (12 partitions), persisted on Memory and Disk. Ever

[jira] [Created] (SPARK-15904) High Memory Pressure using MLlib K-means

2016-06-12 Thread Alessio (JIRA)
Alessio created SPARK-15904: --- Summary: High Memory Pressure using MLlib K-means Key: SPARK-15904 URL: https://issues.apache.org/jira/browse/SPARK-15904 Project: Spark Issue Type: Bug Comp

[jira] [Commented] (SPARK-15479) Spark job doesn't shut gracefully in yarn mode.

2016-06-12 Thread Elizabeth Keddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326576#comment-15326576 ] Elizabeth Keddy commented on SPARK-15479: - Are there instructions on how to grace

[jira] [Updated] (SPARK-15796) Reduce spark.memory.fraction default to avoid overrunning old gen in JVM default config

2016-06-12 Thread Gabor Feher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Feher updated SPARK-15796: Attachment: baseline.txt memfrac06.txt memfrac063.txt

[jira] [Commented] (SPARK-15849) FileNotFoundException on _temporary while doing saveAsTable to S3

2016-06-12 Thread Sandeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326572#comment-15326572 ] Sandeep commented on SPARK-15849: - Thanks for your comments, Steve. 1. I am currently usi

[jira] [Commented] (SPARK-15899) file scheme should be used correctly

2016-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326540#comment-15326540 ] Sean Owen commented on SPARK-15899: --- I don't think that's what the reference says. A ho

[jira] [Commented] (SPARK-15899) file scheme should be used correctly

2016-06-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326537#comment-15326537 ] Kazuaki Ishizaki commented on SPARK-15899: -- Thank you for your comments. It is

[jira] [Commented] (SPARK-6190) create LargeByteBuffer abstraction for eliminating 2GB limit on blocks

2016-06-12 Thread Brian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326532#comment-15326532 ] Brian commented on SPARK-6190: -- This is a terrible problem which I'm hoping someone will solv

[jira] [Updated] (SPARK-15806) Deprecate SPARK_MASTER_IP in favor of SPARK_MASTER_HOST

2016-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15806: -- Assignee: Bo Meng Issue Type: Improvement (was: Bug) Summary: Deprecate SPARK_MASTER_IP in

[jira] [Resolved] (SPARK-15806) Update doc for SPARK_MASTER_IP

2016-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15806. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13543 [https://github.co

[jira] [Updated] (SPARK-15903) Support AllColumn expression in UDF functions

2016-06-12 Thread Lijie Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Xu updated SPARK-15903: - Description: Sometimes, we want to put all the columns in the UDF functions such as "concat()". We would

[jira] [Updated] (SPARK-15903) Support AllColumn expression in UDF functions

2016-06-12 Thread Lijie Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Xu updated SPARK-15903: - Description: Sometimes, we want to put all the columns in the UDF functions such as "concat()". We would

[jira] [Created] (SPARK-15903) Support AllColumn expression in UDF functions

2016-06-12 Thread Lijie Xu (JIRA)
Lijie Xu created SPARK-15903: Summary: Support AllColumn expression in UDF functions Key: SPARK-15903 URL: https://issues.apache.org/jira/browse/SPARK-15903 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-15876) Remove support for "zk://" master URL

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15876: Assignee: (was: Apache Spark) > Remove support for "zk://" master URL > --

[jira] [Assigned] (SPARK-15876) Remove support for "zk://" master URL

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15876: Assignee: Apache Spark > Remove support for "zk://" master URL > -

[jira] [Commented] (SPARK-15876) Remove support for "zk://" master URL

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326415#comment-15326415 ] Apache Spark commented on SPARK-15876: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-15858) "evaluateEachIteration" will fail on trying to run it on a model with 500+ trees

2016-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15326405#comment-15326405 ] Apache Spark commented on SPARK-15858: -- User 'mhmoudr' has created a pull request fo

[jira] [Updated] (SPARK-15781) Misleading deprecated property in standalone cluster configuration documentation

2016-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15781: -- Assignee: Bo Meng Let's leave it at bomeng's PR for now. > Misleading deprecated property in standalon

  1   2   >