[jira] [Commented] (SPARK-16946) saveAsTable[append] with different number of columns should throw Exception

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411373#comment-15411373 ] Apache Spark commented on SPARK-16946: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-16946) saveAsTable[append] with different number of columns should throw Exception

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16946: Assignee: Apache Spark > saveAsTable[append] with different number of columns should throw

[jira] [Assigned] (SPARK-16946) saveAsTable[append] with different number of columns should throw Exception

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16946: Assignee: (was: Apache Spark) > saveAsTable[append] with different number of columns s

[jira] [Commented] (SPARK-16941) SparkSQLOperationManager shuold use synchronization map to store SessionHandle

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411368#comment-15411368 ] Apache Spark commented on SPARK-16941: -- User 'SaintBacchus' has created a pull reque

[jira] [Assigned] (SPARK-16941) SparkSQLOperationManager shuold use synchronization map to store SessionHandle

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16941: Assignee: (was: Apache Spark) > SparkSQLOperationManager shuold use synchronization ma

[jira] [Assigned] (SPARK-16941) SparkSQLOperationManager shuold use synchronization map to store SessionHandle

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16941: Assignee: Apache Spark > SparkSQLOperationManager shuold use synchronization map to store

[jira] [Commented] (SPARK-11638) Run Spark on Mesos with bridge networking

2016-08-07 Thread Radoslaw Gruchalski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411366#comment-15411366 ] Radoslaw Gruchalski commented on SPARK-11638: - [~mandoskippy] I have not been

[jira] [Created] (SPARK-16946) saveAsTable[append] with different number of columns should throw Exception

2016-08-07 Thread Huaxin Gao (JIRA)
Huaxin Gao created SPARK-16946: -- Summary: saveAsTable[append] with different number of columns should throw Exception Key: SPARK-16946 URL: https://issues.apache.org/jira/browse/SPARK-16946 Project: Spar

[jira] [Commented] (SPARK-16606) Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411328#comment-15411328 ] Apache Spark commented on SPARK-16606: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-16606) Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16606: Assignee: Apache Spark > Misleading warning for SparkContext.getOrCreate "WARN SparkContex

[jira] [Assigned] (SPARK-16606) Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16606: Assignee: (was: Apache Spark) > Misleading warning for SparkContext.getOrCreate "WARN

[jira] [Comment Edited] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411319#comment-15411319 ] Sun Rui edited comment on SPARK-16944 at 8/8/16 5:29 AM: - I don't

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411320#comment-15411320 ] Sun Rui commented on SPARK-16944: - I don't think it can be improved without dynamic alloc

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411319#comment-15411319 ] Sun Rui commented on SPARK-16944: - I don't think it can be improved without dynamic alloc

[jira] [Issue Comment Deleted] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-16944: Comment: was deleted (was: I don't think it can be improved without dynamic allocation. because without dy

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411315#comment-15411315 ] Michael Gummelt commented on SPARK-16944: - Yea, we typically call it "delay sched

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411313#comment-15411313 ] Sun Rui commented on SPARK-16944: - Not quite sure. I think the Mesos scheduler backend ca

[jira] [Resolved] (SPARK-16919) Configurable update interval for console progress bar

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16919. --- Resolution: Fixed Assignee: Tejas Patil Fix Version/s: 2.1.0 Resolved by https://gith

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411309#comment-15411309 ] Michael Gummelt commented on SPARK-16944: - Since Mesos is offer based, it's up to

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411307#comment-15411307 ] Michael Gummelt commented on SPARK-16944: - I think we can improve both with and w

[jira] [Commented] (SPARK-16945) Fix Java Lint errors

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411305#comment-15411305 ] Sean Owen commented on SPARK-16945: --- Probably does not need a JIRA. We have to do this

[jira] [Updated] (SPARK-16945) Fix Java Lint errors

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16945: -- Assignee: Weiqing Yang Priority: Trivial (was: Minor) > Fix Java Lint errors > ---

[jira] [Assigned] (SPARK-16945) Fix Java Lint errors

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16945: Assignee: (was: Apache Spark) > Fix Java Lint errors > > >

[jira] [Commented] (SPARK-16945) Fix Java Lint errors

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411303#comment-15411303 ] Apache Spark commented on SPARK-16945: -- User 'Sherry302' has created a pull request

[jira] [Assigned] (SPARK-16945) Fix Java Lint errors

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16945: Assignee: Apache Spark > Fix Java Lint errors > > > K

[jira] [Comment Edited] (SPARK-16918) Weird error when selecting more than 100 spark udf columns

2016-08-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411282#comment-15411282 ] Hyukjin Kwon edited comment on SPARK-16918 at 8/8/16 5:14 AM: -

[jira] [Commented] (SPARK-16918) Weird error when selecting more than 100 spark udf columns

2016-08-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411300#comment-15411300 ] Hyukjin Kwon commented on SPARK-16918: -- Oh, thanks for pointing this out. I just did

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411299#comment-15411299 ] Saisai Shao commented on SPARK-16944: - Does Mesos have the similar concept like Yarn

[jira] [Updated] (SPARK-16945) Fix Java Lint errors

2016-08-07 Thread Weiqing Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiqing Yang updated SPARK-16945: - Component/s: Build > Fix Java Lint errors > > > Key: SPARK-1

[jira] [Created] (SPARK-16945) Fix Java Lint errors

2016-08-07 Thread Weiqing Yang (JIRA)
Weiqing Yang created SPARK-16945: Summary: Fix Java Lint errors Key: SPARK-16945 URL: https://issues.apache.org/jira/browse/SPARK-16945 Project: Spark Issue Type: Task Reporter: W

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411297#comment-15411297 ] Sun Rui commented on SPARK-16944: - [~jerryshao] [~mgummelt] > [MESOS] Improve data local

[jira] [Issue Comment Deleted] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-16944: Comment: was deleted (was: [~jerryshao] [~mgummelt]) > [MESOS] Improve data locality when launching new ex

[jira] [Commented] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411295#comment-15411295 ] Sun Rui commented on SPARK-16944: - [~jerryshao] [~mgummelt] > [MESOS] Improve data local

[jira] [Commented] (SPARK-16918) Weird error when selecting more than 100 spark udf columns

2016-08-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411292#comment-15411292 ] Dongjoon Hyun commented on SPARK-16918: --- By the way, you need to test with N=101 .

[jira] [Created] (SPARK-16944) [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled

2016-08-07 Thread Sun Rui (JIRA)
Sun Rui created SPARK-16944: --- Summary: [MESOS] Improve data locality when launching new executors when dynamic allocation is enabled Key: SPARK-16944 URL: https://issues.apache.org/jira/browse/SPARK-16944 P

[jira] [Resolved] (SPARK-16918) Weird error when selecting more than 100 spark udf columns

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16918. --- Resolution: Not A Problem OK, it's probably a duplicate of something else then but I don't know what.

[jira] [Commented] (SPARK-16918) Weird error when selecting more than 100 spark udf columns

2016-08-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411289#comment-15411289 ] Dongjoon Hyun commented on SPARK-16918: --- Oh, fast [~hyukjin.kwon]! :) > Weird erro

[jira] [Commented] (SPARK-16918) Weird error when selecting more than 100 spark udf columns

2016-08-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411287#comment-15411287 ] Dongjoon Hyun commented on SPARK-16918: --- Hi, [~phihungle]. I met the same error in

[jira] [Comment Edited] (SPARK-16918) Weird error when selecting more than 100 spark udf columns

2016-08-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411287#comment-15411287 ] Dongjoon Hyun edited comment on SPARK-16918 at 8/8/16 5:03 AM:

[jira] [Commented] (SPARK-16918) Weird error when selecting more than 100 spark udf columns

2016-08-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411282#comment-15411282 ] Hyukjin Kwon commented on SPARK-16918: -- FYI, it seems fine in current master fortuna

[jira] [Commented] (SPARK-11638) Run Spark on Mesos with bridge networking

2016-08-07 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411277#comment-15411277 ] Michael Gummelt commented on SPARK-11638: - This JIRA is complex and a lot of it i

[jira] [Assigned] (SPARK-16942) CREATE TABLE LIKE generates External table when source table is an External Hive Serde table

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16942: Assignee: (was: Apache Spark) > CREATE TABLE LIKE generates External table when source

[jira] [Commented] (SPARK-16942) CREATE TABLE LIKE generates External table when source table is an External Hive Serde table

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411264#comment-15411264 ] Apache Spark commented on SPARK-16942: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-16942) CREATE TABLE LIKE generates External table when source table is an External Hive Serde table

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16942: Assignee: Apache Spark > CREATE TABLE LIKE generates External table when source table is a

[jira] [Assigned] (SPARK-16943) CREATE TABLE LIKE generates a non-empty table when source is a data source table

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16943: Assignee: Apache Spark > CREATE TABLE LIKE generates a non-empty table when source is a da

[jira] [Commented] (SPARK-16943) CREATE TABLE LIKE generates a non-empty table when source is a data source table

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411258#comment-15411258 ] Apache Spark commented on SPARK-16943: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-16943) CREATE TABLE LIKE generates a non-empty table when source is a data source table

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16943: Assignee: (was: Apache Spark) > CREATE TABLE LIKE generates a non-empty table when sou

[jira] [Updated] (SPARK-16942) CREATE TABLE LIKE generates External table when source table is External

2016-08-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-16942: Summary: CREATE TABLE LIKE generates External table when source table is External (was: CREATE TABLE LIKE

[jira] [Updated] (SPARK-16942) CREATE TABLE LIKE generates External table when source table is an External Hive Serde table

2016-08-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-16942: Summary: CREATE TABLE LIKE generates External table when source table is an External Hive Serde table (was

[jira] [Created] (SPARK-16943) CREATE TABLE LIKE generates a non-empty table when source is a data source table

2016-08-07 Thread Xiao Li (JIRA)
Xiao Li created SPARK-16943: --- Summary: CREATE TABLE LIKE generates a non-empty table when source is a data source table Key: SPARK-16943 URL: https://issues.apache.org/jira/browse/SPARK-16943 Project: Spark

[jira] [Created] (SPARK-16942) CREATE TABLE LIKE generates External table when Source table is External

2016-08-07 Thread Xiao Li (JIRA)
Xiao Li created SPARK-16942: --- Summary: CREATE TABLE LIKE generates External table when Source table is External Key: SPARK-16942 URL: https://issues.apache.org/jira/browse/SPARK-16942 Project: Spark

[jira] [Created] (SPARK-16941) SparkSQLOperationManager shuold use synchronization map to store SessionHandle

2016-08-07 Thread carlmartin (JIRA)
carlmartin created SPARK-16941: -- Summary: SparkSQLOperationManager shuold use synchronization map to store SessionHandle Key: SPARK-16941 URL: https://issues.apache.org/jira/browse/SPARK-16941 Project: S

[jira] [Commented] (SPARK-16666) Kryo encoder for custom complex classes

2016-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411207#comment-15411207 ] Wenchen Fan commented on SPARK-1: - [~samehraban] , in your stack trace, `Querya

[jira] [Commented] (SPARK-15899) file scheme should be used correctly

2016-08-07 Thread xuyifei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411190#comment-15411190 ] xuyifei commented on SPARK-15899: - really appreciate, it works,( sorry reply too late >

[jira] [Commented] (SPARK-16868) Executor will be both dead and alive when this executor reregister itself to driver.

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411180#comment-15411180 ] Apache Spark commented on SPARK-16868: -- User 'SaintBacchus' has created a pull reque

[jira] [Assigned] (SPARK-16868) Executor will be both dead and alive when this executor reregister itself to driver.

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16868: Assignee: (was: Apache Spark) > Executor will be both dead and alive when this executo

[jira] [Assigned] (SPARK-16868) Executor will be both dead and alive when this executor reregister itself to driver.

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16868: Assignee: Apache Spark > Executor will be both dead and alive when this executor reregiste

[jira] [Comment Edited] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411159#comment-15411159 ] Saisai Shao edited comment on SPARK-16914 at 8/8/16 1:48 AM: -

[jira] [Commented] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411159#comment-15411159 ] Saisai Shao commented on SPARK-16914: - So from your description, is this exception ma

[jira] [Commented] (SPARK-16940) `checkAnswer` should raise `TestFailedException` for wrong results

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411145#comment-15411145 ] Apache Spark commented on SPARK-16940: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-16940) `checkAnswer` should raise `TestFailedException` for wrong results

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16940: Assignee: (was: Apache Spark) > `checkAnswer` should raise `TestFailedException` for w

[jira] [Assigned] (SPARK-16940) `checkAnswer` should raise `TestFailedException` for wrong results

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16940: Assignee: Apache Spark > `checkAnswer` should raise `TestFailedException` for wrong result

[jira] [Created] (SPARK-16940) `checkAnswer` should raise `TestFailedException` for wrong results

2016-08-07 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-16940: - Summary: `checkAnswer` should raise `TestFailedException` for wrong results Key: SPARK-16940 URL: https://issues.apache.org/jira/browse/SPARK-16940 Project: Spark

[jira] [Commented] (SPARK-16937) Confusing behaviors when View and Temp View sharing the same names

2016-08-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411137#comment-15411137 ] Xiao Li commented on SPARK-16937: - Sure, will do it. Thanks! > Confusing behaviors when

[jira] [Commented] (SPARK-16937) Confusing behaviors when View and Temp View sharing the same names

2016-08-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411134#comment-15411134 ] Wenchen Fan commented on SPARK-16937: - For the problem described in the JIRA, yea, se

[jira] [Commented] (SPARK-16508) Fix documentation warnings found by R CMD check

2016-08-07 Thread Junyang Qian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411132#comment-15411132 ] Junyang Qian commented on SPARK-16508: -- Sounds good. I'll be working on the undocume

[jira] [Assigned] (SPARK-16938) Cannot resolve column name after a join

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16938: Assignee: Apache Spark > Cannot resolve column name after a join > ---

[jira] [Assigned] (SPARK-16938) Cannot resolve column name after a join

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16938: Assignee: (was: Apache Spark) > Cannot resolve column name after a join >

[jira] [Commented] (SPARK-16938) Cannot resolve column name after a join

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1545#comment-1545 ] Apache Spark commented on SPARK-16938: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Updated] (SPARK-12920) Fix high CPU usage in spark thrift server with concurrent users

2016-08-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-12920: - Summary: Fix high CPU usage in spark thrift server with concurrent users (was: Spark thr

[jira] [Commented] (SPARK-16938) Cannot resolve column name after a join

2016-08-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411106#comment-15411106 ] Dongjoon Hyun commented on SPARK-16938: --- Hi, [~mathieude]. This bug seems to be in

[jira] [Commented] (SPARK-15899) file scheme should be used correctly

2016-08-07 Thread Bruno C Faria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411052#comment-15411052 ] Bruno C Faria commented on SPARK-15899: --- I have used System.setProperty("spark.sql.

[jira] [Resolved] (SPARK-16939) Fix build error by using `Tuple1` explicitly in StringFunctionSuite

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16939. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 1.6.3 Resolved by https://gi

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2016-08-07 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411023#comment-15411023 ] Debasish Das commented on SPARK-6932: - [~rxin] [~sowen] Do we have any other active pa

[jira] [Commented] (SPARK-16937) Confusing behaviors when View and Temp View sharing the same names

2016-08-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410991#comment-15410991 ] Xiao Li commented on SPARK-16937: - We are using different name resolution rules, should w

[jira] [Commented] (SPARK-16937) Confusing behaviors when View and Temp View sharing the same names

2016-08-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410989#comment-15410989 ] Xiao Li commented on SPARK-16937: - Currently, the existing DDL behaviors for views when u

[jira] [Assigned] (SPARK-16939) Fix build error by using `Tuple1` explicitly in StringFunctionSuite

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16939: Assignee: Apache Spark > Fix build error by using `Tuple1` explicitly in StringFunctionSui

[jira] [Commented] (SPARK-16939) Fix build error by using `Tuple1` explicitly in StringFunctionSuite

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410974#comment-15410974 ] Apache Spark commented on SPARK-16939: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-16939) Fix build error by using `Tuple1` explicitly in StringFunctionSuite

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16939: Assignee: (was: Apache Spark) > Fix build error by using `Tuple1` explicitly in String

[jira] [Created] (SPARK-16939) Fix build error by using `Tuple1` explicitly in StringFunctionSuite

2016-08-07 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-16939: - Summary: Fix build error by using `Tuple1` explicitly in StringFunctionSuite Key: SPARK-16939 URL: https://issues.apache.org/jira/browse/SPARK-16939 Project: Spark

[jira] [Commented] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

2016-08-07 Thread Hasil Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410946#comment-15410946 ] Hasil Sharma commented on SPARK-12436: -- Is this issue solved ? If not, would like to

[jira] [Created] (SPARK-16938) Cannot resolve column name after a join

2016-08-07 Thread Mathieu D (JIRA)
Mathieu D created SPARK-16938: - Summary: Cannot resolve column name after a join Key: SPARK-16938 URL: https://issues.apache.org/jira/browse/SPARK-16938 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-16324) regexp_extract should doc that it returns empty string when match fails

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410927#comment-15410927 ] Apache Spark commented on SPARK-16324: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-16324) regexp_extract should doc that it returns empty string when match fails

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16324: Assignee: (was: Apache Spark) > regexp_extract should doc that it returns empty string

[jira] [Assigned] (SPARK-16324) regexp_extract should doc that it returns empty string when match fails

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16324: Assignee: Apache Spark > regexp_extract should doc that it returns empty string when match

[jira] [Commented] (SPARK-15575) Remove breeze from dependencies?

2016-08-07 Thread xubo245 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410923#comment-15410923 ] xubo245 commented on SPARK-15575: - If remove breeze dependency,we need rewrite similar pr

[jira] [Assigned] (SPARK-16409) regexp_extract with optional groups causes NPE

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-16409: - Assignee: Sean Owen > regexp_extract with optional groups causes NPE > -

[jira] [Resolved] (SPARK-16409) regexp_extract with optional groups causes NPE

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16409. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 1.6.3 Issue

[jira] [Updated] (SPARK-16909) Streaming for postgreSQL JDBC driver

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16909: -- Assignee: prince john wesley Priority: Minor (was: Major) Issue Type: Improvement (was: Bu

[jira] [Resolved] (SPARK-16909) Streaming for postgreSQL JDBC driver

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16909. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14502 [https://github.co

[jira] [Assigned] (SPARK-16832) CrossValidator and TrainValidationSplit are not random without seed

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16832: Assignee: (was: Apache Spark) > CrossValidator and TrainValidationSplit are not random

[jira] [Commented] (SPARK-16832) CrossValidator and TrainValidationSplit are not random without seed

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410913#comment-15410913 ] Apache Spark commented on SPARK-16832: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-16832) CrossValidator and TrainValidationSplit are not random without seed

2016-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16832: Assignee: Apache Spark > CrossValidator and TrainValidationSplit are not random without se

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-08-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410870#comment-15410870 ] Steve Loughran commented on SPARK-10063: The solution for this is going to be s3g

[jira] [Resolved] (SPARK-16769) httpclient classic dependency - potentially a patch required?

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16769. --- Resolution: Not A Problem I think this doesn't end up being a vulnerability AFAICT and would partly g

[jira] [Resolved] (SPARK-16326) Evaluate sparklyr package from RStudio

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16326. --- Resolution: Not A Problem > Evaluate sparklyr package from RStudio >

[jira] [Updated] (SPARK-16911) Remove migrating to a Spark 1.x version in programming guide documentation

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16911: -- Assignee: Shivansh > Remove migrating to a Spark 1.x version in programming guide documentation > -

[jira] [Resolved] (SPARK-16911) Remove migrating to a Spark 1.x version in programming guide documentation

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16911. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Updated] (SPARK-16870) add "spark.sql.broadcastTimeout" into docs/sql-programming-guide.md to help people to how to fix this timeout error when it happenned

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16870: -- Assignee: Liang Ke > add "spark.sql.broadcastTimeout" into docs/sql-programming-guide.md to help > peo

[jira] [Resolved] (SPARK-16870) add "spark.sql.broadcastTimeout" into docs/sql-programming-guide.md to help people to how to fix this timeout error when it happenned

2016-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16870. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

  1   2   >