[jira] [Commented] (SPARK-20478) Document LinearSVC in R programming guide

2017-04-26 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986101#comment-15986101 ] Miao Wang commented on SPARK-20478: --- R programming guide and vignettes have linear svm

[jira] [Commented] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986093#comment-15986093 ] Apache Spark commented on SPARK-20476: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-20477) Document R bisecting k-means in R programming guide

2017-04-26 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986072#comment-15986072 ] Miao Wang commented on SPARK-20477: --- OK. I will add it. > Document R bisecting k-means

[jira] [Commented] (SPARK-20478) Document LinearSVC in R programming guide

2017-04-26 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986071#comment-15986071 ] Miao Wang commented on SPARK-20478: --- OK. I will add it. > Document LinearSVC in R pro

[jira] [Assigned] (SPARK-20425) Support an extended display mode to print a column data per line

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20425: --- Assignee: Takeshi Yamamuro > Support an extended display mode to print a column data per line >

[jira] [Resolved] (SPARK-20425) Support an extended display mode to print a column data per line

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20425. - Resolution: Fixed Fix Version/s: 2.3.0 > Support an extended display mode to print a column data p

[jira] [Issue Comment Deleted] (SPARK-20435) More thorough redaction of sensitive information from logs/UI, more unit tests

2017-04-26 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated SPARK-20435: Comment: was deleted (was: Thanks Marcelo! ) > More thorough redaction of sensitive information

[jira] [Closed] (SPARK-20475) Whether use "broadcast join" depends on hive configuration

2017-04-26 Thread Lijia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijia Liu closed SPARK-20475. - Resolution: Fixed Fix Version/s: 2.0.3 > Whether use "broadcast join" depends on hive configuratio

[jira] [Commented] (SPARK-20475) Whether use "broadcast join" depends on hive configuration

2017-04-26 Thread Lijia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985995#comment-15985995 ] Lijia Liu commented on SPARK-20475: --- [~ZenWzh] This issue is duplicated to https://iss

[jira] [Resolved] (SPARK-20470) Invalid json converting RDD row with Array of struct to json

2017-04-26 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20470. -- Resolution: Invalid This is because {{recursive}} should be set to {{True}} in {{asDict}}. Wit

[jira] [Comment Edited] (SPARK-20475) Whether use "broadcast join" depends on hive configuration

2017-04-26 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985838#comment-15985838 ] Zhenhua Wang edited comment on SPARK-20475 at 4/27/17 3:53 AM:

[jira] [Assigned] (SPARK-20487) `HiveTableScan` node is quite verbose in explained plan

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20487: Assignee: (was: Apache Spark) > `HiveTableScan` node is quite verbose in explained pla

[jira] [Assigned] (SPARK-20487) `HiveTableScan` node is quite verbose in explained plan

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20487: Assignee: Apache Spark > `HiveTableScan` node is quite verbose in explained plan > ---

[jira] [Commented] (SPARK-20487) `HiveTableScan` node is quite verbose in explained plan

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985907#comment-15985907 ] Apache Spark commented on SPARK-20487: -- User 'tejasapatil' has created a pull reques

[jira] [Created] (SPARK-20487) `HiveTableScan` node is quite verbose in explained plan

2017-04-26 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-20487: --- Summary: `HiveTableScan` node is quite verbose in explained plan Key: SPARK-20487 URL: https://issues.apache.org/jira/browse/SPARK-20487 Project: Spark Issue T

[jira] [Updated] (SPARK-20403) It is wrong to the instructions of some functions,such as boolean,tinyint,smallint,int,bigint,float,double,decimal,date,timestamp,binary,string

2017-04-26 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-20403: Priority: Minor (was: Trivial) > It is wrong to the instructions of some functions,such as > boolean,tin

[jira] [Assigned] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-26 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-20483: --- Assignee: Davis Shepherd > Mesos Coarse mode may starve other Mesos frameworks if max cores is not a

[jira] [Updated] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-26 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-20483: Shepherd: DB Tsai > Mesos Coarse mode may starve other Mesos frameworks if max cores is not a > multiple o

[jira] [Updated] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-26 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-20483: Affects Version/s: 2.1.1 2.0.2 > Mesos Coarse mode may starve other Mesos frameworks

[jira] [Commented] (SPARK-20468) Refactor the ALS code

2017-04-26 Thread Daniel Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985888#comment-15985888 ] Daniel Li commented on SPARK-20468: --- Thanks for the guidance, [~srowen]. I've read the

[jira] [Updated] (SPARK-20486) Encapsulate ALS in-block and out-block data structures and methods into a separate class

2017-04-26 Thread Daniel Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Li updated SPARK-20486: -- Description: The in-block and out-block data structures in the ALS code is currently calculated within

[jira] [Created] (SPARK-20486) Encapsulate ALS in-block and out-block data structures and methods into a separate class

2017-04-26 Thread Daniel Li (JIRA)
Daniel Li created SPARK-20486: - Summary: Encapsulate ALS in-block and out-block data structures and methods into a separate class Key: SPARK-20486 URL: https://issues.apache.org/jira/browse/SPARK-20486 Pr

[jira] [Created] (SPARK-20485) Split ALS.scala into multiple files

2017-04-26 Thread Daniel Li (JIRA)
Daniel Li created SPARK-20485: - Summary: Split ALS.scala into multiple files Key: SPARK-20485 URL: https://issues.apache.org/jira/browse/SPARK-20485 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-20484) Add documentation to ALS code

2017-04-26 Thread Daniel Li (JIRA)
Daniel Li created SPARK-20484: - Summary: Add documentation to ALS code Key: SPARK-20484 URL: https://issues.apache.org/jira/browse/SPARK-20484 Project: Spark Issue Type: Improvement Com

[jira] [Commented] (SPARK-20475) Whether use "broadcast join" depends on hive configuration

2017-04-26 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985838#comment-15985838 ] Zhenhua Wang commented on SPARK-20475: -- Spark also collects table size no matter "an

[jira] [Updated] (SPARK-20435) More thorough redaction of sensitive information from logs/UI, more unit tests

2017-04-26 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated SPARK-20435: Thanks Marcelo! > More thorough redaction of sensitive information from logs/UI, more unit tests >

[jira] [Updated] (SPARK-20435) More thorough redaction of sensitive information from logs/UI, more unit tests

2017-04-26 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated SPARK-20435: Thanks Marcelo! > More thorough redaction of sensitive information from logs/UI, more unit tests >

Re: [jira] [Resolved] (SPARK-20435) More thorough redaction of sensitive information from logs/UI, more unit tests

2017-04-26 Thread Mark Grover
Thanks Marcelo! On Apr 26, 2017 5:07 PM, "Marcelo Vanzin (JIRA)" wrote: > > [ https://issues.apache.org/jira/browse/SPARK-20435?page= > com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] > > Marcelo Vanzin resolved SPARK-20435. > >Res

[jira] [Resolved] (SPARK-20435) More thorough redaction of sensitive information from logs/UI, more unit tests

2017-04-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20435. Resolution: Fixed Assignee: Mark Grover Fix Version/s: 2.2.0 > More thoroug

[jira] [Commented] (SPARK-20482) Resolving Casts is too strict on having time zone set

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985720#comment-15985720 ] Apache Spark commented on SPARK-20482: -- User 'rednaxelafx' has created a pull reques

[jira] [Updated] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-26 Thread Davis Shepherd (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davis Shepherd updated SPARK-20483: --- Description: if {{spark.cores.max = 10}} for example and {{spark.executor.cores = 4}}, 2 exec

[jira] [Updated] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-26 Thread Davis Shepherd (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davis Shepherd updated SPARK-20483: --- Description: if {{spark.cores.max = 10}} for example and {{spark.executor.cores = 4}}, 2 exe

[jira] [Commented] (SPARK-20481) Wrong mapping for BooleanType in Spark SQL

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985716#comment-15985716 ] Xiao Li commented on SPARK-20481: - We are unable to make a change in this default data ty

[jira] [Commented] (SPARK-20481) Wrong mapping for BooleanType in Spark SQL

2017-04-26 Thread Talat UYARER (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985695#comment-15985695 ] Talat UYARER commented on SPARK-20481: -- I am using Redshift. > Wrong mapping for Bo

[jira] [Updated] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-26 Thread Davis Shepherd (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davis Shepherd updated SPARK-20483: --- Description: if {{spark.cores.max = 10}} for example and {{spark.executor.cores = 4}}, 2 exe

[jira] [Created] (SPARK-20483) Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores

2017-04-26 Thread Davis Shepherd (JIRA)
Davis Shepherd created SPARK-20483: -- Summary: Mesos Coarse mode may starve other Mesos frameworks if max cores is not a multiple of executor cores Key: SPARK-20483 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Commented] (SPARK-20481) Wrong mapping for BooleanType in Spark SQL

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985690#comment-15985690 ] Xiao Li commented on SPARK-20481: - Which DB are you using? > Wrong mapping for BooleanTy

[jira] [Assigned] (SPARK-20482) Resolving Casts is too strict on having time zone set

2017-04-26 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-20482: - Assignee: Kris Mok > Resolving Casts is too strict on having time zone set > ---

[jira] [Created] (SPARK-20482) Resolving Casts is too strict on having time zone set

2017-04-26 Thread Kris Mok (JIRA)
Kris Mok created SPARK-20482: Summary: Resolving Casts is too strict on having time zone set Key: SPARK-20482 URL: https://issues.apache.org/jira/browse/SPARK-20482 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-20454) Improvement of ShortestPaths in Spark GraphX

2017-04-26 Thread Ji Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ji Dai updated SPARK-20454: --- Labels: (was: patch) > Improvement of ShortestPaths in Spark GraphX > -

[jira] [Updated] (SPARK-20454) Improvement of ShortestPaths in Spark GraphX

2017-04-26 Thread Ji Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ji Dai updated SPARK-20454: --- Flags: Important (was: Patch,Important) > Improvement of ShortestPaths in Spark GraphX > ---

[jira] [Updated] (SPARK-20454) Improvement of ShortestPaths in Spark GraphX

2017-04-26 Thread Ji Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ji Dai updated SPARK-20454: --- Target Version/s: (was: 2.1.0) > Improvement of ShortestPaths in Spark GraphX > ---

[jira] [Closed] (SPARK-20480) FileFormatWriter hides FetchFailedException from scheduler

2017-04-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-20480. - Resolution: Duplicate > FileFormatWriter hides FetchFailedException from scheduler >

[jira] [Commented] (SPARK-20480) FileFormatWriter hides FetchFailedException from scheduler

2017-04-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985590#comment-15985590 ] Thomas Graves commented on SPARK-20480: --- ah it looks like it should, hadn't seen th

[jira] [Created] (SPARK-20481) Wrong mapping for BooleanType in Spark SQL

2017-04-26 Thread Talat UYARER (JIRA)
Talat UYARER created SPARK-20481: Summary: Wrong mapping for BooleanType in Spark SQL Key: SPARK-20481 URL: https://issues.apache.org/jira/browse/SPARK-20481 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20480) FileFormatWriter hides FetchFailedException from scheduler

2017-04-26 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985575#comment-15985575 ] Mridul Muralidharan commented on SPARK-20480: - Shouldn't fix for SPARK-19276

[jira] [Commented] (SPARK-20480) FileFormatWriter hides FetchFailedException from scheduler

2017-04-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985571#comment-15985571 ] Thomas Graves commented on SPARK-20480: --- Note with blacklisting on this caused the

[jira] [Commented] (SPARK-20480) FileFormatWriter hides FetchFailedException from scheduler

2017-04-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985567#comment-15985567 ] Thomas Graves commented on SPARK-20480: --- exception in task manager looks like: 17/0

[jira] [Updated] (SPARK-20480) FileFormatWriter hides FetchFailedException from scheduler

2017-04-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-20480: -- Description: I was running a large job where it was getting faiures, noticed they were listed

[jira] [Created] (SPARK-20480) FileFormatWriter hides FetchFailedException from scheduler

2017-04-26 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-20480: - Summary: FileFormatWriter hides FetchFailedException from scheduler Key: SPARK-20480 URL: https://issues.apache.org/jira/browse/SPARK-20480 Project: Spark

[jira] [Resolved] (SPARK-12868) ADD JAR via sparkSQL JDBC will fail when using a HDFS URL

2017-04-26 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12868. Resolution: Fixed Assignee: Weiqing Yang Fix Version/s: 2.2.0 > ADD JAR via

[jira] [Resolved] (SPARK-20474) OnHeapColumnVector realocation may not copy existing data

2017-04-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-20474. - Resolution: Fixed Assignee: Michal Szafranski Fix Version/s: 2.2.0 > OnHeapColumn

[jira] [Commented] (SPARK-20178) Improve Scheduler fetch failures

2017-04-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985447#comment-15985447 ] Thomas Graves commented on SPARK-20178: --- Another thing we should tie in here is han

[jira] [Updated] (SPARK-20479) Performance degradation for large number of hash-aggregated columns

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20479: Affects Version/s: (was: 2.3.0) 2.2.0 > Performance degradation for large number

[jira] [Assigned] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20476: --- Assignee: Xiao Li > Exception between "create table as" and "get_json_object" >

[jira] [Assigned] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20476: Assignee: (was: Apache Spark) > Exception between "create table as" and "get_json_obje

[jira] [Assigned] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20476: Assignee: Apache Spark > Exception between "create table as" and "get_json_object" > -

[jira] [Commented] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985399#comment-15985399 ] Apache Spark commented on SPARK-20476: -- User 'gatorsmile' has created a pull request

[jira] [Created] (SPARK-20479) Performance degradation for large number of hash-aggregated columns

2017-04-26 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-20479: Summary: Performance degradation for large number of hash-aggregated columns Key: SPARK-20479 URL: https://issues.apache.org/jira/browse/SPARK-20479 Project:

[jira] [Commented] (SPARK-20184) performance regression for complex/long sql when enable whole stage codegen

2017-04-26 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985319#comment-15985319 ] Kazuaki Ishizaki commented on SPARK-20184: -- When # of the aggregated columns get

[jira] [Assigned] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20208: Assignee: Maciej Szymkiewicz (was: Apache Spark) > Document R fpGrowth support in vignett

[jira] [Assigned] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20208: Assignee: Apache Spark (was: Maciej Szymkiewicz) > Document R fpGrowth support in vignett

[jira] [Commented] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985309#comment-15985309 ] Apache Spark commented on SPARK-20208: -- User 'zero323' has created a pull request fo

[jira] [Resolved] (SPARK-20473) ColumnVector.Array is missing accessors for some types

2017-04-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-20473. - Resolution: Fixed Assignee: Michal Szafranski Fix Version/s: 2.2.0 > ColumnVector

[jira] [Updated] (SPARK-20015) Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide, R example

2017-04-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20015: - Summary: Document R Structured Streaming (experimental) in R vignettes and R & SS programming gui

[jira] [Commented] (SPARK-20477) Document R bisecting k-means in R programming guide

2017-04-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985226#comment-15985226 ] Felix Cheung commented on SPARK-20477: -- [~wangmiao1981] Would you like to add this?

[jira] [Updated] (SPARK-20477) Document R bisecting k-means in R programming guide

2017-04-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20477: - Issue Type: Documentation (was: Bug) > Document R bisecting k-means in R programming guide > ---

[jira] [Commented] (SPARK-20478) Document LinearSVC in R programming guide

2017-04-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985227#comment-15985227 ] Felix Cheung commented on SPARK-20478: -- [~wangmiao1981] Would you like to add this?

[jira] [Reopened] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

2017-04-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reopened SPARK-20208: -- Actually, would you mind updating the R programming guide too? > Document R fpGrowth support in vi

[jira] [Created] (SPARK-20478) Document LinearSVC in R programming guide

2017-04-26 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20478: Summary: Document LinearSVC in R programming guide Key: SPARK-20478 URL: https://issues.apache.org/jira/browse/SPARK-20478 Project: Spark Issue Type: Documen

[jira] [Created] (SPARK-20477) Document R bisecting k-means in R programming guide

2017-04-26 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20477: Summary: Document R bisecting k-means in R programming guide Key: SPARK-20477 URL: https://issues.apache.org/jira/browse/SPARK-20477 Project: Spark Issue Typ

[jira] [Commented] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985175#comment-15985175 ] Xiao Li commented on SPARK-20476: - You can bypass it by {noformat} create table spark_js

[jira] [Updated] (SPARK-20470) Invalid json converting RDD row with Array of struct to json

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20470: Component/s: SQL > Invalid json converting RDD row with Array of struct to json > -

[jira] [Commented] (SPARK-20475) Whether use "broadcast join" depends on hive configuration

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985100#comment-15985100 ] Xiao Li commented on SPARK-20475: - cc [~ZenWzh] > Whether use "broadcast join" depends o

[jira] [Commented] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985096#comment-15985096 ] Xiao Li commented on SPARK-20476: - This sounds a bug to me. Let me double check it > Exc

[jira] [Commented] (SPARK-7481) Add spark-hadoop-cloud module to pull in object store support

2017-04-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985040#comment-15985040 ] Steve Loughran commented on SPARK-7481: --- (This is a fairly long comment, but it trie

[jira] [Updated] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-20476: -- Description: I encounter this problem when I want to create a table as select , get_json_object fr

[jira] [Updated] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-20476: -- Description: I encounter this problem when I want to create a table as select , get_json_object fr

[jira] [Comment Edited] (SPARK-17403) Fatal Error: Scan cached strings

2017-04-26 Thread Paul Lysak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982595#comment-15982595 ] Paul Lysak edited comment on SPARK-17403 at 4/26/17 3:23 PM: -

[jira] [Commented] (SPARK-17403) Fatal Error: Scan cached strings

2017-04-26 Thread Paul Lysak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984987#comment-15984987 ] Paul Lysak commented on SPARK-17403: Hope that helps - finally managed to reproduce i

[jira] [Updated] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-20476: -- Description: {code} create table spark_json_object as select get_json_object(deliver_geojson,'$.')

[jira] [Created] (SPARK-20476) Exception between "create table as" and "get_json_object"

2017-04-26 Thread cen yuhai (JIRA)
cen yuhai created SPARK-20476: - Summary: Exception between "create table as" and "get_json_object" Key: SPARK-20476 URL: https://issues.apache.org/jira/browse/SPARK-20476 Project: Spark Issue Typ

[jira] [Commented] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Sebastian Arzt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984975#comment-15984975 ] Sebastian Arzt commented on SPARK-18371: Screenshots: [before|https://issues.apa

[jira] [Issue Comment Deleted] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Sebastian Arzt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Arzt updated SPARK-18371: --- Comment: was deleted (was: After fix) > Spark Streaming backpressure bug - generates a batch

[jira] [Issue Comment Deleted] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Sebastian Arzt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Arzt updated SPARK-18371: --- Comment: was deleted (was: Before fix) > Spark Streaming backpressure bug - generates a batc

[jira] [Updated] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Sebastian Arzt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Arzt updated SPARK-18371: --- Attachment: 01.png Before fix > Spark Streaming backpressure bug - generates a batch with la

[jira] [Updated] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Sebastian Arzt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Arzt updated SPARK-18371: --- Attachment: 02.png After fix > Spark Streaming backpressure bug - generates a batch with lar

[jira] [Assigned] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18371: Assignee: Apache Spark > Spark Streaming backpressure bug - generates a batch with large n

[jira] [Assigned] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18371: Assignee: (was: Apache Spark) > Spark Streaming backpressure bug - generates a batch w

[jira] [Commented] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984962#comment-15984962 ] Apache Spark commented on SPARK-18371: -- User 'arzt' has created a pull request for t

[jira] [Assigned] (SPARK-20391) Properly rename the memory related fields in ExecutorSummary REST API

2017-04-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-20391: Assignee: Saisai Shao > Properly rename the memory related fields in ExecutorSummary REST

[jira] [Resolved] (SPARK-20391) Properly rename the memory related fields in ExecutorSummary REST API

2017-04-26 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-20391. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17700 [https://git

[jira] [Resolved] (SPARK-19812) YARN shuffle service fails to relocate recovery DB across NFS directories

2017-04-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-19812. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.0 > YARN shuffle service

[jira] [Comment Edited] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Sebastian Arzt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984776#comment-15984776 ] Sebastian Arzt edited comment on SPARK-18371 at 4/26/17 1:24 PM: --

[jira] [Comment Edited] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Sebastian Arzt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984776#comment-15984776 ] Sebastian Arzt edited comment on SPARK-18371 at 4/26/17 1:23 PM: --

[jira] [Commented] (SPARK-18371) Spark Streaming backpressure bug - generates a batch with large number of records

2017-04-26 Thread Sebastian Arzt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984776#comment-15984776 ] Sebastian Arzt commented on SPARK-18371: I deep dived into it and found a simple

[jira] [Commented] (SPARK-7481) Add spark-hadoop-cloud module to pull in object store support

2017-04-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984771#comment-15984771 ] Steve Loughran commented on SPARK-7481: --- I think we ended up going in circles on tha

[jira] [Assigned] (SPARK-20473) ColumnVector.Array is missing accessors for some types

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20473: Assignee: Apache Spark > ColumnVector.Array is missing accessors for some types >

[jira] [Assigned] (SPARK-20474) OnHeapColumnVector realocation may not copy existing data

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20474: Assignee: (was: Apache Spark) > OnHeapColumnVector realocation may not copy existing d

[jira] [Assigned] (SPARK-20473) ColumnVector.Array is missing accessors for some types

2017-04-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20473: Assignee: (was: Apache Spark) > ColumnVector.Array is missing accessors for some types

  1   2   >