[jira] [Updated] (SPARK-22202) Release tgz content differences for python and R

[ https://issues.apache.org/jira/browse/SPARK-22202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22202: - Description: As a follow up to SPARK-22167, currently we are running different profiles/steps

[jira] [Assigned] (SPARK-22206) gapply in R can't work on empty grouping columns

[ https://issues.apache.org/jira/browse/SPARK-22206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22206: Assignee: (was: Apache Spark) > gapply in R can't work on empty grouping columns >

[jira] [Assigned] (SPARK-22206) gapply in R can't work on empty grouping columns

[ https://issues.apache.org/jira/browse/SPARK-22206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22206: Assignee: Apache Spark > gapply in R can't work on empty grouping columns >

[jira] [Commented] (SPARK-22206) gapply in R can't work on empty grouping columns

[ https://issues.apache.org/jira/browse/SPARK-22206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192472#comment-16192472 ] Apache Spark commented on SPARK-22206: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-22206) gapply in R can't work on empty grouping columns

Liang-Chi Hsieh created SPARK-22206: --- Summary: gapply in R can't work on empty grouping columns Key: SPARK-22206 URL: https://issues.apache.org/jira/browse/SPARK-22206 Project: Spark Issue

[jira] [Commented] (SPARK-22204) Explain output for SQL with commands shows no optimization

[ https://issues.apache.org/jira/browse/SPARK-22204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192454#comment-16192454 ] Takeshi Yamamuro commented on SPARK-22204: -- good catch. The optimization is internally applied

[jira] [Resolved] (SPARK-22203) Add job description for file listing Spark jobs

[ https://issues.apache.org/jira/browse/SPARK-22203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22203. -- Resolution: Fixed Fix Version/s: 2.3.0 > Add job description for file listing Spark

[jira] [Commented] (SPARK-21785) Support create table from a file schema

[ https://issues.apache.org/jira/browse/SPARK-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192433#comment-16192433 ] Takeshi Yamamuro commented on SPARK-21785: -- {code} scala> sql("""CREATE TABLE customer USING

[jira] [Commented] (SPARK-21785) Support create table from a file schema

[ https://issues.apache.org/jira/browse/SPARK-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192430#comment-16192430 ] Jacky Shen commented on SPARK-21785: from my understanding, "CREATE TABLE xxx USING parquet" won't

[jira] [Commented] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192414#comment-16192414 ] Liang-Chi Hsieh commented on SPARK-22137: - Ideally I think a UDT should be able casted to/from

[jira] [Reopened] (SPARK-21783) Turn on ORC filter push-down by default

[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-21783: --- > Turn on ORC filter push-down by default > --- > >

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192407#comment-16192407 ] Vadim Semenov commented on SPARK-21999: --- Could you somehow reproduce the issue? If it's related to

[jira] [Commented] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192406#comment-16192406 ] Sean Owen commented on SPARK-22187: --- [~tdas] fixed for 2.3.0 right, if it's in master? > Update

[jira] [Commented] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192395#comment-16192395 ] Michael N commented on SPARK-22163: --- Committers: The actual issues are with Seam Owen himself where 1.

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192394#comment-16192394 ] Michael N edited comment on SPARK-21999 at 10/5/17 2:38 AM: Committers: The

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192394#comment-16192394 ] Michael N commented on SPARK-21999: --- The actual issues are with Seam Owen himself where 1. Sean Owen

[jira] [Resolved] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-22187. --- Resolution: Fixed Fix Version/s: (was: 2.2.0) 3.0.0 Issue

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192352#comment-16192352 ] Michael N edited comment on SPARK-22163 at 10/5/17 2:11 AM: It is obvious

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192374#comment-16192374 ] Sean Owen commented on SPARK-21999: --- Committers: rather than continue the close battle with this

[jira] [Commented] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192373#comment-16192373 ] Sean Owen commented on SPARK-22163: --- Committers: rather than continue the close battle with this

[jira] [Reopened] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-21999: --- Sean, this issue occurs in both the slave nodes and the driver. No, my app is not modifying a

[jira] [Closed] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-21999. - Resolution: Invalid Discussion may continue here but should not be reopened except by committers, when

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192364#comment-16192364 ] Sean Owen commented on SPARK-21999: --- [~michaeln_apache] I'll have to see if we can block you from

[jira] [Commented] (SPARK-21785) Support create table from a file schema

[ https://issues.apache.org/jira/browse/SPARK-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192362#comment-16192362 ] Takeshi Yamamuro commented on SPARK-21785: -- `CREATE TABLE xxx USING parquet OPTIONS (path

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192348#comment-16192348 ] Michael N edited comment on SPARK-21999 at 10/5/17 1:46 AM: No, my app is

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192348#comment-16192348 ] Michael N edited comment on SPARK-21999 at 10/5/17 1:43 AM: No, my app is

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192352#comment-16192352 ] Michael N edited comment on SPARK-22163 at 10/5/17 1:42 AM: It is obvious

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192348#comment-16192348 ] Michael N edited comment on SPARK-21999 at 10/5/17 1:39 AM: No, my app is

[jira] [Created] (SPARK-22205) Incorrect result with user defined agg function followed by a non deterministic function

kanika dhuria created SPARK-22205: - Summary: Incorrect result with user defined agg function followed by a non deterministic function Key: SPARK-22205 URL: https://issues.apache.org/jira/browse/SPARK-22205

[jira] [Reopened] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-22163: --- It is obvious that you don't understand the differences between design flaws vs coding bugs,

[jira] [Reopened] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-21999: --- No, my app is *not* modifying a collection asynchronously w.r.t. Spark. You misunderstood the issue

[jira] [Created] (SPARK-22204) Explain output for SQL with commands shows no optimization

Andrew Ash created SPARK-22204: -- Summary: Explain output for SQL with commands shows no optimization Key: SPARK-22204 URL: https://issues.apache.org/jira/browse/SPARK-22204 Project: Spark Issue

[jira] [Assigned] (SPARK-21785) Support create table from a file schema

[ https://issues.apache.org/jira/browse/SPARK-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21785: Assignee: (was: Apache Spark) > Support create table from a file schema >

[jira] [Commented] (SPARK-21785) Support create table from a file schema

[ https://issues.apache.org/jira/browse/SPARK-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192244#comment-16192244 ] Apache Spark commented on SPARK-21785: -- User 'CrazyJacky' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21785) Support create table from a file schema

[ https://issues.apache.org/jira/browse/SPARK-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21785: Assignee: Apache Spark > Support create table from a file schema >

[jira] [Resolved] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21999. --- Resolution: Not A Problem I am not sure what you mean by bold-faced asynchronously. Your app is

[jira] [Closed] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-21999. - > ConcurrentModificationException - Spark Streaming > - > >

[jira] [Closed] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-22163. - > Design Issue of Spark Streaming that Causes Random Run-time Exception >

[jira] [Resolved] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22163. --- Resolution: Duplicate If one accepts your premise, then the bug is simply a manifestation of the

[jira] [Commented] (SPARK-22201) Dataframe describe includes string columns

[ https://issues.apache.org/jira/browse/SPARK-22201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192231#comment-16192231 ] Sean Owen commented on SPARK-22201: --- If you're saying that string-valued columns should never appear in

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192217#comment-16192217 ] yuhao yang commented on SPARK-3181: --- Regarding to whether to separate Huber loss an an independent

[jira] [Comment Edited] (SPARK-3162) Train DecisionTree locally when possible

[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192201#comment-16192201 ] Siddharth Murching edited comment on SPARK-3162 at 10/4/17 11:35 PM: -

[jira] [Commented] (SPARK-3162) Train DecisionTree locally when possible

[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192201#comment-16192201 ] Siddharth Murching commented on SPARK-3162: --- Commenting here to note that I'm resuming work on

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192110#comment-16192110 ] Michael N edited comment on SPARK-22163 at 10/4/17 10:33 PM: - Please

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192135#comment-16192135 ] Michael N edited comment on SPARK-21999 at 10/4/17 10:32 PM: - The posted

[jira] [Commented] (SPARK-3162) Train DecisionTree locally when possible

[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192166#comment-16192166 ] Apache Spark commented on SPARK-3162: - User 'smurching' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192135#comment-16192135 ] Michael N edited comment on SPARK-21999 at 10/4/17 10:31 PM: - The posted

[jira] [Assigned] (SPARK-22203) Add job description for file listing Spark jobs

[ https://issues.apache.org/jira/browse/SPARK-22203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22203: Assignee: Apache Spark (was: Shixiong Zhu) > Add job description for file listing Spark

[jira] [Assigned] (SPARK-22203) Add job description for file listing Spark jobs

[ https://issues.apache.org/jira/browse/SPARK-22203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22203: Assignee: Shixiong Zhu (was: Apache Spark) > Add job description for file listing Spark

[jira] [Commented] (SPARK-22203) Add job description for file listing Spark jobs

[ https://issues.apache.org/jira/browse/SPARK-22203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192162#comment-16192162 ] Apache Spark commented on SPARK-22203: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192110#comment-16192110 ] Michael N edited comment on SPARK-22163 at 10/4/17 10:12 PM: - Please

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192135#comment-16192135 ] Michael N edited comment on SPARK-21999 at 10/4/17 10:13 PM: - The posted

[jira] [Issue Comment Deleted] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Comment: was deleted (was: The posted questions were intended to show why this is a design issue. You

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192131#comment-16192131 ] Michael N commented on SPARK-21999: --- The posted questions were intended to show why this is a design

[jira] [Reopened] (SPARK-21999) ConcurrentModificationException - Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-21999: --- The posted questions were intended to show why this is a design issue. You have not been able to

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192110#comment-16192110 ] Michael N edited comment on SPARK-22163 at 10/4/17 10:02 PM: - Please

[jira] [Reopened] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-22163: --- Please distinguish between code bug vs design flaws. That is why this ticket is separate from the

[jira] [Created] (SPARK-22203) Add job description for file listing Spark jobs

Shixiong Zhu created SPARK-22203: Summary: Add job description for file listing Spark jobs Key: SPARK-22203 URL: https://issues.apache.org/jira/browse/SPARK-22203 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22201) Dataframe describe includes string columns

[ https://issues.apache.org/jira/browse/SPARK-22201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191973#comment-16191973 ] cold gin commented on SPARK-22201: -- Ok I see what you mean - it is Dataset, not Dataframe.. Thank you

[jira] [Assigned] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-15689: --- Assignee: Wenchen Fan > Data source API v2 > -- > > Key:

[jira] [Commented] (SPARK-18580) Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream

[ https://issues.apache.org/jira/browse/SPARK-18580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191776#comment-16191776 ] Oleksandr Konopko commented on SPARK-18580: --- https://github.com/apache/spark/pull/19431 This

[jira] [Commented] (SPARK-18580) Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream

[ https://issues.apache.org/jira/browse/SPARK-18580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191767#comment-16191767 ] Apache Spark commented on SPARK-18580: -- User 'akonopko' has created a pull request for this issue:

[jira] [Updated] (SPARK-22202) Release tgz content differences for python and R

[ https://issues.apache.org/jira/browse/SPARK-22202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22202: - Description: As a follow up to SPARK-22167, currently we are running different profiles/steps

[jira] [Created] (SPARK-22202) Release tgz content differences for python and R

Felix Cheung created SPARK-22202: Summary: Release tgz content differences for python and R Key: SPARK-22202 URL: https://issues.apache.org/jira/browse/SPARK-22202 Project: Spark Issue Type:

[jira] [Updated] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-22187: - Labels: release-notes releasenotes (was: release-notes) > Update unsaferow format for saved

[jira] [Updated] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-22187: - Labels: release-notes (was: ) > Update unsaferow format for saved state such that we can set

[jira] [Updated] (SPARK-21871) Check actual bytecode size when compiling generated code

[ https://issues.apache.org/jira/browse/SPARK-21871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21871: Priority: Critical (was: Minor) > Check actual bytecode size when compiling generated code >

[jira] [Resolved] (SPARK-21871) Check actual bytecode size when compiling generated code

[ https://issues.apache.org/jira/browse/SPARK-21871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21871. - Resolution: Fixed Fix Version/s: 2.3.0 > Check actual bytecode size when compiling generated code

[jira] [Assigned] (SPARK-21871) Check actual bytecode size when compiling generated code

[ https://issues.apache.org/jira/browse/SPARK-21871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21871: --- Assignee: Takeshi Yamamuro > Check actual bytecode size when compiling generated code >

[jira] [Commented] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API

[ https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191526#comment-16191526 ] Asif Hussain Shahid commented on SPARK-22192: - The PR opened for this bug is

[jira] [Updated] (SPARK-22169) support byte length literal as identifier

[ https://issues.apache.org/jira/browse/SPARK-22169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22169: Summary: support byte length literal as identifier (was: table name with numbers and characters

[jira] [Updated] (SPARK-22201) Dataframe describe includes string columns

[ https://issues.apache.org/jira/browse/SPARK-22201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cold gin updated SPARK-22201: - Description: As per the api documentation, the default no-arg Dataframe describe() function should only

[jira] [Commented] (SPARK-22201) Dataframe describe includes string columns

[ https://issues.apache.org/jira/browse/SPARK-22201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191461#comment-16191461 ] Sean Owen commented on SPARK-22201: --- This is just a duplicate of SPARK-16468 What API are you referring

[jira] [Created] (SPARK-22201) Dataframe describe includes string columns

cold gin created SPARK-22201: Summary: Dataframe describe includes string columns Key: SPARK-22201 URL: https://issues.apache.org/jira/browse/SPARK-22201 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10884) Support prediction on single instance for regression and classification related models

[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191424#comment-16191424 ] Derek Kaknes commented on SPARK-10884: -- [~WeichenXu123] Thanks for picking this up, my team is very

[jira] [Created] (SPARK-22200) Kinesis Receivers stops if Kinesis stream was re-sharded

Alex Mikhailau created SPARK-22200: -- Summary: Kinesis Receivers stops if Kinesis stream was re-sharded Key: SPARK-22200 URL: https://issues.apache.org/jira/browse/SPARK-22200 Project: Spark

[jira] [Commented] (SPARK-20557) JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE

[ https://issues.apache.org/jira/browse/SPARK-20557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191255#comment-16191255 ] Dan Stine commented on SPARK-20557: --- Got it. Thank you, Sean. > JdbcUtils doesn't support

[jira] [Commented] (SPARK-20055) Documentation for CSV datasets in SQL programming guide

[ https://issues.apache.org/jira/browse/SPARK-20055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191232#comment-16191232 ] Jorge Machado commented on SPARK-20055: --- [~hyukjin.kwon] just added some docs. > Documentation

[jira] [Commented] (SPARK-20055) Documentation for CSV datasets in SQL programming guide

[ https://issues.apache.org/jira/browse/SPARK-20055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191230#comment-16191230 ] Apache Spark commented on SPARK-20055: -- User 'jomach' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20055) Documentation for CSV datasets in SQL programming guide

[ https://issues.apache.org/jira/browse/SPARK-20055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20055: Assignee: (was: Apache Spark) > Documentation for CSV datasets in SQL programming

[jira] [Assigned] (SPARK-20055) Documentation for CSV datasets in SQL programming guide

[ https://issues.apache.org/jira/browse/SPARK-20055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20055: Assignee: Apache Spark > Documentation for CSV datasets in SQL programming guide >

[jira] [Updated] (SPARK-22199) Spark Job on YARN fails with executors "Slave registration failed"

[ https://issues.apache.org/jira/browse/SPARK-22199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22199: -- Priority: Minor (was: Major) > Spark Job on YARN fails with executors "Slave registration failed" >

[jira] [Created] (SPARK-22199) Spark Job on YARN fails with executors "Slave registration failed"

Prabhu Joseph created SPARK-22199: - Summary: Spark Job on YARN fails with executors "Slave registration failed" Key: SPARK-22199 URL: https://issues.apache.org/jira/browse/SPARK-22199 Project: Spark

[jira] [Assigned] (SPARK-22131) Add Mesos Secrets Support to the Mesos Driver

[ https://issues.apache.org/jira/browse/SPARK-22131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22131: Assignee: (was: Apache Spark) > Add Mesos Secrets Support to the Mesos Driver >

[jira] [Assigned] (SPARK-22131) Add Mesos Secrets Support to the Mesos Driver

[ https://issues.apache.org/jira/browse/SPARK-22131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22131: Assignee: Apache Spark > Add Mesos Secrets Support to the Mesos Driver >

[jira] [Commented] (SPARK-22131) Add Mesos Secrets Support to the Mesos Driver

[ https://issues.apache.org/jira/browse/SPARK-22131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191155#comment-16191155 ] Apache Spark commented on SPARK-22131: -- User 'susanxhuynh' has created a pull request for this

[jira] [Commented] (SPARK-22195) Add cosine similarity to org.apache.spark.ml.linalg.Vectors

[ https://issues.apache.org/jira/browse/SPARK-22195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191037#comment-16191037 ] Sean Owen commented on SPARK-22195: --- When I've heard this, it's been in the context of supporting this

[jira] [Comment Edited] (SPARK-14172) Hive table partition predicate not passed down correctly

[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189481#comment-16189481 ] Saktheesh Balaraj edited comment on SPARK-14172 at 10/4/17 9:21 AM:

[jira] [Comment Edited] (SPARK-12606) Scala/Java compatibility issue Re: how to extend java transformer from Scala UnaryTransformer ?

[ https://issues.apache.org/jira/browse/SPARK-12606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190904#comment-16190904 ] Akos Tomasits edited comment on SPARK-12606 at 10/4/17 9:02 AM: We have

[jira] [Updated] (SPARK-22198) Java incompatibility when extending UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akos Tomasits updated SPARK-22198: -- Description: It is not possible to create proper Java custom Transformer by extending

[jira] [Updated] (SPARK-22198) Java incompatibility when extending UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akos Tomasits updated SPARK-22198: -- Description: It is not possible to create proper Java custom Transformer by extending

[jira] [Updated] (SPARK-22198) Java incompatibility when extending UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akos Tomasits updated SPARK-22198: -- Component/s: Java API > Java incompatibility when extending UnaryTransformer >

[jira] [Updated] (SPARK-22198) Java incompatibility when extending UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akos Tomasits updated SPARK-22198: -- Description: It is not possible to create proper Java custom Transformer by extending

[jira] [Updated] (SPARK-22198) Java incompatibility when extending UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akos Tomasits updated SPARK-22198: -- Description: It is not possible to create proper Java custom Transformer by extending

[jira] [Updated] (SPARK-22198) Java incompatibility when extending UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akos Tomasits updated SPARK-22198: -- Description: It is not possible to create proper Java custom Transformer by extending

[jira] [Created] (SPARK-22198) Java incompatibility when extending UnaryTransformer

Akos Tomasits created SPARK-22198: - Summary: Java incompatibility when extending UnaryTransformer Key: SPARK-22198 URL: https://issues.apache.org/jira/browse/SPARK-22198 Project: Spark Issue

[jira] [Commented] (SPARK-22190) Add Spark executor task metrics to Dropwizard metrics

[ https://issues.apache.org/jira/browse/SPARK-22190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190920#comment-16190920 ] Apache Spark commented on SPARK-22190: -- User 'LucaCanali' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22190) Add Spark executor task metrics to Dropwizard metrics

[ https://issues.apache.org/jira/browse/SPARK-22190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22190: Assignee: (was: Apache Spark) > Add Spark executor task metrics to Dropwizard metrics

[jira] [Assigned] (SPARK-22190) Add Spark executor task metrics to Dropwizard metrics

[ https://issues.apache.org/jira/browse/SPARK-22190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22190: Assignee: Apache Spark > Add Spark executor task metrics to Dropwizard metrics >

[jira] [Commented] (SPARK-12606) Scala/Java compatibility issue Re: how to extend java transformer from Scala UnaryTransformer ?

[ https://issues.apache.org/jira/browse/SPARK-12606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190904#comment-16190904 ] Akos Tomasits commented on SPARK-12606: --- We have run into the same issue. We cannot create proper

  1   2   >