[jira] [Resolved] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu DESPRIEE resolved SPARK-23220. -- Resolution: Resolved Fix Version/s: 2.3.0 > broadcast hint not applied in a stre

[jira] [Commented] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342351#comment-16342351 ] Mathieu DESPRIEE commented on SPARK-23220: -- I confirm this is fixed in 2.3.0 >

[jira] [Comment Edited] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342339#comment-16342339 ] Mathieu DESPRIEE edited comment on SPARK-23220 at 1/27/18 10:05 PM: ---

[jira] [Comment Edited] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342339#comment-16342339 ] Mathieu DESPRIEE edited comment on SPARK-23220 at 1/27/18 10:04 PM: ---

[jira] [Updated] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu DESPRIEE updated SPARK-23220: - Attachment: (was: Screenshot from 2018-01-27 22-32-30.png) > broadcast hint not appli

[jira] [Commented] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342339#comment-16342339 ] Mathieu DESPRIEE commented on SPARK-23220: -- Found that the problem is related to

[jira] [Updated] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu DESPRIEE updated SPARK-23220: - Attachment: Screenshot from 2018-01-27 22-32-30.png > broadcast hint not applied in a str

[jira] [Commented] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341791#comment-16341791 ] Mathieu DESPRIEE commented on SPARK-23220: -- Here is a gist https://gist.github.

[jira] [Issue Comment Deleted] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu DESPRIEE updated SPARK-23220: - Comment: was deleted (was: [~viirya] working on it. It's actually harder than I thought.

[jira] [Commented] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341142#comment-16341142 ] Mathieu DESPRIEE commented on SPARK-23220: -- [~viirya] working on it. It's actual

[jira] [Updated] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu DESPRIEE updated SPARK-23220: - Description: We have a structured streaming app doing a left anti-join between a stream,

[jira] [Updated] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu DESPRIEE updated SPARK-23220: - Description: We have a structured streaming app doing a left anti-join between a stream,

[jira] [Updated] (SPARK-23220) broadcast hint not applied in a streaming left anti join

[ https://issues.apache.org/jira/browse/SPARK-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu DESPRIEE updated SPARK-23220: - Attachment: Screenshot from 2018-01-25 17-32-45.png > broadcast hint not applied in a str

[jira] [Created] (SPARK-23220) broadcast hint not applied in a streaming left anti join

Mathieu DESPRIEE created SPARK-23220: Summary: broadcast hint not applied in a streaming left anti join Key: SPARK-23220 URL: https://issues.apache.org/jira/browse/SPARK-23220 Project: Spark

[jira] [Commented] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16336009#comment-16336009 ] Mathieu DESPRIEE commented on SPARK-20927: -- I don't master Spark Internals, pard

[jira] [Comment Edited] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334363#comment-16334363 ] Mathieu DESPRIEE edited comment on SPARK-20927 at 1/23/18 2:42 PM:

[jira] [Comment Edited] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334363#comment-16334363 ] Mathieu DESPRIEE edited comment on SPARK-20927 at 1/22/18 4:19 PM:

[jira] [Commented] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334363#comment-16334363 ] Mathieu DESPRIEE commented on SPARK-20927: -- @[~zsxwing] actually it does make se

[jira] [Comment Edited] (SPARK-20927) Add cache operator to Unsupported Operations in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334363#comment-16334363 ] Mathieu DESPRIEE edited comment on SPARK-20927 at 1/22/18 2:59 PM:

[jira] [Updated] (SPARK-21257) LDA : create an Evaluator to enable cross validation

[ https://issues.apache.org/jira/browse/SPARK-21257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu DESPRIEE updated SPARK-21257: - Issue Type: Improvement (was: New Feature) > LDA : create an Evaluator to enable cross v

[jira] [Updated] (SPARK-21257) LDA : create an Evaluator to enable cross validation

[ https://issues.apache.org/jira/browse/SPARK-21257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu DESPRIEE updated SPARK-21257: - Issue Type: New Feature (was: Improvement) > LDA : create an Evaluator to enable cross v

[jira] [Created] (SPARK-21257) LDA : create an Evaluator to enable cross validation

Mathieu DESPRIEE created SPARK-21257: Summary: LDA : create an Evaluator to enable cross validation Key: SPARK-21257 URL: https://issues.apache.org/jira/browse/SPARK-21257 Project: Spark

[jira] [Commented] (SPARK-20082) Incremental update of LDA model, by adding initialModel as start point

[ https://issues.apache.org/jira/browse/SPARK-20082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066816#comment-16066816 ] Mathieu DESPRIEE commented on SPARK-20082: -- I updated the PR. Basically, here i

[jira] [Commented] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

[ https://issues.apache.org/jira/browse/SPARK-11128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965351#comment-14965351 ] mathieu despriee commented on SPARK-11128: -- hadoop 2.4 just tested right now wi

[jira] [Created] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

mathieu despriee created SPARK-11128: Summary: strange NPE when writing in non-existing S3 bucket Key: SPARK-11128 URL: https://issues.apache.org/jira/browse/SPARK-11128 Project: Spark Is

[jira] [Commented] (SPARK-8980) Setup cluster with spark-ec2 scripts as non-root user

[ https://issues.apache.org/jira/browse/SPARK-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622527#comment-14622527 ] Mathieu DESPRIEE commented on SPARK-8980: - Well, um, i thought jira was a good pla

[jira] [Created] (SPARK-8980) Setup cluster with spark-ec2 scripts as non-root user

Mathieu DESPRIEE created SPARK-8980: --- Summary: Setup cluster with spark-ec2 scripts as non-root user Key: SPARK-8980 URL: https://issues.apache.org/jira/browse/SPARK-8980 Project: Spark Iss