[jira] [Commented] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960300#comment-15960300 ] Liang-Chi Hsieh commented on SPARK-20246: - We should also check determinism of the [replaced

[jira] [Commented] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribut

[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960291#comment-15960291 ] 翟玉勇 commented on SPARK-20241: - i am sorry， it is my code added in spark cause this WARN，i change thread

[jira] [Closed] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribute

[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 翟玉勇 closed SPARK-20241. --- Resolution: Not A Bug > java.lang.IllegalArgumentException: Can not set final [B field >

[jira] [Commented] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960287#comment-15960287 ] Liang-Chi Hsieh commented on SPARK-20246: - Seems we have checked determinism in

[jira] [Comment Edited] (SPARK-20226) Call to sqlContext.cacheTable takes an incredibly long time in some cases

[ https://issues.apache.org/jira/browse/SPARK-20226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960001#comment-15960001 ] Liang-Chi Hsieh edited comment on SPARK-20226 at 4/7/17 5:19 AM: -

[jira] [Comment Edited] (SPARK-20226) Call to sqlContext.cacheTable takes an incredibly long time in some cases

[ https://issues.apache.org/jira/browse/SPARK-20226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960001#comment-15960001 ] Liang-Chi Hsieh edited comment on SPARK-20226 at 4/7/17 5:19 AM: -

[jira] [Issue Comment Deleted] (SPARK-20247) Add jar but this jar is missing later shouldn't affect jobs that doesn't use this jar

[ https://issues.apache.org/jira/browse/SPARK-20247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-20247: Comment: was deleted (was: I will create a PR later.) > Add jar but this jar is missing later

[jira] [Assigned] (SPARK-20247) Add jar but this jar is missing later shouldn't affect jobs that doesn't use this jar

[ https://issues.apache.org/jira/browse/SPARK-20247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20247: Assignee: Apache Spark > Add jar but this jar is missing later shouldn't affect jobs that

[jira] [Commented] (SPARK-20247) Add jar but this jar is missing later shouldn't affect jobs that doesn't use this jar

[ https://issues.apache.org/jira/browse/SPARK-20247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960279#comment-15960279 ] Apache Spark commented on SPARK-20247: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20247) Add jar but this jar is missing later shouldn't affect jobs that doesn't use this jar

[ https://issues.apache.org/jira/browse/SPARK-20247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20247: Assignee: (was: Apache Spark) > Add jar but this jar is missing later shouldn't

[jira] [Assigned] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20208: Assignee: (was: Apache Spark) > Document R fpGrowth support in vignettes, programming

[jira] [Commented] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960278#comment-15960278 ] Apache Spark commented on SPARK-20208: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20208: Assignee: Apache Spark > Document R fpGrowth support in vignettes, programming guide and

[jira] [Commented] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960277#comment-15960277 ] Maciej Szymkiewicz commented on SPARK-20208: [~felixcheung] I am working on this but it is

[jira] [Comment Edited] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960277#comment-15960277 ] Maciej Szymkiewicz edited comment on SPARK-20208 at 4/7/17 4:52 AM:

[jira] [Commented] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribut

[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960275#comment-15960275 ] Kazuaki Ishizaki commented on SPARK-20241: -- I realized that it is not easy to reproduce this

[jira] [Commented] (SPARK-20208) Document R fpGrowth support in vignettes, programming guide and code example

[ https://issues.apache.org/jira/browse/SPARK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960267#comment-15960267 ] Felix Cheung commented on SPARK-20208: -- ping [~zero323] > Document R fpGrowth support in vignettes,

[jira] [Updated] (SPARK-19825) spark.ml R API for FPGrowth

[ https://issues.apache.org/jira/browse/SPARK-19825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19825: - Target Version/s: 2.2.0 > spark.ml R API for FPGrowth > --- > >

[jira] [Resolved] (SPARK-19825) spark.ml R API for FPGrowth

[ https://issues.apache.org/jira/browse/SPARK-19825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19825. -- Resolution: Fixed Assignee: Maciej Szymkiewicz > spark.ml R API for FPGrowth >

[jira] [Updated] (SPARK-19825) spark.ml R API for FPGrowth

[ https://issues.apache.org/jira/browse/SPARK-19825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19825: - Fix Version/s: 2.2.0 > spark.ml R API for FPGrowth > --- > >

[jira] [Commented] (SPARK-19827) spark.ml R API for PIC

[ https://issues.apache.org/jira/browse/SPARK-19827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960266#comment-15960266 ] Felix Cheung commented on SPARK-19827: -- yes > spark.ml R API for PIC > -- > >

[jira] [Commented] (SPARK-20247) Add jar but this jar is missing later shouldn't affect jobs that doesn't use this jar

[ https://issues.apache.org/jira/browse/SPARK-20247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960265#comment-15960265 ] Yuming Wang commented on SPARK-20247: - I will create a PR later. > Add jar but this jar is missing

[jira] [Created] (SPARK-20247) Add jar but this jar is missing later shouldn't affect jobs that doesn't use this jar

Yuming Wang created SPARK-20247: --- Summary: Add jar but this jar is missing later shouldn't affect jobs that doesn't use this jar Key: SPARK-20247 URL: https://issues.apache.org/jira/browse/SPARK-20247

[jira] [Assigned] (SPARK-16957) Use weighted midpoints for split values.

[ https://issues.apache.org/jira/browse/SPARK-16957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16957: Assignee: Apache Spark > Use weighted midpoints for split values. >

[jira] [Commented] (SPARK-16957) Use weighted midpoints for split values.

[ https://issues.apache.org/jira/browse/SPARK-16957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960260#comment-15960260 ] Apache Spark commented on SPARK-16957: -- User 'facaiy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16957) Use weighted midpoints for split values.

[ https://issues.apache.org/jira/browse/SPARK-16957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16957: Assignee: (was: Apache Spark) > Use weighted midpoints for split values. >

[jira] [Commented] (SPARK-16957) Use weighted midpoints for split values.

[ https://issues.apache.org/jira/browse/SPARK-16957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960177#comment-15960177 ] Yan Facai (颜发才) commented on SPARK-16957: - I think that it is helpful for small dataset, while

[jira] [Updated] (SPARK-20240) SparkSQL support limitations of max dynamic partitions when inserting hive table

[ https://issues.apache.org/jira/browse/SPARK-20240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zenglinxi updated SPARK-20240: -- Affects Version/s: (was: 2.1.0) > SparkSQL support limitations of max dynamic partitions when

[jira] [Commented] (SPARK-13210) NPE in Sort

[ https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960147#comment-15960147 ] Gowtham commented on SPARK-13210: - we are facing same exception in spark 2.1.0

[jira] [Commented] (SPARK-19495) Make SQLConf slightly more extensible

[ https://issues.apache.org/jira/browse/SPARK-19495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960004#comment-15960004 ] Apache Spark commented on SPARK-19495: -- User 'rxin' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-20226) Call to sqlContext.cacheTable takes an incredibly long time in some cases

[ https://issues.apache.org/jira/browse/SPARK-20226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960001#comment-15960001 ] Liang-Chi Hsieh edited comment on SPARK-20226 at 4/6/17 11:59 PM: --

[jira] [Commented] (SPARK-20226) Call to sqlContext.cacheTable takes an incredibly long time in some cases

[ https://issues.apache.org/jira/browse/SPARK-20226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960001#comment-15960001 ] Liang-Chi Hsieh commented on SPARK-20226: - {{spark.sql.constraintPropagation.enabled}} is a SQL

[jira] [Updated] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-20246: --- Labels: correctness (was: ) > Should check determinism when pushing predicates down through

[jira] [Commented] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959946#comment-15959946 ] Cheng Lian commented on SPARK-20246: [This

[jira] [Updated] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiluo Ren updated SPARK-20246: --- Description: `import org.apache.spark.sql.functions._

[jira] [Updated] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiluo Ren updated SPARK-20246: --- Description: {code}import org.apache.spark.sql.functions._

[jira] [Updated] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

[ https://issues.apache.org/jira/browse/SPARK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiluo Ren updated SPARK-20246: --- Description: `import org.apache.spark.sql.functions._`

[jira] [Created] (SPARK-20246) Should check determinism when pushing predicates down through aggregation

Weiluo Ren created SPARK-20246: -- Summary: Should check determinism when pushing predicates down through aggregation Key: SPARK-20246 URL: https://issues.apache.org/jira/browse/SPARK-20246 Project: Spark

[jira] [Updated] (SPARK-20243) DebugFilesystem.assertNoOpenStreams thread race

[ https://issues.apache.org/jira/browse/SPARK-20243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Raducanu updated SPARK-20243: Description: Introduced by SPARK-19946. DebugFilesystem.assertNoOpenStreams gets the size

[jira] [Assigned] (SPARK-20026) Document R GLM Tweedie family support in programming guide and code example

[ https://issues.apache.org/jira/browse/SPARK-20026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20026: Assignee: (was: Apache Spark) > Document R GLM Tweedie family support in programming

[jira] [Assigned] (SPARK-20026) Document R GLM Tweedie family support in programming guide and code example

[ https://issues.apache.org/jira/browse/SPARK-20026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20026: Assignee: Apache Spark > Document R GLM Tweedie family support in programming guide and

[jira] [Commented] (SPARK-20026) Document R GLM Tweedie family support in programming guide and code example

[ https://issues.apache.org/jira/browse/SPARK-20026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959527#comment-15959527 ] Apache Spark commented on SPARK-20026: -- User 'actuaryzhang' has created a pull request for this

[jira] [Commented] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribut

[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959495#comment-15959495 ] Kazuaki Ishizaki commented on SPARK-20241: -- I think that this problem is caused by using the

[jira] [Assigned] (SPARK-17019) Expose off-heap memory usage in various places

[ https://issues.apache.org/jira/browse/SPARK-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-17019: Assignee: Saisai Shao > Expose off-heap memory usage in various places >

[jira] [Resolved] (SPARK-17019) Expose off-heap memory usage in various places

[ https://issues.apache.org/jira/browse/SPARK-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-17019. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 14617

[jira] [Commented] (SPARK-20082) Incremental update of LDA model, by adding initialModel as start point

[ https://issues.apache.org/jira/browse/SPARK-20082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959368#comment-15959368 ] yuhao yang commented on SPARK-20082: Sorry I'm occupied by some internal project this week. I'll find

[jira] [Commented] (SPARK-20060) Support Standalone visiting secured HDFS

[ https://issues.apache.org/jira/browse/SPARK-20060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959349#comment-15959349 ] Marcelo Vanzin commented on SPARK-20060: Adding a link to SPARK-5158; they're not exactly

[jira] [Assigned] (SPARK-20245) pass output to LogicalRelation directly

[ https://issues.apache.org/jira/browse/SPARK-20245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20245: Assignee: Apache Spark (was: Wenchen Fan) > pass output to LogicalRelation directly >

[jira] [Assigned] (SPARK-20245) pass output to LogicalRelation directly

[ https://issues.apache.org/jira/browse/SPARK-20245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20245: Assignee: Wenchen Fan (was: Apache Spark) > pass output to LogicalRelation directly >

[jira] [Commented] (SPARK-20245) pass output to LogicalRelation directly

[ https://issues.apache.org/jira/browse/SPARK-20245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959333#comment-15959333 ] Apache Spark commented on SPARK-20245: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-20245) pass output to LogicalRelation directly

Wenchen Fan created SPARK-20245: --- Summary: pass output to LogicalRelation directly Key: SPARK-20245 URL: https://issues.apache.org/jira/browse/SPARK-20245 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-20195) SparkR to add createTable catalog API and deprecate createExternalTable

[ https://issues.apache.org/jira/browse/SPARK-20195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20195. -- Resolution: Fixed Fix Version/s: 2.2.0 Target Version/s: 2.2.0 > SparkR to

[jira] [Resolved] (SPARK-20196) Python to add catalog API for refreshByPath

[ https://issues.apache.org/jira/browse/SPARK-20196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20196. -- Resolution: Fixed Fix Version/s: 2.2.0 Target Version/s: 2.2.0 > Python to

[jira] [Commented] (SPARK-19870) Repeatable deadlock on BlockInfoManager and TorrentBroadcast

[ https://issues.apache.org/jira/browse/SPARK-19870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959185#comment-15959185 ] Steven Ruppert commented on SPARK-19870: ok, I can get that. trace logging as in slf4j TRACE

[jira] [Commented] (SPARK-20228) Random Forest instable results depending on spark.executor.memory

[ https://issues.apache.org/jira/browse/SPARK-20228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959168#comment-15959168 ] Ansgar Schulze commented on SPARK-20228: I just varied spark.executor.memory, everything else is

[jira] [Commented] (SPARK-19870) Repeatable deadlock on BlockInfoManager and TorrentBroadcast

[ https://issues.apache.org/jira/browse/SPARK-19870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959169#comment-15959169 ] Eyal Farago commented on SPARK-19870: - Steven, I meant traces produced by logging. Sean, this looks

[jira] [Commented] (SPARK-19870) Repeatable deadlock on BlockInfoManager and TorrentBroadcast

[ https://issues.apache.org/jira/browse/SPARK-19870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959167#comment-15959167 ] Steven Ruppert commented on SPARK-19870: It didn't seem to be a jvm-level deadlock, just that the

[jira] [Commented] (SPARK-20243) DebugFilesystem.assertNoOpenStreams thread race

[ https://issues.apache.org/jira/browse/SPARK-20243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959138#comment-15959138 ] Sean Owen commented on SPARK-20243: --- This needs detail to be a JIRA. >

[jira] [Commented] (SPARK-20226) Call to sqlContext.cacheTable takes an incredibly long time in some cases

[ https://issues.apache.org/jira/browse/SPARK-20226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959134#comment-15959134 ] Barry Becker commented on SPARK-20226: -- Yes. We are running through spark job-server, and local.conf

[jira] [Commented] (SPARK-19870) Repeatable deadlock on BlockInfoManager and TorrentBroadcast

[ https://issues.apache.org/jira/browse/SPARK-19870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959131#comment-15959131 ] Sean Owen commented on SPARK-19870: --- That isn't a deadlock, in that only one thread is waiting on a

[jira] [Commented] (SPARK-8696) Streaming API for Online LDA

[ https://issues.apache.org/jira/browse/SPARK-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959088#comment-15959088 ] Rene Richard commented on SPARK-8696: - Hello, We'd like to use Online LDA to do something like

[jira] [Commented] (SPARK-20226) Call to sqlContext.cacheTable takes an incredibly long time in some cases

[ https://issues.apache.org/jira/browse/SPARK-20226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959072#comment-15959072 ] Liang-Chi Hsieh commented on SPARK-20226: - I am not sure what the job-server local.conf is. Does

[jira] [Updated] (SPARK-20244) Incorrect input size in UI with pyspark

[ https://issues.apache.org/jira/browse/SPARK-20244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artur Sukhenko updated SPARK-20244: --- Attachment: pyspark_incorrect_inputsize.png sparkshell_correct_inputsize.png

[jira] [Created] (SPARK-20244) Incorrect input size in UI with pyspark

Artur Sukhenko created SPARK-20244: -- Summary: Incorrect input size in UI with pyspark Key: SPARK-20244 URL: https://issues.apache.org/jira/browse/SPARK-20244 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19870) Repeatable deadlock on BlockInfoManager and TorrentBroadcast

[ https://issues.apache.org/jira/browse/SPARK-19870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959053#comment-15959053 ] Steven Ruppert commented on SPARK-19870: Should be attached as

[jira] [Commented] (SPARK-19900) [Standalone] Master registers application again when driver relaunched

[ https://issues.apache.org/jira/browse/SPARK-19900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959052#comment-15959052 ] Sergey commented on SPARK-19900: This issue does not reproduced in spark 2.1.0 version. > [Standalone]

[jira] [Created] (SPARK-20243) DebugFilesystem.assertNoOpenStreams thread race

Bogdan Raducanu created SPARK-20243: --- Summary: DebugFilesystem.assertNoOpenStreams thread race Key: SPARK-20243 URL: https://issues.apache.org/jira/browse/SPARK-20243 Project: Spark Issue

[jira] [Comment Edited] (SPARK-20226) Call to sqlContext.cacheTable takes an incredibly long time in some cases

[ https://issues.apache.org/jira/browse/SPARK-20226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959024#comment-15959024 ] Barry Becker edited comment on SPARK-20226 at 4/6/17 2:45 PM: -- I set

[jira] [Commented] (SPARK-20226) Call to sqlContext.cacheTable takes an incredibly long time in some cases

[ https://issues.apache.org/jira/browse/SPARK-20226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959024#comment-15959024 ] Barry Becker commented on SPARK-20226: -- I set spark.sql.constraintPropagation.enabled to false in

[jira] [Resolved] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(41,W

[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artur Sukhenko resolved SPARK-19068. Resolution: Duplicate Fix Version/s: 2.2.0 Closing as duplicate of SPARK-19146.

[jira] [Issue Comment Deleted] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetri

[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rostyslav Sotnychenko updated SPARK-19068: -- Comment: was deleted (was:

[jira] [Commented] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(41,

[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958956#comment-15958956 ] Rostyslav Sotnychenko commented on SPARK-19068: --- Actually, maybe we should close this one

[jira] [Updated] (SPARK-20227) Job hangs when joining a lot of aggregated columns

[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quentin Auge updated SPARK-20227: - Environment: AWS emr-5.4.0, master: m4.xlarge, core: 4 m4.xlarge (was: AWS emr-5.4.0 m4.xlarge)

[jira] [Comment Edited] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdat

[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958880#comment-15958880 ] Rostyslav Sotnychenko edited comment on SPARK-19068 at 4/6/17 1:14 PM:

[jira] [Commented] (SPARK-19802) Remote History Server

[ https://issues.apache.org/jira/browse/SPARK-19802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958896#comment-15958896 ] Ben Barnard commented on SPARK-19802: - The scenario we're trying to support is running Spark

[jira] [Commented] (SPARK-19870) Repeatable deadlock on BlockInfoManager and TorrentBroadcast

[ https://issues.apache.org/jira/browse/SPARK-19870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958894#comment-15958894 ] Eyal Farago commented on SPARK-19870: - [~stevenruppert] can you attach traces? [~joshrosen], a glance

[jira] [Commented] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(41,

[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958880#comment-15958880 ] Rostyslav Sotnychenko commented on SPARK-19068: ---

[jira] [Comment Edited] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdat

[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958880#comment-15958880 ] Rostyslav Sotnychenko edited comment on SPARK-19068 at 4/6/17 1:00 PM:

[jira] [Assigned] (SPARK-20242) Delay stop of web UI

[ https://issues.apache.org/jira/browse/SPARK-20242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20242: Assignee: Apache Spark > Delay stop of web UI > > >

[jira] [Assigned] (SPARK-20242) Delay stop of web UI

[ https://issues.apache.org/jira/browse/SPARK-20242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20242: Assignee: (was: Apache Spark) > Delay stop of web UI > > >

[jira] [Commented] (SPARK-20242) Delay stop of web UI

[ https://issues.apache.org/jira/browse/SPARK-20242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958872#comment-15958872 ] Apache Spark commented on SPARK-20242: -- User 'barnardb' has created a pull request for this issue:

[jira] [Commented] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(41,

[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958846#comment-15958846 ] Rostyslav Sotnychenko commented on SPARK-19068: --- As a work-around one can rise value of

[jira] [Created] (SPARK-20242) Delay stop of web UI

Ben Barnard created SPARK-20242: --- Summary: Delay stop of web UI Key: SPARK-20242 URL: https://issues.apache.org/jira/browse/SPARK-20242 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-20242) Delay stop of web UI

[ https://issues.apache.org/jira/browse/SPARK-20242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958804#comment-15958804 ] Ben Barnard commented on SPARK-20242: - I will submit a pull request for this. > Delay stop of web UI

[jira] [Commented] (SPARK-20240) SparkSQL support limitations of max dynamic partitions when inserting hive table

[ https://issues.apache.org/jira/browse/SPARK-20240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958801#comment-15958801 ] Apache Spark commented on SPARK-20240: -- User 'zenglinxi0615' has created a pull request for this

[jira] [Assigned] (SPARK-20240) SparkSQL support limitations of max dynamic partitions when inserting hive table

[ https://issues.apache.org/jira/browse/SPARK-20240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20240: Assignee: Apache Spark > SparkSQL support limitations of max dynamic partitions when

[jira] [Assigned] (SPARK-20240) SparkSQL support limitations of max dynamic partitions when inserting hive table

[ https://issues.apache.org/jira/browse/SPARK-20240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20240: Assignee: (was: Apache Spark) > SparkSQL support limitations of max dynamic

[jira] [Commented] (SPARK-20228) Random Forest instable results depending on spark.executor.memory

[ https://issues.apache.org/jira/browse/SPARK-20228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958755#comment-15958755 ] Sean Owen commented on SPARK-20228: --- I don't think there's a problem here. I'm saying that if you vary

[jira] [Commented] (SPARK-20082) Incremental update of LDA model, by adding initialModel as start point

[ https://issues.apache.org/jira/browse/SPARK-20082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958754#comment-15958754 ] Mathieu D commented on SPARK-20082: --- [~yuhaoyan] or [~josephkb] any feedback on this approach and PR ?

[jira] [Commented] (SPARK-20228) Random Forest instable results depending on spark.executor.memory

[ https://issues.apache.org/jira/browse/SPARK-20228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958719#comment-15958719 ] Ansgar Schulze commented on SPARK-20228: Should not be there a WARN message if there is a memory

[jira] [Updated] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribute

[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 翟玉勇 updated SPARK-20241: Description: do some sql operate for example :insert into table mytable select * from othertable there are WARN

[jira] [Comment Edited] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAtt

[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958636#comment-15958636 ] 翟玉勇 edited comment on SPARK-20241 at 4/6/17 10:18 AM: -- {code} val codeAttr =

[jira] [Updated] (SPARK-20240) SparkSQL support limitations of max dynamic partitions when inserting hive table

[ https://issues.apache.org/jira/browse/SPARK-20240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zenglinxi updated SPARK-20240: -- Affects Version/s: 1.6.3 > SparkSQL support limitations of max dynamic partitions when inserting hive

[jira] [Comment Edited] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAtt

[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958698#comment-15958698 ] 翟玉勇 edited comment on SPARK-20241 at 4/6/17 10:18 AM: -- add debug code {code}

[jira] [Commented] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribut

[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958698#comment-15958698 ] 翟玉勇 commented on SPARK-20241: - add debug code {code} logInfo("***" +

[jira] [Created] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribute

翟玉勇 created SPARK-20241: --- Summary: java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribute Key: SPARK-20241

[jira] [Commented] (SPARK-20241) java.lang.IllegalArgumentException: Can not set final [B field org.codehaus.janino.util.ClassFile$CodeAttribute.code to org.codehaus.janino.util.ClassFile$CodeAttribut

[ https://issues.apache.org/jira/browse/SPARK-20241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958636#comment-15958636 ] 翟玉勇 commented on SPARK-20241: - val codeAttr =

[jira] [Commented] (SPARK-20240) SparkSQL support limitations of max dynamic partitions when inserting hive table

[ https://issues.apache.org/jira/browse/SPARK-20240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958573#comment-15958573 ] zenglinxi commented on SPARK-20240: --- There is a configuration parameter in hive that can limit the

[jira] [Assigned] (SPARK-20064) Bump the PySpark verison number to 2.2

[ https://issues.apache.org/jira/browse/SPARK-20064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20064: - Assignee: holdenk Priority: Trivial (was: Minor) > Bump the PySpark verison number to 2.2

[jira] [Resolved] (SPARK-20064) Bump the PySpark verison number to 2.2

[ https://issues.apache.org/jira/browse/SPARK-20064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20064. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17523

  1   2   >