Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Claire Cadman updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Claire Cadman Labels: doc_reviewed Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.94668.1607532000289%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Mihai Buzgau updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Mihai Buzgau Fix Version/s: PUP 7.1.0 Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.94460.1607515560039%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Release Notes: Bug Fix Release Notes Summary: Previously, if the environment.conf for an environment was updated and the environment was cleared, then puppetserver would still use the old values in memory for per-environment settings such as modulepath, config_version, etc. This was true if the environment timed out or if the environment was explicitly cleared using puppetserver's environment cache REST API. Now if an environment is cleared, puppet will reload the per-environment settings from the updated environment.conf. Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper commented on PUP-10713 Re: Fine grained environment timeout issues Merged to master in https://github.com/puppetlabs/puppet/commit/8720fab607503e41954599cc685bf532364ed451 Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.79063.1605294360084%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title
Josh Cooper updated an issue
Puppet / PUP-10713
Fine grained environment timeout issues
Change By:
Josh Cooper
Puppet's environment cache has three methods for evicting a single expired environment, all expired environments, or all environments, but they don't mutate the cache in a consistent way:1. Whenever {{Puppet::Environments::Cached#get_conf(name)}} is called to lookup the {{EnvironmentConf}} for an environment, we clear that environment if it is now expired via {{evict_if_expired(name)}}, but the method doesn't update the {{@next_expiration}} instance variable. As a result, the optimization in {{clear_all_evicted}} may cause us to call the {{cache_expiration_service.expired?(name.to_sym}} twice.2. Whenever {{Puppet::Environments::Cached#get(name)}} is called, we clear all environments that are now expired via {{clear_all_expired}}. This method updates the cache consistently.3. Whenever {{Puppet::Environments::Cached#clear_all}} is called, the {{cache_expiration_service}} is never notified of the eviction, which could lead to puppetserver holding onto environment names in memory. The method also does not clear environment related settings (for each environment). So anyone calling `Puppet[:rich_data]` for example could "see" the value from the now evicted environment. The {{clear_all}} method is used when Puppet[:rich_data] is set and also in unit tests.4. The {{Puppet::Environments::Cached#clear}} method does not remove the environment entry from the {{@expirations}} sorted set and doesn't recalculate the {{@next_expiration}} time, or clear the enviroment related settings. The {{clear}} methods does not appear to be used in puppet, as it was decided earlier to only support a REST API for cache eviction.
Add Comment
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Labels: platform_7 Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.7.1604537700083%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Fix Version/s: PUP 7.0.0 Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.72223.1604537700127%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title
Josh Cooper updated an issue
Puppet / PUP-10713
Fine grained environment timeout issues
Change By:
Josh Cooper
Puppet's environment cache has several three methods for evicting an a single expired environment, all expired environments, or all environments, but they do not don't mutate the cache in a consistent way:1. Whenever {{Puppet::Environments::Cached#get_conf(name)}} to lookup the {{EnvironmentConf}} for an environment is requested , we evict all environments clear that are environment if it is now expired , but the via {{evict_if_expired (name) }} , but the method doesn't update the {{@next_expiration}} instance variable. As a result, the optimization in {{clear_all_evicted}} may cause us to call the {{cache_expiration_service.expired?(name.to_sym}} twice.2. The Whenever {{ clear_all Puppet::Environments::Cached#get(name) }} is called, we clear all environments that are now expired via {{clear_all_expired}}. This method does not notify updates the cache consistently.3. Whenever {{ Puppet::Environments::Cached#clear_all}} is called, the {{ cache_expiration_service}} that it evicted all is never notified of the environments. This eviction, which could lead to puppetserver holding onto environment names unnecessarily in memory . The method also does not clear environment related settings (for each environment). So anyone calling `Puppet[:rich_data]` for example could "see" the value from the now evicted environment. The {{clear_all}} method is used when Puppet[:rich_data] is set and also in unit tests. 3 4 . The {{ Puppet::Environments::Cached# clear}} method does not remove the environment entry from the {{@expirations}} sorted set , it and doesn't recalculate the {{@next_expiration}} time, or clear the enviroment related settings. The - {{ clear_all}} and- {{ clear}} methods does not appear to be used in puppet, as it was decided earlier to only support a REST API for cache eviction. -So we might want to remove {{clear_all}} and {{clear}} to avoid confusion.- The {{clear_all}} method is used when Puppet[:rich_data] is set and also in unit tests.
Add Comment
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Epic Link: PUP-10593 Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.72163.1604536140204%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title
Josh Cooper updated an issue
Puppet / PUP-10713
Fine grained environment timeout issues
Change By:
Josh Cooper
Puppet's environment cache has several methods for evicting an environment, but they do not mutate the cache in a consistent way:1. Whenever an environment is requested, we evict all environments that are now expired, but the {{evict_if_expired}} method doesn't update the {{@next_expiration}} instance variable. As a result, the optimization in {{clear_all_evicted}} may cause us to call the {{cache_expiration_service.expired?(name.to_sym}} twice.2. The {{clear_all}} method does not notify the {{cache_expiration_service}} that it evicted all of the environments. This could lead to puppetserver holding onto environment names unnecessarily. The method also does not clear environment related settings (for each environment).3. The {{clear}} method does not remove the environment entry from the {{@expirations}} sorted set, it doesn't recalculate the {{@next_expiration}} time, or clear the enviroment related settings.The - {{clear_all}} and - {{clear}} methods do does not appear to be used in puppet, as it was decided earlier to only support a REST API for cache eviction. - So we might want to remove {{clear_all}} and {{clear}} to avoid confusion. - The {{clear_all}} method is used when Puppet[:rich_data] is set and also in unit tests.
Add Comment
This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Fix Version/s: PUP 6.20.0 Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.72164.1604536140247%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper assigned an issue to Josh Cooper Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Assignee: Josh Cooper Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.62153.1603414320112%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Fix Version/s: PUP 7.0.0 Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.62152.1603414320058%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Sprint: Platform Core KANBAN Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.62154.1603414320155%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Epic Link: PUP-10593 Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.57266.1602869460029%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper commented on PUP-10713 Re: Fine grained environment timeout issues Added to platform_7 so that we can delete the clear and clear_all methods (so all manual cache eviction is handled through the REST API). Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.55941.1602697860375%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Team: Coremunity Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.55942.1602697860419%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper updated an issue Puppet / PUP-10713 Fine grained environment timeout issues Change By: Josh Cooper Labels: platform_7 Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.374883.1602635146000.55933.1602697800036%40Atlassian.JIRA.
Jira (PUP-10713) Fine grained environment timeout issues
Title: Message Title Josh Cooper created an issue Puppet / PUP-10713 Fine grained environment timeout issues Issue Type: Bug Assignee: Unassigned Created: 2020/10/13 5:25 PM Priority: Normal Reporter: Josh Cooper Puppet's environment cache has several methods for evicting an environment, but they do not mutate the cache in a consistent way: 1. Whenever an environment is requested, we evict all environments that are now expired, but the evict_if_expired method doesn't update the @next_expiration instance variable. As a result, the optimization in clear_all_evicted may cause us to call the cache_expiration_service.expired?(name.to_sym twice. 2. The clear_all method does not notify the cache_expiration_service that it evicted all of the environments. This could lead to puppetserver holding onto environment names unnecessarily. The method also does not clear environment related settings (for each environment). 3. The clear method does not remove the environment entry from the @expirations sorted set, it doesn't recalculate the @next_expiration time, or clear the enviroment related settings. The clear_all and clear methods do not appear to be used in puppet, as it was decided earlier to only support a REST API for cache eviction. So we might want to remove clear_all and clear to avoid confusion. Add Comment
