[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title Daniel Beck updated an issue Jenkins / JENKINS-60907 Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true Change By: Daniel Beck Labels: lts-candidate performance Add Comment This message was sent by Atlassian Jira (v7.13.12#713012-sha1:6e07c38) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204298.1580317923000.996.1582841880464%40Atlassian.JIRA.
[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title Thomas de Grenier de Latour closed an issue as Fixed Jenkins / JENKINS-60907 Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true Change By: Thomas de Grenier de Latour Status: Resolved Closed Assignee: Thomas de Grenier de Latour Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204298.1580317923000.1920.1582064520087%40Atlassian.JIRA.
[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title Oleg Nenashev updated an issue Jenkins / JENKINS-60907 Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true Change By: Oleg Nenashev Released As: https://jenkins Jenkins 2 . io/changelog/#v2. 220 Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204298.1580317923000.5286.1581326760573%40Atlassian.JIRA.
[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title Thomas de Grenier de Latour updated JENKINS-60907 Jenkins / JENKINS-60907 Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true Change By: Thomas de Grenier de Latour Status: Fixed but Unreleased Resolved Released As: https://jenkins.io/changelog/#v2.220 Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204298.1580317923000.5231.1581323280216%40Atlassian.JIRA.
[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title Thomas de Grenier de Latour updated an issue Jenkins / JENKINS-60907 Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true Tagging as a LTS candidate (for 2.204.3), to be considered after it is released in the next weekly. It's not a critical fix, but on the other hand the change is pretty simple, can hardly have any undesirable side effects, and is useful in some use cases. Change By: Thomas de Grenier de Latour Labels: lts-candidate performance Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to
[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title Thomas de Grenier de Latour updated JENKINS-60907 PR #4459 is now merged Jenkins / JENKINS-60907 Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true Change By: Thomas de Grenier de Latour Status: Open Fixed but Unreleased Resolution: Fixed Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to
[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title Thomas de Grenier de Latour commented on JENKINS-60907 Re: Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true With buffered streams (PR #4459), my test case with traffic compression disabled now completes in ~30 seconds (vs. ~50 seconds with compression). Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204298.1580317923000.8464.1580332020049%40Atlassian.JIRA.
[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title Thomas de Grenier de Latour updated an issue Jenkins / JENKINS-60907 Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true Change By: Thomas de Grenier de Latour URL: https://github.com/jenkinsci/jenkins/pull/4459 Add Comment This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-issues/JIRA.204298.1580317923000.8463.1580331840073%40Atlassian.JIRA.
[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title
Thomas de Grenier de Latour updated an issue
Jenkins / JENKINS-60907
Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Change By:
Thomas de Grenier de Latour
With the new {{jenkins.model.StandardArtifactManager.disableTrafficCompression}} property (JENKINS-26008 / [PR #4205|https://github.com/jenkinsci/jenkins/pull/4205]), I was expecting improved performances when archiving artifacts from slaves to master. Especially when there is no room for further compression (when the artifact is already a compressed archive). But my first tests with 2.204.1 and this option are disappointing. On my test setup:- with traffic compression (default setting), archiving a ~200 MB .tar.gz file consistently takes ~50 seconds (which is really not great already)- without traffic compression (the new option), it now takes ~240 seconds!I suspect this is because {{FilePath.TarCompression.NONE}} lacks a layer of buffering input/output streams, which is there in {{FilePath.TarCompression.GZIP}}:[FilePath.java#L758|https://github.com/jenkinsci/jenkins/blob/jenkins-2.204.1/core/src/main/java/hudson/FilePath.java#L758] - {{GZIPInputStream}} is a buffering {{InputStream}} (here with buffer size set to 8K) - {{GZIPOutputStream}} is a buffering {{OutputStream}} (with a default buffer size of 512), and here there is also an addition additionnal {{BufferedOutputStream}} involved (with its default buffer size of 8K)I will submit a PR for {{FilePath.TarCompression.NONE}} to add the missing buffering layer, such so that the difference with {{GZIP}} will really only be only about compression.
Add Comment
[JIRA] (JENKINS-60907) Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true
Title: Message Title Thomas de Grenier de Latour created an issue Jenkins / JENKINS-60907 Poor performance with jenkins.model.StandardArtifactManager.disableTrafficCompression=true Issue Type: Bug Assignee: Unassigned Components: core Created: 2020-01-29 17:12 Environment: Jenkins 2.204.1 Linux (Ubuntu 18.04) OpenJDK 8u242 Priority: Minor Reporter: Thomas de Grenier de Latour With the new jenkins.model.StandardArtifactManager.disableTrafficCompression property (JENKINS-26008 / PR #4205), I was expecting improved performances when archiving artifacts from slaves to master. Especially when there is no room for further compression (when the artifact is already a compressed archive). But my first tests with 2.204.1 and this option are disappointing. On my test setup: with traffic compression (default setting), archiving a ~200 MB .tar.gz file consistently takes ~50 seconds (which is really not great already) without traffic compression (the new option), it now takes ~240 seconds! I suspect this is because FilePath.TarCompression.NONE lacks a layer of buffering input/output streams, which is there in FilePath.TarCompression.GZIP: FilePath.java#L758 GZIPInputStream is a buffering InputStream (here with buffer size set to 8K) GZIPOutputStream is a buffering OutputStream (with a default buffer size of 512), and here there is also an addition
