[JIRA] (JENKINS-17236) Pluggable artifact transfer storage

2013-03-15 Thread jgl...@cloudbees.com (JIRA)














































Jesse Glick
 created  JENKINS-17236


Pluggable artifact transfer  storage















Issue Type:


New Feature



Assignee:


Jesse Glick



Components:


core



Created:


15/Mar/13 4:50 PM



Description:


Currently artifact archiving follows a fixed model: artifacts are defined in ArtifactArchiver (or MavenArtifactArchiver) configuration; they are copied from slave to master using FilePath.copyRecursiveTo; they are stored in ${Run.rootDir}/archive; and they are served by browsing this directory in master.

This system has obvious scalability limitations: channel transfer is not particularly efficient; and storing enormous files in the builds directory can cause disk overruns.

The CloudBees Fast Archiver plugin tries to address the transfer speed issue by using a better algorithm. This helps, but the implementation (replacing the ArtifactArchiver build step) is very awkward, and cannot be made to work properly with Maven projects, fingerprints, etc.

Some installations may anyway not need to copy files at all. The master and slave might share a common network filesystem, or might have a way of efficiently transferring file references (e.g. ZFS send).

Finally, there should be the option to store artifacts in a better way: on a big slow drive, in a compressed archive, etc.

To handle all these requirements we need an extension point that encompasses both transfer and storage of artifacts for each build.




Project:


Jenkins



Priority:


Major



Reporter:


Jesse Glick

























This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira







-- 
You received this message because you are subscribed to the Google Groups Jenkins Issues group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.




[JIRA] (JENKINS-17236) Pluggable artifact transfer storage

2013-03-15 Thread scm_issue_l...@java.net (JIRA)














































SCM/JIRA link daemon
 commented on  JENKINS-17236


Pluggable artifact transfer  storage















Code changed in jenkins
User: Jesse Glick
Path:
 core/src/main/java/hudson/model/Run.java
 core/src/main/java/hudson/tasks/ArtifactArchiver.java
 core/src/main/java/jenkins/model/ArtifactManager.java
 core/src/main/java/jenkins/model/StandardArtifactManager.java
 maven-plugin/src/main/java/hudson/maven/MavenBuild.java
 maven-plugin/src/main/java/hudson/maven/MavenBuildProxy.java
 maven-plugin/src/main/java/hudson/maven/reporters/MavenArtifact.java
 maven-plugin/src/main/java/hudson/maven/reporters/MavenArtifactArchiver.java
 maven-plugin/src/main/java/hudson/maven/reporters/MavenArtifactRecord.java
http://jenkins-ci.org/commit/jenkins/e1eea67bb2fa1a356492e91313d84a523f441b34
Log:
  JENKINS-17236 Initial version of ArtifactManager (no Maven support yet).



 
You received this message because you are subscribed to the Google Groups "Jenkins Commits" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-commits+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.






























This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira







-- 
You received this message because you are subscribed to the Google Groups Jenkins Issues group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.




[JIRA] (JENKINS-17236) Pluggable artifact transfer storage

2013-03-15 Thread jgl...@cloudbees.com (JIRA)














































Jesse Glick
 updated  JENKINS-17236


Pluggable artifact transfer  storage
















Change By:


Jesse Glick
(15/Mar/13 6:35 PM)




URL:


https://github.com/jenkinsci/jenkins/pull/736



























This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira







-- 
You received this message because you are subscribed to the Google Groups Jenkins Issues group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.




[JIRA] (JENKINS-17236) Pluggable artifact transfer storage

2013-03-15 Thread jgl...@cloudbees.com (JIRA)














































Jesse Glick
 started work on  JENKINS-17236


Pluggable artifact transfer  storage
















Change By:


Jesse Glick
(15/Mar/13 6:35 PM)




Status:


Open
InProgress



























This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira







-- 
You received this message because you are subscribed to the Google Groups Jenkins Issues group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.




[JIRA] (JENKINS-17236) Pluggable artifact transfer storage

2013-03-15 Thread jgl...@cloudbees.com (JIRA)














































Jesse Glick
 commented on  JENKINS-17236


Pluggable artifact transfer  storage















API should be fleshed out; still need to add Maven support. Working on a prototype plugin archiving to ${build.rootDir}/archive.zip.



























This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira







-- 
You received this message because you are subscribed to the Google Groups Jenkins Issues group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.