On 06/02/18 06:53, Thanh Ha wrote: > The old-style mdsal-merge job deployed and I kicked off a build: > > https://jenkins.opendaylight.org/releng/view/Merge-Jobs/job/mdsal-merge-oxygen/1/console > > It takes about 50 minutes for mdsal to build so we'll know in ~50 > minutes if that fixed the issue.
Hello Thanh, the one thing I found is a difference in file upload strategy in the two jobs: old: > Deploying the main artifact iana-afn-safi-2013.07.04.12.0-SNAPSHOT.jar > Downloading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml > Downloaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml > (2 KB at 20.8 KB/sec) > Uploading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112.jar > Uploaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112.jar > (23 KB at 2.4 KB/sec) > Uploading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112.pom > Uploaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112.pom > (2 KB at 7.5 KB/sec) > Downloading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml > Downloaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml > (481 B at 31.3 KB/sec) > Uploading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml > Uploaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml > (2 KB at 4.3 KB/sec) > Uploading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml > Uploaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml > (481 B at 0.6 KB/sec) > Deploying the main artifact iana-afn-safi-2013.07.04.12.0-SNAPSHOT-javadoc.jar > Uploading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112-javadoc.jar > Uploaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112-javadoc.jar > (50 KB at 58.1 KB/sec) > Uploading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml > Uploaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml > (2 KB at 2.7 KB/sec) > Deploying the main artifact iana-afn-safi-2013.07.04.12.0-SNAPSHOT-sources.jar > Uploading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112-sources.jar > Uploaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112-sources.jar > (13 KB at 13.0 KB/sec) > Uploading: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml > Uploaded: > https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml > (2 KB at 1.9 KB/sec) new: > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.jar.sha1 > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.jar > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.jar.md5 > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.pom > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.pom.sha1 > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.pom.md5 > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml.sha1 > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml.md5 > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-javadoc.jar > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-javadoc.jar.sha1 > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-javadoc.jar.md5 > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-sources.jar > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-sources.jar.sha1 > Uploading > org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-sources.jar.md5 > Uploading org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml > Uploading org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml.sha1 > Uploading org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml.md5 It seems we are doing things in different order, old: - download artifact-$VERSION metadata - upload artifact-$VERSION content (jar, pom) - download artifact metadata - upload artifact-$VERSION metadata - upload artifact metadata Whereas new does not seem to do any sort of ordering -- and uploads also checksums, etc. Now I don't know if nexus is doing anything the the metadata it has or how it reacts to parallel deployment of related artifacts. I would suggest creating a smarter strategy: - group files by their artifact name (i.e. directory) for each artifact file group: - upload content (jars, pom, javadoc, sources, etc. etc.) for an artifact in a serial manner first - upload versioned metadata - upload metadata Never use parallelism inside a group, use parallelism across groups -- i.e. deploy multiple artifacts concurrently while retaining file upload ordering matching how the old job does things within each artifact. Regards, Robert
signature.asc
Description: OpenPGP digital signature
_______________________________________________ controller-dev mailing list controller-dev@lists.opendaylight.org https://lists.opendaylight.org/mailman/listinfo/controller-dev