On 06/02/18 06:53, Thanh Ha wrote:
> The old-style mdsal-merge job deployed and I kicked off a build:
> 
> https://jenkins.opendaylight.org/releng/view/Merge-Jobs/job/mdsal-merge-oxygen/1/console
> 
> It takes about 50 minutes for mdsal to build so we'll know in ~50
> minutes if that fixed the issue.

Hello Thanh,

the one thing I found is a difference in file upload strategy in the two
jobs:

old:

> Deploying the main artifact iana-afn-safi-2013.07.04.12.0-SNAPSHOT.jar
> Downloading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml
> Downloaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml
>  (2 KB at 20.8 KB/sec)
> Uploading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112.jar
> Uploaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112.jar
>  (23 KB at 2.4 KB/sec)
> Uploading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112.pom
> Uploaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112.pom
>  (2 KB at 7.5 KB/sec)
> Downloading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml
> Downloaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml
>  (481 B at 31.3 KB/sec)
> Uploading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml
> Uploaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml
>  (2 KB at 4.3 KB/sec)
> Uploading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml
> Uploaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml
>  (481 B at 0.6 KB/sec)
> Deploying the main artifact iana-afn-safi-2013.07.04.12.0-SNAPSHOT-javadoc.jar
> Uploading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112-javadoc.jar
> Uploaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112-javadoc.jar
>  (50 KB at 58.1 KB/sec)
> Uploading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml
> Uploaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml
>  (2 KB at 2.7 KB/sec)
> Deploying the main artifact iana-afn-safi-2013.07.04.12.0-SNAPSHOT-sources.jar
> Uploading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112-sources.jar
> Uploaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.071107-112-sources.jar
>  (13 KB at 13.0 KB/sec)
> Uploading: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml
> Uploaded: 
> https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml
>  (2 KB at 1.9 KB/sec)

new:

> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.jar.sha1
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.jar
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.jar.md5
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.pom
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.pom.sha1
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111.pom.md5
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml.sha1
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/maven-metadata.xml.md5
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-javadoc.jar
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-javadoc.jar.sha1
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-javadoc.jar.md5
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-sources.jar
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-sources.jar.sha1
> Uploading 
> org/opendaylight/mdsal/model/iana-afn-safi/2013.07.04.12.0-SNAPSHOT/iana-afn-safi-2013.07.04.12.0-20180206.034156-111-sources.jar.md5
> Uploading org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml
> Uploading org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml.sha1
> Uploading org/opendaylight/mdsal/model/iana-afn-safi/maven-metadata.xml.md5

It seems we are doing things in different order, old:
- download artifact-$VERSION metadata
- upload artifact-$VERSION content (jar, pom)
- download artifact metadata
- upload artifact-$VERSION metadata
- upload artifact metadata

Whereas new does not seem to do any sort of ordering -- and uploads also
checksums, etc.

Now I don't know if nexus is doing anything the the metadata it has or
how it reacts to parallel deployment of related artifacts. I would
suggest creating a smarter strategy:

- group files by their artifact name (i.e. directory)

for each artifact file group:
- upload content (jars, pom, javadoc, sources, etc. etc.) for an
artifact in a serial manner first
- upload versioned metadata
- upload metadata

Never use parallelism inside a group, use parallelism across groups --
i.e. deploy multiple artifacts concurrently while retaining file upload
ordering matching how the old job does things within each artifact.

Regards,
Robert

Attachment: signature.asc
Description: OpenPGP digital signature

_______________________________________________
controller-dev mailing list
controller-dev@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/controller-dev

Reply via email to