Re: Cleanup of dist (https://dist.apache.org/repos/dist/release/sling/)

2021-03-01 Thread Robert Munteanu
> On Wed, Feb 24, 2021 at 7:24 PM Konrad Windszus > wrote: > > currently we do have almost 6k files directly below > > https://dist.apache.org/repos/dist/release/sling/ > > which makes handling with SVN really hard in that directory > > Using the "Quick update of artifacts in dist" instructio

Re: Cleanup of dist (https://dist.apache.org/repos/dist/release/sling/)

2021-03-01 Thread Robert Munteanu
On Thu, 2021-02-25 at 12:12 +0100, Carsten Ziegeler wrote: > You should have automation in place to detect issues - that used to be > in place, not sure if it still is. As soon as its more than 10 files > any > > manual process will fail. There used to be https://checker.apache.org/ , but it is

Re: Cleanup of dist (https://dist.apache.org/repos/dist/release/sling/)

2021-02-25 Thread Bertrand Delacretaz
Hi, On Thu, Feb 25, 2021 at 12:56 PM Konrad Windszus wrote: > > The biggest difference is that without binaries it becomes possible again to > checkout > dist again and clean it up without solely relying on svn import/export... What kind of cleanup is needed? If we write some sanity check tool

Re: Cleanup of dist (https://dist.apache.org/repos/dist/release/sling/)

2021-02-25 Thread Konrad Windszus
The biggest difference is that without binaries it becomes possible again to checkout dist again and clean it up without solely relying on svn import/export. That is way more comfortable and allows to use other tools than CLI for that. Regarding filtering what needs to be put to dist, that can be

Re: Cleanup of dist (https://dist.apache.org/repos/dist/release/sling/)

2021-02-25 Thread Carsten Ziegeler
You should have automation in place to detect issues - that used to be in place, not sure if it still is. As soon as its more than 10 files any manual process will fail. If we start to exclude files from being put into dist, I think the release process is even harder than today - as I need to

Re: Cleanup of dist (https://dist.apache.org/repos/dist/release/sling/)

2021-02-25 Thread Bertrand Delacretaz
On Thu, Feb 25, 2021 at 9:54 AM Konrad Windszus wrote: >... It is close to impossible to detect issues like these with 6k files >without tooling. Assuming we have 300 modules, the minimum number of files in there is N*300 which IMHO doesn't work anyway for manual inspection. At least not at

Re: Cleanup of dist (https://dist.apache.org/repos/dist/release/sling/)

2021-02-25 Thread Konrad Windszus
> What exact problems are you seeing? https://issues.apache.org/jira/browse/SLING-10153 https://issues.apache.org/jira/browse/SLING-10152 https://issues.apache.org/jira/browse/SLING-10151 In general I doubt that dist is very often used for downloading binaries and I want to reduce effort for d

Re: Cleanup of dist (https://dist.apache.org/repos/dist/release/sling/)

2021-02-25 Thread Bertrand Delacretaz
Hi, On Wed, Feb 24, 2021 at 7:24 PM Konrad Windszus wrote: > currently we do have almost 6k files directly below > https://dist.apache.org/repos/dist/release/sling/ > which makes handling with SVN really hard in that directory Using the "Quick update of artifacts in dist" instructions that

Cleanup of dist (https://dist.apache.org/repos/dist/release/sling/)

2021-02-24 Thread Konrad Windszus
Hi, currently we do have almost 6k files directly below https://dist.apache.org/repos/dist/release/sling/ which makes handling with SVN really hard in that directory. As ASF only requires us to upload source releases there (http://www.apache.org/legal/release-policy.html#what-must-every-release-