Author: sebb
Date: Mon Sep 22 16:54:25 2025
New Revision: 1928684
Log:
Documentation on accounts-evolution
Modified:
comdev/projects.apache.org/trunk/scripts/README.txt
comdev/projects.apache.org/trunk/scripts/cronjobs/countaccounts.py
comdev/projects.apache.org/trunk/scripts/cronjobs/parsecommitters.py
comdev/projects.apache.org/trunk/site/json/foundation/HEADER.html
comdev/projects.apache.org/trunk/site/timelines.html
comdev/projects.apache.org/trunk/site/timelines2.html
Modified: comdev/projects.apache.org/trunk/scripts/README.txt
==============================================================================
--- comdev/projects.apache.org/trunk/scripts/README.txt Mon Sep 22 14:46:05
2025 (r1928683)
+++ comdev/projects.apache.org/trunk/scripts/README.txt Mon Sep 22 16:54:25
2025 (r1928684)
@@ -44,3 +44,4 @@ various sources:
in: data/projects.xml + projects' DOAP files
out: site/json/projects/*.json - JSON versions of DOAP files
+ site/json/foundation/projects.json - combined listing of all projects
+ + site/json/foundation/accounts-evolution2.json
Modified: comdev/projects.apache.org/trunk/scripts/cronjobs/countaccounts.py
==============================================================================
--- comdev/projects.apache.org/trunk/scripts/cronjobs/countaccounts.py Mon Sep
22 14:46:05 2025 (r1928683)
+++ comdev/projects.apache.org/trunk/scripts/cronjobs/countaccounts.py Mon Sep
22 16:54:25 2025 (r1928684)
@@ -36,6 +36,14 @@ However on day one of a new month, it al
This is so it sees accounts that were created after the final run
on the last day of the month
+Note that the accounts-evolution.json file was preloaded when it was created
in r1658041 (2015-02-07)
+see: https://lists.apache.org/thread/1sj0c1hvr0lnn3drldsv7o9c6dlhf3bg
+The derivation of the initial data is unclear.
+
+There is also parsecommitters.py which creates accounts-evolution2.json
directly from public_ldap_people.json
+The total number of accounts is lower, because it only includes current
entries in LDAP, and some early joiners
+were never added to LDAP.
+
"""
import sys
Modified: comdev/projects.apache.org/trunk/scripts/cronjobs/parsecommitters.py
==============================================================================
--- comdev/projects.apache.org/trunk/scripts/cronjobs/parsecommitters.py
Mon Sep 22 14:46:05 2025 (r1928683)
+++ comdev/projects.apache.org/trunk/scripts/cronjobs/parsecommitters.py
Mon Sep 22 16:54:25 2025 (r1928684)
@@ -108,6 +108,8 @@ with open("../../site/json/foundation/gr
f.close()
###### Test of alternate account evolution counting - start #####
+# see also countaccounts.py, which creates accounts-evolution.json
+
from datetime import datetime
accounts = {} # key: yyyy-mm value: number of accounts created
now = datetime.now() # fetch time once
Modified: comdev/projects.apache.org/trunk/site/json/foundation/HEADER.html
==============================================================================
--- comdev/projects.apache.org/trunk/site/json/foundation/HEADER.html Mon Sep
22 14:46:05 2025 (r1928683)
+++ comdev/projects.apache.org/trunk/site/json/foundation/HEADER.html Mon Sep
22 16:54:25 2025 (r1928684)
@@ -7,6 +7,7 @@
</p>
<ul>
<li><a href="accounts-evolution.json"><code>accounts-evolution.json</code></a>
generated by <code>cronjobs/countaccounts.py</code> from LDAP</li>
+<li><a
href="accounts-evolution2.json"><code>accounts-evolution2.json</code></a>
generated by <code>cronjobs/parsecommitters.py</code> from LDAP dates
(only)</li>
<li><a href="groups.json"><code>groups.json</code></a>, <a
href="people.json"><code>people.json</code></a> and <a
href="people_name.json"><code>people_name.json</code></a> generated by
<code>cronjobs/parsecommitters.py</code> from <a
href="https://whimsy.apache.org/public/";>https://whimsy.apache.org/public/</a></li>
<li><a href="podlings.json"><code>podlings.json</code></a> and <a
href="podlings-history.json"><code>podlings-history.json</code></a> generated
by <code>cronjobs/podlings.py</code> from <a
href="http://incubator.apache.org/podlings.xml";>http://incubator.apache.org/podlings.xml</a></li>
<li><a href="projects.json"><code>projects.json</code></a> imported with
<code>cronjobs/parseprojects.py</code> from <a
href='https://svn.apache.org/repos/asf/comdev/projects.apache.org/trunk/data/projects.xml'>projects'
DOAP files</a></li>
Modified: comdev/projects.apache.org/trunk/site/timelines.html
==============================================================================
--- comdev/projects.apache.org/trunk/site/timelines.html Mon Sep 22
14:46:05 2025 (r1928683)
+++ comdev/projects.apache.org/trunk/site/timelines.html Mon Sep 22
16:54:25 2025 (r1928684)
@@ -14,7 +14,9 @@
</head>
<body>
-<div id="logo"><h1><div style="padding-top: 30px;">Project
Timelines</div></h1></div>
+<div id="logo"><h1><div style="padding-top: 30px;">Project Timelines</div></h1>
+<p>Datasource:
https://projects.apache.org/json/foundation/accounts-evolution.json</p>
+</div>
<div id='cssmenu'>
<ul>
<li><a href='.'><span>Home</span></a></li>
Modified: comdev/projects.apache.org/trunk/site/timelines2.html
==============================================================================
--- comdev/projects.apache.org/trunk/site/timelines2.html Mon Sep 22
14:46:05 2025 (r1928683)
+++ comdev/projects.apache.org/trunk/site/timelines2.html Mon Sep 22
16:54:25 2025 (r1928684)
@@ -15,7 +15,7 @@
<body>
<div id="logo"><h1><div style="padding-top: 30px;">Project Timelines (v2)
using LDAP data only</div></h1>
-<p>N.B. Jan 2004 is the default if the start date is unknown, hence the
spike</p>
+<p>N.B. Jan 2004 is the default if the start date is unknown, hence the spike.
Datasource:
https://projects.apache.org/json/foundation/accounts-evolution2.json</p>
</div>
<div id='cssmenu'>
<ul>
