aborrero added a comment.
the VM is in error state:
This is what I get from the openstack API:
{'code': 500, 'created': '2021-12-10T19:19:35Z', 'message': 'OSError',
'details': 'Traceback (most recent call last):
aborrero added a subtask: T273579: cloudvirt-wdqs1001 getting out of space due
to huge VM.
TASK DETAIL
https://phabricator.wikimedia.org/T206636
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Gehel, aborrero
Cc: dcausse, EBernhardson, Iamamz3
aborrero closed subtask T195121: Contribution from the IGN to Structured Data on Commons as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T190495EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMF, aborreroCc: Aklapper, Ab
aborrero closed this task as "Resolved".aborrero claimed this task.aborrero added a comment.
Since we found a way to do this operation, marking task as resolved now. Feel free to reopen if required.TASK DETAILhttps://phabricator.wikimedia.org/T195121EMAIL PREFER
aborrero closed this task as "Resolved".aborrero added a comment.
root@soweego-1:~# ls -l /public/dumps/
total 16
lrwxrwxrwx 1 root root 59 Dec 12 13:52 incr -> /mnt/nfs/dumps-labstore1007.wikimedia.org/xmldatadumps/incr
lrwxrwxrwx 1 root root 88 Dec 12 13:52 pagecounts-all-sites ->
aborrero claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T209818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aborreroCc: bd808, aborrero, Aklapper, Hjfocs, Nandana, JKSTNK, GTirloni, Fheredia, AndyTan, sietec, Zylc, Bstorm, 1978Gage2001
aborrero edited projects, added cloud-services-team (Kanban); removed cloud-services-team.aborrero triaged this task as "Normal" priority.aborrero added a comment.
Looking into this.TASK DETAILhttps://phabricator.wikimedia.org/T209818EMAIL PREFERENCEShttps://phabricator.wikimedia.or
aborrero added a project: cloud-services-team (Kanban).
TASK DETAILhttps://phabricator.wikimedia.org/T208714EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GTirloni, aborreroCc: Hjfocs, MaxFrax96, Aklapper, Nandana, JKSTNK, GTirloni, Fheredia, AndyTan, sietec
aborrero added a comment.
In T204698#4599707, @Jdlrobson wrote:
@aborrero if we don't hear from Sumit, i suggest we remove this instance, however I'm not sure what the protocol and grace period is for doing so.
Ok,
you can read more about our timeline here:
https://wikitech.wikimedi
aborrero created this task.aborrero triaged this task as "Normal" priority.aborrero added a project: Cloud-VPS.Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTIONUbuntu Trusty is no longer available in Cloud VPS since Nov 2017 for new instances. However, the EOL of
aborrero added a subscriber: Tpt.aborrero added a comment.
We stopped now the corhist tool which belongs to @Tpt, please check the tool. Now that the tool has been terminated, the traffic in wikidata seems back to normal.TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps
aborrero added a comment.
In T204267#4583629, @Pintoch wrote:
@aborrero thanks for the ping. I do not recognize the shape of the queries as coming from this tool though. The openrefine-wikidata tool should do relatively few SPARQL queries, whose results are cached in redis. How did you determine
aborrero added subscribers: Pintoch, aborrero.aborrero added a comment.
Ping @Pintoch , this seems to be your tool.TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, aborreroCc: aborrero, Pintoch
aborrero added a comment.
I just formally requested a project with a single VM for this. See T203072. Please expect a week-long wait until resources are available.TASK DETAILhttps://phabricator.wikimedia.org/T195121EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences
aborrero added a comment.
In T195121#4527757, @fgiunchedi wrote:
Sounds like a nice project! With my swift maintainer hat on, testing a single 200-300 GB chunk of data sounds good to me. Let's coordinate though before uploading the full data set because swift is pending its annual expa
aborrero added a comment.
I just had a videoconf with people @abian and Ruben Ojeda from Wikimedia Spain.
Some conclusions:
IGN offers a lot of data, in many different formats. @abian or someone else should get an idea on how to post-process these files to a format understandable by Commons.
We
aborrero added a subscriber: bd808.aborrero added a comment.
In T195121#4424983, @abian wrote:
In T195121#4224564, @aborrero wrote:
Is it possible to do the processing by type (your first 3 points) instead of all at the same time? So you could reuse small chunks of storage instead of having to
aborrero added a comment.
Hey, this is great news, since IGN is indeed a powerful source of data regarding geography, topology and mountains (which I love).
From the Wikimedia Cloud Services point of view, one thing we could offer is a Cloud VPS temporal project, where you can create one or two
aborrero closed subtask T192892: Request creation of wikibase-registry VPS project as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T192785EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aborreroCc: Addshore, Aklapper, RazShuty, LJ,
19 matches
Mail list logo
