[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 Marc A. Pelletier changed: What|Removed |Added Status|REOPENED|RESOLVED Resolution|---

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #25 from jeremyb --- (In reply to Tim Landscheidt from comment #24) > New server tracked in RT #7578. I can't see that. I assume it's in procurement. There's several more relevant tickets e.g. RT 7948, RT 8090 None have been upda

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #24 from Tim Landscheidt --- New server tracked in RT #7578. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wiki

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 Marc A. Pelletier changed: What|Removed |Added CC||bgwh...@gmail.com --- Comment #23

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #22 from Marc A. Pelletier --- There will be a new server allocated for dumps and pagecounts which will give us several times more space than we need, and will return that space from labstore1001 back to the usable pool. More news

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #21 from Marc A. Pelletier --- On the dumps FS? Fairly hard: it doesn't live on the shelves since it didn't need the same level of redundancy and fully fills its raid. There are three things there, however, so perhaps we can move

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #20 from Ariel T. Glenn --- I don't know how feasible that is. Marc? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@li

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #19 from Tim Landscheidt --- Just to clarify, are we talking about: | scfc@tools-login:~$ df -h /public/dumps/pagecounts-raw | Filesystem Size Used Avail Use% Mounted on | labstore.svc.eqiad.wmnet:/dumps 9.1

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #18 from Ariel T. Glenn --- Folks, if I don't hear back on this soon I'm going to whack files so only the last year is there; we're down to 300 gb or so on that filesystem. -- You are receiving this mail because: You are on the CC

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 Ariel T. Glenn changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|FIXED

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 Marc A. Pelletier changed: What|Removed |Added Status|PATCH_TO_REVIEW |RESOLVED Resolution|---

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #15 from Gerrit Notification Bot --- Change 91293 merged by ArielGlenn: dumps: Copy pagecounts data to public labs nfs too https://gerrit.wikimedia.org/r/91293 -- You are receiving this mail because: You are on the CC list for th

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #14 from Gerrit Notification Bot --- Change 91293 had a related patch set uploaded by Yuvipanda: dumps: Copy pagecounts data to public labs nfs too https://gerrit.wikimedia.org/r/91293 -- You are receiving this mail because: You

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 Gerrit Notification Bot changed: What|Removed |Added Status|NEW |PATCH_TO_REVIEW -- You are

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #13 from Diederik van Liere --- We have an RFC for making this pageview data queryable: https://www.mediawiki.org/wiki/Analytics/Hypercube -- You are receiving this mail because: You are on the CC list for the bug. ___

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #12 from Diederik van Liere --- @Yuvi, Apergos: can we please coordinate this as the Analytics team is working on a mysql setup with this data -- You are receiving this mail because: You are on the CC list for the bug. ___

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #11 from Yuvi Panda --- Talked with apergos about it, and I've gotten a good idea of what needs doing. Will try to do a puppet patchset in a while. Assuming that 3.1T on NFS won't be an issue... :D -- You are receiving this mail

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #10 from Yuvi Panda --- If it is no problem getting all 3.1T of it in Labs, we should! -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #9 from Addshore --- I can't remember who initially asked me about this. I imagine a Year would suffice, who large would that be? -- You are receiving this mail because: You are on the CC list for the bug. ___

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #8 from Ariel T. Glenn --- Did we decide folks need the whole 3.1T? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lis

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #7 from Yuvi Panda --- *bump* -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimed

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #6 from Ariel T. Glenn --- It makes sense(In reply to comment #5) > ... wait, that's already accessible through HTTP; why doesn't that suffice? So everyone downloads their own copy, 3.1T worth, and puts it where? It makes sense to

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #5 from Marc A. Pelletier --- ... wait, that's already accessible through HTTP; why doesn't that suffice? -- You are receiving this mail because: You are on the CC list for the bug. ___

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #4 from Marc A. Pelletier --- There is space, though 3.1T is big enough that I'd like to see if we can somehow manage to share access to a single copy rather than duplicate it around. -- You are receiving this mail because: You ar

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 --- Comment #3 from Ariel T. Glenn --- This could be done but it's 3.1T (and will only get bigger); is there space for this, Ryan? -- You are receiving this mail because: You are on the CC list for the bug. ___

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 Peter Bena changed: What|Removed |Added CC||ar...@wikimedia.org, |

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 Peter Bena changed: What|Removed |Added Priority|Normal |High Severity|normal

[Bug 48894] Include pagecounts dumps in datasets

https://bugzilla.wikimedia.org/show_bug.cgi?id=48894 Peter Bena changed: What|Removed |Added Priority|Unprioritized |Normal CC|