Addshore added a comment.
> The energy savings is possibly unclear, at least under current case (but that's partly because it's hard to know how much energy is being expended, which could be guessed at from number of dump downloads; not sure how easy it is to get those stats; this is different from the bandwidth transfer on Cloudflare R2). Are you talking about number of dump downloads of the JNL or of triples? I believe the only way to really tell # of dump downloads of JNL on R2 is to infer this from the bytes downloaded For example on my large JNL file I have had many connections / download starts, but only a few people downloaded the full file size. As the file size is so big the number is probably fairly accurate though. For my JNL file in the past 30 days... 829 connection requests, 141 unique visitors 8TB data served, so probably 6-7 full downloads in 30 days > Thinking ahead a little, we'd probably want to generalize anything so that it can take arbitrary .jnls, for example for split graphs. I think the generalized approach here should probably just be taking large files from WDQS land and dumping them into a space like R2 Information that would be great to flow with that data would be a checksum of the thing prior to all of the copying, and also a timestamp the thing was taken from. One of the next steps I want to try along this journey is downloading the file from R2, and adding it to a volume image for an EC2 machine or compute machine on another cloud provider. This should also remove the "download" step from those that want to use this file in coud lands and provide a fairly instant experience on whatever hardware for "your own WDQS" TASK DETAIL https://phabricator.wikimedia.org/T347605 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, Addshore Cc: Addshore, dr0ptp4kt, Aklapper, bking, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen, BTullis, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
