Re: Fedora packages site down
How hard is to swap Solr search engine backend to client side JS search? Are there any fast client side JS search engines? If no-JS navigation is important, maybe it is possible to add clickable index for all packages under the search form? I added CI job for GitHub Pages, but of course it is impossible to host Solr backend there https://github.com/abitrolly/fedora-packages-static ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: Fedora packages site down
Hi. I've deployed the static website to GitHub Pages at https://abitrolly.github.io/fedora-packages-static/ The search doesn't work, and there is no index to browse, so it is not very useful. Looks like the search is supposed to be Solr, which is not static. ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: infrastructure.fedoraproject.org
I like the layout http://docs.fedoraproject.org/ - clear, simple and up to the point without too much text. While ideally I wish that the same page would be designed for Infrastructure team alone (with a backlink to main docs page) I am unlikely to become a person who can physically do this anytime soon. Therefore an idea to place a redirect and avoid maintaining extra things in extra place seems most logical right now. The page that I would expect to find there, however, ia - https://fedora-infra-docs.readthedocs.io/en/latest/index.html - as it is probably the most practical information about Fedora infrastructure to learn from. ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
infrastructure.fedoraproject.org
Good Sunday. ) I found this https://infrastructure.fedoraproject.org/ while searching for this list. Maybe make it a single page entrypoint for all related things? Static site generator with quick links to sources, SOP, wiki (?) and this list. ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: Statistics. Stats for installled or downloaded packages
I need only package info like https://popcon.debian.org/ but getting stats about Fedora hardware similar to https://store.steampowered.com/hwsurvey/ is interesting. I can not find the source code for Smolt. The first point at https://fedoraproject.org/wiki/Smolt_retirement#Rationale is that Smalt is not maintained for more than 10 months, but census GitHub is 5 years old. I am not a fan of rewrites. It seems to me that taking http://web.archive.org/web/20121029093725/http://www.smolts.org/static/stats/stats.html and then fixing that is way faster than writing everything from scratch. I wish rationale above contained more technical details, because rewriting is always a step back until everything is implemented, and it would be interesting to know what were design limitation and why census design is better. ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: Statistics. Stats for installled or downloaded packages
Now I see. Then porting https://popcon.debian.org/ to Fedora and providing infrastructure for incoming data is the only way to collect the stats. How to know if that is possible or interesting for Fedora? ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: Statistics. Stats for installled or downloaded packages
> On Mon, 5 Nov 2018 at 09:56, Anatoli Babenia wrote: > > I think the page should be archived/removed. Mainly because a lot of > the questions people want answers for usually also get in the way of > people wanting privacy. I agree that the page in its current state is not useful, but why do you propose to censor information about how Fedora handles privacy instead of explaining it on a case by case basis? Without statistics people are pretty much limited in synchronizing the view of the world to make a joint action. For example, with qdigidoc stats we could try to get some funding for Fedora development from EU. And also it could be an opt-in feature like https://popcon.debian.org/ I am not saying that the stats are reflecting anything, but with some adjustments they still can be useful. > Currently there is no way to know what > packages are being installed/downloaded the most. yum and dnf > downloads not provide those answers on purpose (it would require more > computational power on the servers than we have and it can't be easily > made anonymous. The data we can get is only basic information like > 'what version of yum/dnf used', 'what arch was asked for', 'what was > the version of Fedora/EPEL wanted' and 'what was the public ip > address'. This loses all kinds of additional information and masks > things like proxies, mock builds, etc which inflate/deflate numbers in > different ways. Just a hypothesis. If HTTPS/SSH and dnf protocol uses fixed size packets and encryption increases the size proportionally, then I can guess the combination of packages being installed based on time of request and request size, so it doesn't help to hide that. Recording IP is a big deal on its own. But for stats it can be replaced with just increasing counter. And you also forgot to mention about virtual machines and containers that also inflate the numbers. I don't believe that right now anybody has the incentive to keep the numbers on usage for `qdigidoc` higher than a real usage, and even if that's the case, the guys from the other side can validate the data according to the number of sessions with unique ID cards from Fedora to their servers. That's the whole point of it - making the first step to go further and pass the ball to the other side. Also from file serving mirrors I'd expect the bottleneck to be in a bandwidth and not processing power. Storing IPs for each can be inefficient, but can we get some statistics about that? I could not find any example mirror at https://nagios.fedoraproject.org/nagios/ > That page is even older than the one you pointed to and should also be > archived/removed. We are probably on Statistics 5.0 > > > I am sorry but there is no way to answer that question. I want to believe, but because you touched my paranoia from the start, is there a dump of client server session with logs to do a proper privacy audit? Now I need to feed the lawyer inside. :D ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Statistics. Stats for installled or downloaded packages
Good Monday. ) I am trying to find package installation/download statistics for Fedora. https://fedoraproject.org/wiki/Statistics is the page that pops up first in search results, and it is kind of 6 years outdated. It would be really great to update it with current situation. I can not do this, because acquiring CLA+1 for wiki edits is too hard and didn't happen even though I sent several requests to different groups. The second reason - I don't know what to write as there seems to be no contact point except this groups. There is also unlinked https://fedoraproject.org/wiki/Statistics_2.0 page with many good stories including mine - `Parse mirror logs: what packages are being the most downloaded?`, but no links or tracker items to see the status and jump in. I found a request to open stats@ list https://pagure.io/fedora-infrastructure/issue/2223 which speaks about https://github.com/fedora-infra/datanommer/ as a new location. There are still no examples of getting package popularity data. I need stats to see how many people are using qdigidoc package to make it more official. ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: Slow Pagure.io
It is the same with pagure itself - https://pagure.io/pagure/issue/3207 DB is missing indexes? Or there is some loop in Pagure that goes slow because of number of issues? How to profile it? ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
