[Wikimedia-l] Re: Attribution of specific Wikipedia articles as sources of a LLM's output (Was: Bing-ChatGPT)
Hi Lauren, Thanks for attending the Future Audiences community call this week, and apologies that we ran out of time before I was able to answer your question about the ChatGPT plugin next steps – answering now :) You wrote: “As for the Foundation’s ChatGPT plugin, I’m afraid I find it mostly unusable because it ignores everything after the first dozen paragraphs of all articles. That was listed as needing 3-4 days to fix on https://phabricator.wikimedia.org/T343932 a month ago. Do you know whether there are any plans to go ahead with that fix?” First: thank you for enabling the plugin and trying it out! We've just added a link to a survey that we're hoping will give us more feedback on whether/how the current plugin is meeting user needs. If you haven't already done so, I'd appreciate if you could take a few minutes to fill it out (you should see it in the footer of the plugin response). On your specific point about the 12-paragraph cutoff: yes, we recognize that this may lead to the plugin not finding relevant information in some cases (though from our qualitative coding of about 300 query responses in 6 languages, the plugin was able to return relevant information about 84% of the time[1]). However, as I tried to stress in my blog post,[2] this plugin is intended to be a quick experiment and not a fully-featured, permanently maintained product. We're tracking many possible optimizations, such as changes to the 12-paragraph cutoff, showing references, improving output quality, etc. But in order to go deep on optimization, we first need to get compelling evidence that we *should* invest in a product like this, on an external platform that we don't manage, longterm – because making that investment would require getting more resources (i.e., an actual feature development team, not just part-time R), which would be a nontrivial change to our annual plan. As the WMF staffer who would be making the case for that investment internally and to the community: I think while there are definitely more things we can use the plugin to learn, and it's always possible that usage of ChatGPT and the plugin may take off wildly, I don't personally feel comfortable making that recommendation at this moment. (All that said, we may be able to get some more ad hoc R resources to make some optimization tweaks as we try to learn more – that's what I'm currently aiming for, so stay tuned!) Please let me know if you have more questions or want to talk about plugin specifics, on-list, via email, or onwiki (the project is on Meta here: https://meta.wikimedia.org/wiki/Talk:Future_Audiences)! Best, Maryana 1. https://meta.wikimedia.org/wiki/Future_Audiences/Experiments:_conversational/generative_AI#Preliminary_results 2. https://diff.wikimedia.org/2023/07/13/exploring-paths-for-the-future-of-free-knowledge-new-wikipedia-chatgpt-plugin-leveraging-rich-media-social-apps-and-other-experiments/ ___ Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/message/IPOVMFNRDSARHDFWWZJQWLIQ3FRU6CNW/ To unsubscribe send an email to wikimedia-l-le...@lists.wikimedia.org
Re: [Wikimedia-l] The reader, who doesn't exist
On Thu, Aug 21, 2014 at 6:29 AM, John Mark Vandenberg jay...@gmail.com wrote: *But*, that only works on the normal website. On the mobile website, I cant figure out how to disable the Media Viewer. To check I wasnt missing something, I asked someone at the Wikimedia Indonesia office (https://en.wikipedia.org/wiki/Special:CentralAuth/Beeyan) to try to disable it on his phone, and he couldnt work it out either. Go to: https://en.m.wikipedia.org/wiki/Horse_Protection_Act_of_1970 Scroll down to the Tennessee Walking Horse photo and click on it. As far as I can see it has downloaded the 200+KB photo, and I may either close the MediaViewer or go to the page on Commons. There are no other options. We can't figure out how to disable this. Even after logging in on the mobile site, there is no preference to disable it in the Settings. If you click the Details button to return to go to Commons, only a 70KB photo is shown, which is what used to occur. Hi all, A few points of clarification on MediaViewer and mobile. The Mobile Web team built a custom image-viewing experience for users accessing Wikimedia projects on phones and tablets; we're not actually using desktop MediaViewer. The mobile implementation loads a size of the image adapted for the viewport (which may be larger than the screen size due to retina support). It does not load the full-size image unless that image is very small. Users accessing the mobile site via Wikipedia Zero or from lower-end no-JS phones/browsers go straight to the file page. Performance and bandwidth are definitely things we think about a lot. The Zero team is currently experimenting with different thumbnail compression ratios for mobile users who access the site via Wikipedia Zero carriers, in order to keep bandwidth impact minimal. Based on the outcome, we're considering using extra compression in the mobile media viewing experience for all users, though we'll need to study the caching implications, because it could potentially make performance worse but bandwidth better. Making sure the default experience works well for both high-end and low-end device users is a much higher priority on mobile than creating layers of opt-in/out preferences, because people use mobile differently from laptops/computers and complex preference screens are difficult to navigate on a smaller device. We do already have a preference to turn images off entirely on the mobile site for users who want to save bandwidth; adding more granular options to this is not something we're considering at this time, though it's entirely possible that we may revisit this in the future. -- Maryana Pinchuk Product Manager, Wikimedia Foundation wikimediafoundation.org ___ Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Android Nearby Feature (was: Re: Community RfCs about MediaViewer)
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe -- Maryana Pinchuk Product Manager, Wikimedia Foundation wikimediafoundation.org ___ Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Wikimedia Ukraine -- is everyone safe?
terrible to witness the events that are happening there now. My thoughts are with Wikimedia Ukraine, which I know has at least a few members living in the city of Kiev, and with other Wikimedia contributors living in that city, as well as in the rest of Ukraine. Please let us know if everyone is safe, and if there is any way we can help you. Stay safe! Залишайтеся в безпеці! Tomasz ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe -- Maryana Pinchuk Product Manager, Wikimedia Foundation wikimediafoundation.org ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Let's report and learn from non-successes (more often)
On Wed, Jul 3, 2013 at 5:05 PM, Asaf Bartov abar...@wikimedia.org wrote: Dear colleagues, I wanted to remind us all of the importance of learning from when our plans and efforts don't succeed, whether due to mistakes or just an experimental hypothesis turning out to not be the case. We at the Wikimedia Foundation have had such an experiment a few months ago, and an idea we thought had potential turned out to have none of the hoped-for impact. We wrote it up and drew some (I think) interesting learning points from it, including possibly next steps for those who may want to experiment along similar lines. The learning is featured in a Wikimedia Blog post here: http://blog.wikimedia.org/2013/07/02/english-wikipedia-editor-pilot-philippines/ which also links to the full report on Meta. I am also pleased at the discussion the blog post has already generated. Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe Yes! Big plus-one! Though I would refer to it as confirming the null hypothesis[1] rather than non-success :) Publication bias[2] and systematic underreporting of non-significant effects are huge problems in all scholarly fields, so it's not like we're unusual in this respect. But we miss out on really great opportunities to advance our institutional learning when we bury our non-successes.. err.. null hypothesis confirmations! Keep em' coming, folks. 1. https://en.wikipedia.org/wiki/Null_hypothesis 2. https://en.wikipedia.org/wiki/Publication_bias -- Maryana Pinchuk Associate Product Manager, Wikimedia Foundation wikimediafoundation.org ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
[Wikimedia-l] Reminder: IRC office hours with the Wikimedia mobile team
Just a reminder that this is happening in approximately 20 minutes. More details here: https://meta.wikimedia.org/wiki/IRC_office_hours#Upcoming_office_hours Hope to see you in #wikimedia-office! -- Maryana Pinchuk Associate Product Manager, Wikimedia Foundation wikimediafoundation.org ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l
Re: [Wikimedia-l] Wikimedia Foundation Report, May 2012
participants' talk pages through The Tea Leaf newsletter, including links to https://en.wikipedia.org/wiki/Wikipedia:Teahouse/Host_lounge/Metrics; and https://en.wikipedia.org/wiki/Wikipedia:Teahouse/Pilot_report;. I also appreciated reading about the progress of India communications and community support. I would like to hear more about what the projected effects of these initiatives will be on the editor statistics in the global report cards, have the projections compared to actuals, and get updates on these projections and actuals each month. The amount of staff and financial resources that are invested in editor engagement (including development of the visual editor), and the importance of the outcomes of those efforts for the movement and Wikimedia Strategic Plan priorities, are of significant interest to me and I imagine to many other members of the global Wikimedia community. Thank you, Pine ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l -- Maryana Pinchuk Community Organizer, Wikimedia Foundation wikimediafoundation.org ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l
Re: [Wikimedia-l] Only IP editing allowed on Wikipedia
On Mon, Apr 30, 2012 at 1:33 AM, WereSpielChequers werespielchequ...@gmail.com wrote: Hi can anyone point me to a write up of the the test plan for this morning's experiment on Wikipedia? Having been logged off about ten times I've worked out that you get logged out the first two times you change page. It will be interesting to see how many editors revert to IP editing. WSC Erm, not any experiment I know of! I believe it's a server issue, but I'll wait for ops to chime in. Maryana I haven't been logged out, but very few of my edits are saving first time -- I keep getting the session expired message, even when I've only been on the page for a minute or so. And editing has been painfully slow. Lots of discussion about it at the PUMP -- http://en.wikipedia.org/w/index.php?title=Wikipedia:Village_pump_%28technical%29oldid=489919998#Loss_of_session_data_and_slowness_issues It seems to have started for some people on April 10th. I've been noticing the slow speed for a couple of days, and since yesterday the difficulty saving. Sarah ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l -- Maryana Pinchuk Community Organizer, Wikimedia Foundation wikimediafoundation.org ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l
