BEGIN:VCALENDAR METHOD:REQUEST PRODID:Microsoft Exchange Server 2010 VERSION:2.0 BEGIN:VTIMEZONE TZID:GMT Standard Time BEGIN:STANDARD DTSTART:16010101T020000 TZOFFSETFROM:+0100 TZOFFSETTO:+0000 RRULE:FREQ=YEARLY;INTERVAL=1;BYDAY=-1SU;BYMONTH=10 END:STANDARD BEGIN:DAYLIGHT DTSTART:16010101T010000 TZOFFSETFROM:+0000 TZOFFSETTO:+0100 RRULE:FREQ=YEARLY;INTERVAL=1;BYDAY=-1SU;BYMONTH=3 END:DAYLIGHT END:VTIMEZONE BEGIN:VEVENT ORGANIZER;CN=Daniele Quercia:mailto:[email protected] ATTENDEE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TRUE;CN=smartdater [email protected]:mailto:[email protected] ATTENDEE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TRUE;CN=members@sm artdata.polito.it:mailto:[email protected] ATTENDEE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TRUE;CN=MINDS:mail to:[email protected] ATTENDEE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TRUE;CN=HCI:mailto :[email protected] ATTENDEE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TRUE;CN=nexa@serve r-nexa.polito.it:mailto:[email protected] DESCRIPTION;LANGUAGE=en-US:The Parity Benchmark: A Multimodal Framework for Assessing Bias in LLMs\nShmona Simpson\, CEO and Founder of Paritii<https ://www.paritii.com/>\n\n Join the meeting <https://teams.microsoft.com/l/m eetup-join/19%3ameeting_ZTQ5NWI2MjktY2UyMy00M2MxLTgyNDQtNTBmYTAyNGMzNzQ1%4 0thread.v2/0?context=%7b%22Tid%22%3a%225d471751-9675-428d-917b-70f44f9630b 0%22%2c%22Oid%22%3a%221e405340-2229-4554-b37f-b193c118d70e%22%7d>\n\nAbstr act: Large Language Models (LLMs) demonstrate impressive capabilities but remain susceptible to harmful biases that can reinforce inequity across do mains like content moderation\, healthcare\, and decision-making. The Pari ty Benchmark offers a rigorous\, multimodal framework to evaluate such bia ses across protected characteristics including gender\, race\, socioeconom ic status\, and intersectional identities. Using an expert-curated datase t\, the benchmark assesses leading LLMs such as Granite 3.8 against GPT-4o \, Claude 3.5 Sonnet\, Llama 3\, DeepSeekR-1\, and Gemini. The data will show which LLM’s perform best across categories such as ageism\, suprema cism\, colorism\, homophobia\, disability and neurodivergence. Future iter ations of the benchmark will expand to include image-based evaluations\, o pen-ended free-text prompts\, and integrated multimodal analytics—provid ing a richer\, real-world assessment of AI fairness. Initial results show that models excel differently across tasks\, suggesting opportunities for targeted bias mitigation. The Parity Benchmark aims to serve as a practica l\, evolving tool for researchers\, developers\, and policymakers committe d to building more equitable and accountable AI systems.\n\n<https://arxiv .org/abs/2407.02191>Bio: Dr. Shmona Simpson is the visionary CEO and Foun der of Paritii<https://www.paritii.com/>\, a pioneering platformdedicated to advancing equity in technology through data-driven frameworks and innov ation. A recognized leader in AI ethics and technology strategy\, Shmona s pecializes in developing solutions that promote fairness\, accountability\ , and transparency within AI systems.\nHer recent development of The Parit y Benchmark<https://link.springer.com/article/10.1007/s43681-024-00613-4>\ , published by Springer in 2025\, underscores her commitment to Responsibl e AI. This groundbreaking framework provides a robust\, data-informed app roach to evaluating and enhancing fairness within machine learning systems . By identifying and mitigating biases\, The Parity Benchmark equips resea rchers\, developers\, and organizations with actionable insights to create competitive\, responsible AI technologies.\nUnder Shmona’s leadership\, Paritii has emerged as a trusted resource for organizations aiming to bui ld ethical AI systems that serve broad communities. Her expertise in AI et hics and strategic innovation continues to shape critical conversations ab out how technology can be harnessed to promote equity and accountability. Swyft\, Paritii's flagship AI solution for broad access higher education institutions\, streamlines academic operations with intelligent automation . Swyft handles high-volume administrative tasks like registration\, finan cial aid workflows\, and compliance tracking—freeing up staff time and i mproving the student experience at scale. Swyft is available at institutio ns across the country<http://www.tryswyft.com/>.\nAn influential voice in the tech industry\, Shmona is a sought-after advisor and speaker on AI eth ics\, fairness frameworks\, and the broader implications of responsible te chnology development. She has been invited to share her perspective at SXS W\, ASU-GSV\, MITRE\, IBM\, and Anita B.org. Before founding Paritii\, sh e served as a Strategist at the Bill & Melinda Gates Foundation\, where sh e strengthened health systems across diverse regions and led cross-functio nal initiatives to improve organizational impact. Shmona holds a DPhil fro m Oxford University\, where she was a Rhodes Scholar.\n\nSubscribe to futu re talk announcements: Anyone outside Bell Labs can receive talk announcem ents by subscribing to the mailing list. To subscribe\, send an empty emai l with the subject line "Subscribe RAI" to daniele.quercia@nokia-bell-labs .com<mailto:[email protected]>.\n\n\n UID:040000008200E00074C5B7101A82E008000000003E18F43FFCFADB01000000000000000 01000000095DF905180184D4095A11128D5A10EBA SUMMARY;LANGUAGE=en-US:[Responsible AI Talk] The Parity Benchmark\, Shmona Simpson\, CEO and Founder of Paritii DTSTART;TZID=GMT Standard Time:20250728T153000 DTEND;TZID=GMT Standard Time:20250728T163000 CLASS:PUBLIC PRIORITY:5 DTSTAMP:20250722T113414Z TRANSP:OPAQUE STATUS:CONFIRMED SEQUENCE:0 X-MICROSOFT-CDO-APPT-SEQUENCE:0 X-MICROSOFT-CDO-OWNERAPPTID:2123871550 X-MICROSOFT-CDO-BUSYSTATUS:TENTATIVE X-MICROSOFT-CDO-INTENDEDSTATUS:BUSY X-MICROSOFT-CDO-ALLDAYEVENT:FALSE X-MICROSOFT-CDO-IMPORTANCE:1 X-MICROSOFT-CDO-INSTTYPE:0 X-MICROSOFT-DONOTFORWARDMEETING:FALSE X-MICROSOFT-DISALLOW-COUNTER:FALSE X-MICROSOFT-REQUESTEDATTENDANCEMODE:DEFAULT X-MICROSOFT-ISRESPONSEREQUESTED:TRUE BEGIN:VALARM DESCRIPTION:REMINDER TRIGGER;RELATED=START:-PT15M ACTION:DISPLAY END:VALARM END:VEVENT END:VCALENDAR
