Advertisement Β· 728 Γ— 90

Posts by Arjun Subramonian (they_them)

2025 Workshop on Evaluating AI in Practice EvalEval, UK AI Security Institute (AISI), and UC San Diego (UCSD) are excited to announce the upcoming Evaluating AI in Practice workshop, happening on December 8, 2025, in San Diego, California.

3. I will be on a EvalEval panel about sociotechnical perspectives & implications for AI evaluations on 12/8 from 11:00 am - 12:15 pm: evalevalai.com/events/works....

4 months ago 2 0 0 0
OpenReview Promoting openness in scientific communication and the peer-review process

2. My research mentee from UCLA Margaret Capetz will present her work on the fairness of MLPs distilled from GNNs at the Reliable ML workshop on 12/6 from 1:30 pm-2:15 pm: openreview.net/forum?id=6LP....

...

4 months ago 0 0 1 0
Challenges to Grassroot Organization Engagement with AI Policy Around the world, policies are being developed to address privacy, economic, intellectual property, energy, and other risks that AI technologies pose. Simultaneously, institutions are creating...

1. @jennmickel.bsky.social and I will present @queerinai.com's AI policy work at the Algorithmic Collective Action workshop on 12/6 from 10:20 am-12:15 pm: openreview.net/forum?id=XvK....

...

4 months ago 1 0 1 0

I'll be in San Diego for #NeurIPS2025 and EvalEval 12/6-12/8! Let me know if you're around 😊

I unfortunately will not be around for the @queerinai.com workshop and social this year but I will be at the following workshops:

🧡

4 months ago 3 1 1 0

Please respond to this survey if you have changed or have thought about changing your name in academic publishing! For any reason, whether it be transition, recognizability, marriage, privacy, immigration, cultural reasons, etc.

Please RT for reach :)

5 months ago 6 4 0 0

Please take 5-10 minutes to fill out this survey!

5 months ago 1 1 0 0

CW: misgendering

If you're at COLM next week, come say hi to me and @dippedrusk.com at Poster Session 3 on Wednesday morning (Poster #41)! Chat with us about probability-based vs. generation-based LLM evaluations, LLM misgendering, and @queerinai.com 😊

6 months ago 7 0 0 0

Accepted to #COLM2025! See you in MTL :)

8 months ago 6 0 0 0
Preview
Agree to Disagree? A Meta-Evaluation of LLM Misgendering Numerous methods have been proposed to measure LLM misgendering, including probability-based evaluations (e.g., automatically with templatic sentences) and generation-based evaluations (e.g., with aut...

Have you or a loved one been misgendered by an LLM? How can we evaluate LLMs for misgendering? Do different evaluation methods give consistent results?
Check out our preprint led by the newly minted Dr. @arjunsubgraph.bsky.social, and with Preethi Seshadri, Dietrich Klakow, Kai-Wei Chang, Yizhou Sun

10 months ago 15 4 1 3
Advertisement

Announcing our first workshop keynote!

"Processing Trans Languaging" by Vagrant Gautam @dippedrusk.com at 13:30 - 14:30 MDT on May 4, 2025

Read on for a description of the talk! 🧡

11 months ago 26 7 1 1
Birds of paradise in the sand on a beach. Tide, sunset, and mountains visible.

Birds of paradise in the sand on a beach. Tide, sunset, and mountains visible.

Corollary to cow on a beach

1 year ago 2 0 0 0

Went down a huge rabbit hole last night about how the land on which SF was built was primarily covered in massive shifting sand dunes

1 year ago 2 0 0 0

felt

1 year ago 1 0 0 0
Post image

I can't advise joining an extra Slack workspace, but you should join the AI 4 Conservation Slack if you're not in it already :) at the very least to get images like the one below

credit: github.com/google/camer...

1 year ago 1 0 0 0
Culture is not trivia: sociocultural theory for cultural NLP. By Naitian Zhou and David Bamman from the Berkeley School of Information and Isaac L. Bleaman from Berkeley Linguistics.

Culture is not trivia: sociocultural theory for cultural NLP. By Naitian Zhou and David Bamman from the Berkeley School of Information and Isaac L. Bleaman from Berkeley Linguistics.

There's been a lot of work on "culture" in NLP, but not much agreement on what it is.

A position paper by me, @dbamman.bsky.social, and @ibleaman.bsky.social on cultural NLP: what we want, what we have, and how sociocultural linguistics can clarify things.

Website: naitian.org/culture-not-...

1/n

1 year ago 122 35 5 4

We are still looking for annotators! Please consider helping us out, either via filling out the form or sharing it more broadly πŸ’œ Of course, selected annotators are financially compensated.

1 year ago 2 3 0 0
Advertisement
View of Golden Gate Bridge from Baker Beach. Cloudy weather, ocean foam, and wet sand are visible.

View of Golden Gate Bridge from Baker Beach. Cloudy weather, ocean foam, and wet sand are visible.

A walk through the Presidio fixes me more than I would like to admit

1 year ago 9 0 0 0
Preview
Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLP Vagrant Gautam, Arjun Subramonian, Anne Lauscher, Os Keyes. Proceedings of the 5th Workshop on Gender Bias in Natural Language Processing (GeBNLP). 2024.

Very cool work, and a much-needed follow-up to the OpenAI names study! Would also like to share this work with @dippedrusk.com about the use of personal names in NLP: aclanthology.org/2024.gebnlp-... :)

1 year ago 3 0 1 0
Preview
This day in US xenophobia Today, Feb 19, 2025, is a day to see the sheer inhumanity of US anti-immigrant xenophobia at fever pitch. But today is also the 102 year ann...

Today in xenophobia history: 102 years ago today, all Indian American naturalized US citizens were stripped of their citizenship and property. verylowfrequency.blogspot.com/2025/02/this...

1 year ago 1 1 0 0
Decorative graphic for call for contributions. Graphic reads: "We're seeking research papers, extended abstracts, position papers, opinion pieces, surveys, or media pieces for Queer in AI Workshop at NAACL 2025! Topic of Intrest: Queer Issues in NLP and Linguistics"

Decorative graphic for call for contributions. Graphic reads: "We're seeking research papers, extended abstracts, position papers, opinion pieces, surveys, or media pieces for Queer in AI Workshop at NAACL 2025! Topic of Intrest: Queer Issues in NLP and Linguistics"

🚨 FINAL REMINDER 🚨

Whether you're exploring queer linguistics/NLP or queer activism/D&I, the Queer in AI workshop at #NAACL2025 is the place to be!

πŸ“… Submission Deadline: *Feb 20, 2025 AoE*

Let’s make #NAACL2025 the queerest one yet!
All details πŸ‘‰ queerinai.com/naacl-2025

#QueerInAI #NLProc

1 year ago 10 5 1 1

Friendly reminder that all submissions are due Feb 20! Get your submissions in :)

We do have a non-archival track! So do not hesitate to send in your work that is in submission/accepted elsewhere if you are looking for a wonderful group of folks to present your work to

www.queerinai.com/naacl-2025

1 year ago 5 2 0 0
Preview
Oakland dance group performs in halftime show with Kendrick Lamar A dance group from Oakland performed in the half-time show with Kendrick Lamar.

Incredible! πŸ’ƒπŸΎπŸ”₯ I was so inspired by Oakland’s own TurfFeinz shining on the Super Bowl stage with Kendrick Lamar!

Proud to see our city’s talent on full display. Keep dancing, keep thriving! πŸ™ŒπŸΎβœ¨ #SuperBowlLIX #TurfFeinz

πŸ”— ktvu.com/news/oakland-dance-group-performs-halftime-show-kendrick-lamar

1 year ago 7 2 0 0

my reaction exactly 😭

1 year ago 0 0 0 0

Our workshop has been extended till Feb 20. We are looking forward for your papers at NAACL's Queer in AI workshop.

1 year ago 17 18 0 1

The archival deadline has been extended to Feb 20! All submissions are now due on Feb 20. Get your work in soon πŸ’œ

1 year ago 4 2 0 0
Advertisement
Beach and tree atop a bluff, clear sky

Beach and tree atop a bluff, clear sky

View of rocks descending into ocean from atop bluff, sunset visible to the side

View of rocks descending into ocean from atop bluff, sunset visible to the side

So UCSB offers free Overleaf and this ??

1 year ago 18 0 1 1
Preview
NAACL 2025 Queer in AI Call for reviewers We are looking for reviewers to review the upcoming submissions to Queer in AI workshop. Each person will get around 1-2 papers to review. Review starts: February 10 Review ends: March 1 Topics wil...

We are looking for reviewers for our Queer in AI NAACL workshop. The reviewing workload is low (1-2 papers) and you will be given ample time to review.

If you are new to reviewing, you are highly encouraged to sign up as a reviewer!

Sign up here: docs.google.com/forms/d/e/1F...

1 year ago 10 5 0 0

Friendly reminder, the archival deadline is Jan 30 πŸ’œ

1 year ago 2 0 0 0

TIL that half of the UCs provide their students with free Overleaf premium, and I am not in that half

1 year ago 9 0 0 0
View of Pacific Ocean and rolling hills from ridge of Santa Cruz mountains

View of Pacific Ocean and rolling hills from ridge of Santa Cruz mountains

Never an unpretty day at Russian Ridge

1 year ago 5 0 0 0