Advertisement · 728 × 90

Posts by Aryaman Arora

"Mission: Impossible" was featured in Quanta Magazine! Big thank you to @benbenbrubaker.bsky.social for the wonderful article covering our work on impossible languages. Ben was so thoughtful and thorough in all our conversations, and it really shows in his writing!

1 year ago 13 3 0 0
Finding linguistic structure in large language models
Finding linguistic structure in large language models YouTube video by Chris Potts

I've posted the practice run of my LSA keynote. My core claim is that LLMs can be useful tools for doing close linguistic analysis. I illustrate with a detailed case study, drawing on corpus evidence, targeted syntactic evaluations, and causal intervention-based analyses: youtu.be/DBorepHuKDM

1 year ago 74 20 1 3

What are the broad open problems in your view?

1 year ago 0 0 1 0

i am now going to write a massive reply that will have no effect on this score you have given me

1 year ago 12 0 1 0

hmm bluesky feed is 80% reviewing complaints. twitter is slightly better in this regard

1 year ago 27 0 2 0
LANGUAGE AND LINGUISTICS >

I was reading Tim Bodt's new book on Proto-Western Kho-Bwa while waiting for code to run

www.ling.sinica.edu.tw/item/en?act=...

very nice work

1 year ago 6 0 0 0

e.g. Proto-Western Kho-Bwa *n̥a-jʷa-kʰa "chin" (> Khoina Sartang nyjukʰu) seems to be composed of

- PWKB *n̥a- "lower face" < Proto-Sino-Tibetan *s-na ~ s-naːr
- ?PST *g(j/w)ar "cheek, chin, jaw"
- PST *m/s-k(w)a-j "mouth, opening"

very interesting derivational morphology strat

1 year ago 5 0 1 1

it's pretty interesting how (some?) Sino-Tibetan languages, when they historically underwent too much degradation through sound change, just decided to make compounds with synonymous elements or stick semantic prefixes on everything

1 year ago 11 0 1 0
Advertisement

The cat is the mech interp researcher right

1 year ago 1 0 1 0

@avzaagzonunaada.bsky.social

1 year ago 2 0 1 0

added 🫡

1 year ago 1 0 0 0

added 🫡

1 year ago 1 0 0 0

made this thing, reply to be added
go.bsky.app/AKGJ82V

1 year ago 12 1 6 0

sus

1 year ago 1 0 0 0

caleb is so cool pls follow

1 year ago 5 0 1 0
Title: "Characterizing the Role of Similarity in the Property Inferences of Language Models"
Authors: Juan Diego Rodriguez, Aaron Mueller, Kanishka Misra

Left figure: "Given that dogs are daxable, is it true that corgis are daxable?" A language model could answer this either using taxonomic relations, illustrated by a taxonomy dog-corgi, dog-mutt, canine-wolf, etc., or by similarity relations (dogs are more similar to corgis than cats, wolves or shar peis).

Right figure: illustration of the causal model (and an example intervention) for distributed alignment search (DAS), which we used to find a subspace in the network responsible for property inheritance behavior. The bottom nodes are "property", "premise concept (A)" and "conclusion concept (B)" , the middle nodes are "A has property P", "B is a kind of A", and the top node is "B has property P".

Title: "Characterizing the Role of Similarity in the Property Inferences of Language Models" Authors: Juan Diego Rodriguez, Aaron Mueller, Kanishka Misra Left figure: "Given that dogs are daxable, is it true that corgis are daxable?" A language model could answer this either using taxonomic relations, illustrated by a taxonomy dog-corgi, dog-mutt, canine-wolf, etc., or by similarity relations (dogs are more similar to corgis than cats, wolves or shar peis). Right figure: illustration of the causal model (and an example intervention) for distributed alignment search (DAS), which we used to find a subspace in the network responsible for property inheritance behavior. The bottom nodes are "property", "premise concept (A)" and "conclusion concept (B)" , the middle nodes are "A has property P", "B is a kind of A", and the top node is "B has property P".

How do language models organize concepts and their properties? Do they use taxonomies to infer new properties, or infer based on concept similarities? Apparently, both!

🌟 New paper with my fantastic collaborators @amuuueller.bsky.social and @kanishka.bsky.social

1 year ago 108 22 4 6

so true

1 year ago 0 0 0 0
Advertisement

the fact that you are posting here (and not there) has significantly increased my desire to use this platform

1 year ago 4 0 1 1

i do like my username here

1 year ago 6 0 0 0

wow i have so many followers here somehow, is it time to start posting here too

1 year ago 14 0 3 0

I decided what we need to make blueskAI happen is a feed. Reply here to get added to the whitelist! Whitelisted users can post to the feed by adding the following keywords to a post:

🤖
bskAI
blueskAI

2 years ago 43 18 63 2

😮

2 years ago 1 0 0 0

Hey @noviscl.bsky.social should we start shitposting here too

2 years ago 0 0 0 0

lol I think we talked about it the first time I reviewed (SIGMORPHON)

2 years ago 0 0 0 0
Advertisement

There will never be a random Burushaski speaker from Pakistan in my mentions here

2 years ago 8 0 2 0

So Threads got all the AI influencer accounts. This seems to be getting more of the linguists. But I don't think anything will be like Twitter tbh

2 years ago 7 0 1 0

Do I really need to read more than 600 posts a day? The answer is apparently yes

2 years ago 4 0 0 0

South Asian ling twitter check in 🫡

2 years ago 0 0 0 0