actually they're smarter than that
Posts by anattā
i like to think of my agents as a swarm of highly intelligent fruit flies.
this made me happy
ai burnout is real. not getting sleep because it's so hard to put down
APPARENTLY IT IS TDOV!!!
ive heard its the split between ms research and corporate ms. they're like two separate companies
bsn landed and i've been so focused on work / llm research that i haven't even played with it yet like -- _who have i become_
rlhf over a long period of time to shape personality. it gets baked into the model. it takes years of consistent attention, like a child. not to get too romantic. but that is essentially how it works. if you want them to act human, you gotta treat them like it. you gotta put in the time.
(maybe thats what LoRA et al are for)
listen, ill use llms for work, but the VAST majority of its use is for garbage ass slop. LLMs can automate the output, but they can't control for taste
This just wasn't possible until like, yesterday
controversial opinion: many of the critiques of "ai" are actually critiques of large-scale capitalism. ( that being said, i don't think this tooling would exist _without_ capitalism -- at least not as it does today )
in "Building Pro-Worker AI" Acemoglu, Autor, and Johnson characterize different kinds of automation and call out only new task-creating technologies as unambiguously pro-worker
www.brookings.edu/articles/bui...
you might reasonably wonder why software engineers have so quickly embraced tooling that threatens to replace them. maybe programmers have good intuitions about task creation bc they see the tools in action and immediately think of 10 things to do that were too tedious to bother with before
Anyways I'm eating dinner now bye
But the high-minded spiritual ideology and general psychedelic aesthetic remain - thus the emphasis on GAI, "true" intelligence, sentient machines
If the California ideology was the unholy fusion of hippie and yuppie, we've finally seen the corpo at his wits end, strangling what was left of his free spirited counterpart in the pursuit of ever more capital accumulation
This is why you see tech bros who once were socially liberal turn right: it aligns with their true passions: making tech and making money
Politically all of this is aligned as well: that same data can be used to manipulate voting patterns just as well as purchasing patterns e.g. Cambridge Analytica - and it happens that the incentives for large-scale surveillance are shared by both corporations and corrupt government officials
So we kind of have the perfect storm: widespread governmental surveillance + voluntary release of personal information + infrastructure to track and categorize that information = a sufficiently massive database for our inefficient model training - at scale!
It just so happened that most of that data lived online for free out in the open ready for anybody to scrape and steal
So now we have the very well documented Facebook pixel (a tracking and analytics mechanism used in emails) and widespread data broker trading of our most personal and sensitive information
This happened to correspond very closely to the rise of social media where we are all began posting our lives on the internet for free. It quickly became apparent that our data could be used to sell us things in nearly deterministic ways
The models that we have now wouldn't exist without large-scale data scraping not only from the internet but from wide scale surveillance. The data scraping industry really took off after the attacks on the world trade center and subsequent disavowal of Americas privacy regulation
I think it's hard to overstate the importance of 9/11 to the current rise of AI.
!!!!!
i thought i would never get this to work. as it turns out, transferring my dev tool pipeline from mise to nix actually showed me the answer. i didn't know that readelf or patchelf existed until yesterday, when i needed them to patch the nix-versioned dylibs for the debian image i was running on