Man undrar ju ibland hur folk väljer sina jobb.
Posts by Anders Sandberg
As an internationalist I am happily cheering on from my airport.
Intressant att FoF lyfter sorgen.
Men om kryonik förändrar hur vi sörjer, förändrar den också när ett liv anses avslutat.
Det får konsekvenser långt bortom individen.
Don't be shy to take on a little two-week side project. These five months will be the most precious three years of your academic journey.
Toman clearly does not understand infinity, or was just being rhetorical.
(Decision theory with infinities is possible, but most people are not really doing lexical priority setting in a stringent way.)
People like to blame AI, but it is the imitative nature of human culture that is the real culprit.
This is very much like the word "dord". This kind of term emergence has a long history. And when it gets discussed in articles and online it gets more persistent. Before you know, Tlön, Uqbar, Orbis Tertius. en.wikipedia.org/wiki/Dord
Att det faktiskt är svårt att förutse framtiden är en sak, men ett djupare problem är att de vuxnas förmåga att påverka beslutsprocessen på senare tid visat sig svag i många nyckeljurisdiktioner.
Constellation AI Fellowship - Fully funded 5-month, in-person fellowship at Constellation's Berkeley research center for researchers & professionals focused on AI safety and governance
constellation.org/programs/astra
Yes, that is one big reason I find such talk annoying (the other is of course the common correlation with misogyny).
Honestly, the bad ethology grates so bad. It is like somebody took some myrmecology course and began giving dating advice ("As a major, you should...")
I just found out that it is World Quantum Day. The real question is whether this has always been this day or whether *now* it has always been this day.
(I wonder if this will make me tolerate alpha male talk more in the future... I doubt it, but I will have a hard time not smiling when I hear it now.)
Shower thought: people who go on about being alpha males are latent furries.
Full proposals are now open for our Massively Scalable Neurotechnologies programme.
Led by Jacques Carolan, we are investing £50m to develop a new class of neurotech – interfaces that reach the brain via the body’s natural pathways.
Submit by 11 May: link.aria.org.uk/MSNx
Cool with independent eval. I wonder about the curve shape: looks not quite exponential in tokens (which would imply a linear progress in takeover per token), maybe some power curve?
I think one can make a differential technology development argument here: speeding up the arrival of outcome-mitigating technology or policy so they come earlier, or slowing down the GPT arrival, are both valid levers. But the former is often an easier thing to do than the latter.
General Purpose Technologies have downstream effects everywhere, good and bad. Those outcomes can be mitigated, or encouraged, with the right sorts of policy choices If the only options are being for or against a GPT, you end up having very few levers to pull to make it work out.
Kör med en minimal approach: satsa på saker med kända bra effektstorlekar (motion, mat, fiber, metformin eller kanske glucophage). Börjar snart bli dags för senolytics och rapamycin. De experter jag känner verkar inte heller köra femtielva supplement.
Oh yes! So good.
Det smart att ha god hälsa och sakta ned åldrande oavsett kryonik och livsförlängningsframsteg: det har ju ett praktiskt värde för livskvaliteten. Lite osäker på just Johnsons modell, som ju lite är att kasta alla metoder mot väggen för att hoppas att någon fastnar... viss risk för interaktioner.
Running an entire neolithic to space sim would require compressing 10,000 years to something manageable (a million times speedup would give results in a few days) But even an experiment taking a year would be valuable. Plus, running a 100 years of industrial revolution is 100 times faster!
I think this is something that can be extended in so many different ways, with different ways of seeing the same underlying structures.
...and then the doubts start. Are these really all the prerequisites? What about inspiring other things? What techs have been left out? What even is a technology?!
Formally we can use Legg and Hutter's definition arxiv.org/abs/0712.3329 and if the value function is bounded (which @davidmanheim.alter.org.il and me have argued must be the case: www.lesswrong.com/posts/Bc77uw... ) then there is an upper limit. Hutter's AIXI reaches it.
Seems that lowering tariffs should be an effective altruism cause area. (Really wins on scale, but tractability is what it is.)
www.cambridge.org/core/journal...
Some equations that will make you cry, from Season 9 of Bones. Thanks to @harthanson.bsky.social (who wrote it) for the reminder. Brought to live by Emily Deschanel and Richard Schiff. I helped with the equations.
www.youtube.com/watch?v=kQsI...
Because you mostly simulate minds, not their environment. Sim-Anders' virtual sofa and houseplants are simplified compared to his mind. We could do the calc with environment models too, but my coffee has run out...
I still expect trade with aliens in cultural artefacts and services that have different value to different kinds of beings.
It could be that the recalcitrance (effort per unit of progress) grows a lot for finding key capacities, and the search space may be less modular than we would wish. Even with superintelligence-as-a-service the returns may slow.