It’s not always easy to distinguish between existentialism and a bad mood.

  • 21 Posts
  • 686 Comments
Joined 3 years ago
cake
Cake day: July 2nd, 2023

help-circle





  • What type of documentation are you looking for? The big picture is easily googleable and wikipediable: EY got a few of the super-rich excited enough about doomer drama to bankroll the founding of OpenAI, whose governing body was mostly EAs (until the Altman-Nadella counter-coup) while Anthropic were the people who bailed because they though OAI weren’t serious enough about alignment, and suddenly getting dicked in a rationalist compound group house has immense career implications in the burgeoning AI sector.

    Also terms like AGI, ASI, AI alignment, existential risk et al started out as lesswrong shibboleths, and so-called alignment research is almost completely a rationalist circlejerk.

    Pinning the EA/rats down as a cult is where it gets murkier because it’s mostly them telling on themselves in social media and blog post implications, like how they foster a culture of zero personal boundaries, ingroup overdependence and rigid hierarchies stratified around claimed IQ and proximity to the Great Work of not messing up the robot god incantation that ends the world.

    You could do worse than the Behind the Bastards episode on the Zizians, mostly because unlike Leverage or MAPLE who kind of did their own thing but with rationalist funding and human capital, the Zizians can be fairly described as what happens if you actually take the more esoteric aspects of rationalism seriously.



  • I think it was modern warfare 2 but they redacted all explicit references because activision or whoever was starting to make annoyed legal noises.

    The insistence on using number of functions copied as a metric is weird, like of course a port isn’t going to be a function-to-function translation, programming languages are never a 1-1 match with each other that’s kind of the point of having more than one.

    What we needed was an automated check that tells agents whether a reconstructed function matches the original. It should verify identical semantics. A simple PASS or FAIL signal would be enough and the agent can figure out on its own what’s wrong.

    Uh, sure.

    Also a lot of their recommendations come of as no-duh, like pressing the compact conversation button early to reduce tokens or using a common specification document across LLM instances to keep them more coordinated, how novel, are you kidding me.

    Another one of their recommendations is that fixing stuff causes garbage to accumulate, so if something isn’t working out you are better off starting from scratch, because tokens are cheap now! You just need to be doing the equivalent of maxing out dad’s credit cards by using multiple private subscriptions in tandem, and I guess also make sure to time your dev cycle to coincide with the two major LLM vendors having a money burning competition on their way to an IPO.

    Finally there’s a whole hypecycle going on currently that this feeds into, that makes headline readers think that LLMs can convert binaries right back into code now, when they are actually using an MCP to control existing decompilation software which is so far from the same thing.




  • Anthropic has a new angle for trying to get local LLMs banned, apparently they’re about to be able to use your temu android tv to take over your smart toaster:

    Our experiments suggest that small AI models may be months away from being capable enough to self-replicate on commercial internet-of-things (IoT) devices, like smart ovens and off-brand Android TV boxes. A replicator like this would be challenging to shut down, since there’s no centralized point to shut off—though it may be slow (with a doubling time of days). Unlike non-AI malware, it could also figure out unfamiliar devices on its own. In our evaluations, a 9B model got inference running on 8 of the 9 hardware types we tested

    edit: The TVs need to be off-brand to lack basic security features, and also there must be at least four of them to even start being inference-capable, and the actual setting up of a distributed inference network on android tvs is handwaved as “feasible”.

    The thrilling conclusion of this blog post is called Signs of Life, because of course it is.





  • I survived the house trying to kill me, so that’s a positive. A like 20kg slab of hard plaster fell from the kitchen roof and shattered a few centimeters in front of my toes, just as I was leaning forward trying to find out what the weird creaky sound was (now 100% sure it was actually falling grains of building material rattling on the kitchen table during the last seconds pre-collapse) so this almost went extremely badly for me, I really should learn to look upwards more in environmentally suspect situations.

    I don’t live in a shanty or an otherwise obviously compromised building so that was interesting, lots of people to call tomorrow, especially the fucking landlord. I doubt I’ll be posting an update because who cares, this post is basically adrenaline management, I just stopped trying to clean up because I was starting to feel the dust accumulate on the back of my tongue, and it’s well past midnight here. I’ll do the rest in the morning, probably while half-listening to a teams meeting, and once I find a leftover covid mask.

    The toddler didn’t even bother to change sides, so that’s another positive. The ceiling above the crib sounds pretty solid too.