• 1 Post
  • 82 Comments
Joined 10 months ago
cake
Cake day: July 23rd, 2024

help-circle



  • I have a compsci background and I’ve been following language models since the days of the original GPT and BERT. Still, the weird and distinct behavior of LLMs hasn’t really clicked for me until recently when I really thought about what “model” meant, as you described. It’s simulating what a conversation with another person might look like structurally, and it can do so with impressive detail. But there is no depth to it, so logic and fact-checking are completely foreign concepts in this realm.

    When looking at it this way, it also suddenly becomes very clear why people frustratedly telling LLMs things such as “that didn’t work, fix it” is so unproductive and meaningless: what would follow that kind of prompt in a human-to-human conversation? Structurally, an answer that looks very similar! Therefore the LLM will once more produce a structurally similar answer, but there is literally no reason why it would be any more “correct” than the prior output.


  • “Dann haben wir bis zu den Sommerferien gut zwei Monate Zeit, um sehr schnell ein paar Dinge zu beschließen, damit die Menschen spüren, dass sich wirklich etwas ändert.” Als Beispiele nannte Merz einen besseren Grenzschutz und mehr Abschiebungen

    Das kann man sich doch nicht ausdenken. Was soll man denn da bitte schnell “spüren”, außer dass Leute auf einmal verschwunden werden?
    Das einzige, was noch trauriger ist, ist dass tatsächlich die Mehrheit der Leute in diesem Land sowas ohne Sinn und Verstand abfeiern.