Recursive self-improvement through collective intelligence

(pub.sakana.ai)

42 points | by hardmaru 2 hours ago

8 comments

  • throwyonion 47 minutes ago
    Rock smart, but rock make mistake. Caveman must correct all the time. Caveman think: let rock argue with itself. Caveman make ring of rocks. Now rock think self correct. But mammoth not cooked somehow? Most Oddisean moment.
    • bitwize 19 minutes ago
      if grug think complexity demon cause trouble before... shiny-rock grugs say "hold my grug-grog". now programming consist of: summon HUGE complexity demon, trap in magic circle (called "harness"), tell IT to write code. only way to make shiny rock with code in today's economy.
      • adtac 7 minutes ago
        grug realise grug also rely on "harness" for work? grug just call it by other names: coffee, chair, desk, ubuntu, mechanical keyboard, github
  • dpweb 38 minutes ago
    The discovery of some information theoretic limit to model learning (at least using current paradigms) can't come soon enough.
    • optimalsolver 12 minutes ago
      Only Claude (Shannon) can save us now.
  • codethief 59 minutes ago
    Sounds like we're still on track for https://ai-2027.com, for better or for worse.
    • throwawayy6767 33 minutes ago
      Are we reading the same website? The predictions for China are completely fantastical - they are not falling behind and if anything the gap is narrowing, and they aren't stealing the weights because they don't need to (distilling is enough). Also the CDZ stuff is just fanfiction at this point.
      • easterncalculus 12 minutes ago
        No matter what happens, people just blindly claim this nonsense is still accurate. We could have AI halt tomorrow and people on Hacker News would still claim AI 2027 is on track.
        • zamalek 2 minutes ago
          Five years past the flare a bottle drifts with its note AI singularity next year
    • solenoid0937 54 minutes ago
      Probably a bit ahead of it.
    • Aboutplants 40 minutes ago
      Pretty amazingly accurate
  • jsemrau 21 minutes ago
    If Apple's "Intelligence" paper has shown one thing is that never do something in the LLM that can also be done recursive and deterministic.
  • woah 1 hour ago
    This sounds incredibly expensive
    • sva_ 6 minutes ago
      It's just a 27b model finetuned with LoRA?
  • mrkn1 54 minutes ago
    [dead]
  • franzcoughka 50 minutes ago
    [dead]