Thelio Mira AI Linux Workstation: 192 GB GPU Memory

(system76.com)

57 points | by jonifico 4 hours ago

11 comments

  • lxe 2 hours ago
    I thought it was a pricing mistake. But no, you just have to select the variations. $42,412.00
    • adastra22 28 minutes ago
      They missed an opportunity by not adding $8
    • mcbuilder 2 hours ago
      I had to do a double take myself, scrolled down and arrived at a similar number.

      Wish I built this a few years ago!

      • slowmovintarget 32 minutes ago
        Yeah, I bought a Thelio Major three years ago. I'm kicking myself for not going dual-4090s for a mere $10K back then.
      • felixfurtak 2 hours ago
        Me three
    • slowmovintarget 34 minutes ago
      So a new car, or an AI rig.

      That's a bitter pill to swallow. Most of this is the cost of the Nvidia card, and the RAM.

      • cute_boi 27 minutes ago
        SSD too. The priced have tripled...

        It would be great if China had more lithography machine....

        • jaggederest 21 minutes ago
          hoist by our own strategic export controls, rip
  • embedding-shape 2 hours ago
    Seems they might be selling a combo of dual RTX Pro 6000 workstation cards (non-refundable), but the setup they have, unless they change how the GPUs cooling work, isn't gonna work out thermally if you stack two of those workstation cards on top of each other. But it doesn't say WS or "Workstation", so I suppose could be the server variant too? But also doesn't say...

    Hope they have good overall cooling the case, cooling doesn't seem to be mentioned, it'll be a noisy little machine no doubt :)

    • wmf 2 hours ago
      They're [Max-Q] blower cards and there's a big gap between them so the cooling looks fine.
      • embedding-shape 2 hours ago
        So the two variants they offer is the Max-Q and the Server edition one, but only explicitly mentioned for one?

        Edit: The Max-Q is one of the options, what's the other option then?

        • nightski 14 minutes ago
          Seeing as it adds a second PSU, I'm guessing the workstation one.
    • rkagerer 2 hours ago
      Page mentions liquid cooling, for what it's worth.
  • bitbasher 3 hours ago
    It only costs $40,000.
    • mandeepj 2 hours ago
      the landing page showed "$3,299.00" and I had my candy store moment for a few secs.
    • jgalt212 1 hour ago
      5 years ago I could not afford top shelf coders. Now I cannot afford top shelf machines.
  • cherioo 2 hours ago
    This makes Mac Studio with 256GB memory look cheap in comparison. More memory to store weight at a quarter of the price!
    • colordrops 1 hour ago
      It's gonna have WAY faster token rates than that Mac Studio though, enough to be a qualitative rather than quantitative difference.
      • b112 1 hour ago
        Can't it be both?

        EG As I gazed at Janice, joy with equal part contentment washed through my soul.

  • rubyn00bie 14 minutes ago
    Anyone know why they chose a consumer grade CPU on this? I’m a little surprised to see a 9950X as the top option. There’s not enough PCIe lanes available to run everything without bifurcation. I imagine the GPUs probably aren’t too bothered generally… but the NVMe drives are likely to slow down as a result.

    A Threadripper ain’t cheap, but if you’re spending $45k on a workstation it seems like a weird place to skimp. Not to mention you’d then have the option of shoveling a few more 6000 pros in it when you want to run something larger (assuming your home/office electrical box can support it).

  • thom 2 hours ago
    I remember losing sleep when I bought my RTX Pro 6000, but somehow they keep going up in price, and waddya know I’ve even done real work that appreciates the VRAM size.
  • nullbio 2 hours ago
    New car or a Thelio. Tough decision.
    • catchnear4321 1 hour ago
      I bought a spark instead of a motorcycle so it’s somewhat relative and it’s also somewhat relative.
  • rkagerer 3 hours ago
    What motherboard do they use? (Or do they design their own now?)
    • xeeeeeeeeeeenu 2 hours ago
      The ASUS logo is visible in the photo of the innards.
    • embedding-shape 2 hours ago
      I'm guessing it'll depend on the GPU (and CPU) choice, putting the cheapest that is sufficient for the choice.
  • arjie 2 hours ago
    Haha, bloody hell, mate. $17k a pop? I bought these for $8k-ish. That's bonkers to buy this when newer flash models won't fit on this any more. DeepSeek V4 Flash seems the last in its line, and then you have to count on Qwen Next. Seems like a waste honestly.
  • LoganDark 2 hours ago
    Is it more powerful than Apple silicon, or why would anyone buy this? Just for Linux?

    Oh, it's System76, that's why. Open hardware. Makes sense.

    Edit: Also Nvidia

    • wmf 1 hour ago
      It is more powerful than Apple.
      • LoganDark 1 hour ago
        I wonder why Apple has not really pushed their memory bandwidth numbers. They're starting to catch up to 2020 at this point -- cool, but still struggling to run years-old models. (FLOPS is even further behind by a year or two)

        Maybe they're waiting on HBM? Given that they're skipping M6 Max to go straight for M7, I'd assume they're doing a redesign for it.

        • wmf 1 hour ago
          GDDR has higher latency and much lower capacity. HBM requires an interposer and also has lower capacity. It's not an easy choice. The M7 family will probably double memory bandwidth using LPDDR6.
  • senectus1 2 hours ago
    wouldnt you be better off maxing out the new Mac hardware? the memory bandwidth is insane on those jobbies
    • rubyn00bie 0 minutes ago
      There’s roughly 50% more memory bandwidth on an RTX 6000 pro versus the M5 Ultra. I imagine it really comes down to what you’re doing, I know my 5090 runs laps around the M5 Pro I have when it comes to local LLM performance (until it runs out of memory).

      If it wasn’t for the fact the 6000 Pro is selling for like 100% ($9,000) over MSRP it would probably look a lot more reasonable.

    • wmf 2 hours ago
      Two RTX 6000 have more FLOPS and more memory bandwidth than a M5 Ultra (but they also cost more).
    • bigyabai 2 hours ago
      If your goal is pure GPU compute, you should have got a 5090. It can bench comparable to the RTX 6000 Pro cards and is near guaranteed to outperform M5 Ultra.