• eicker@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    71
    arrow-down
    1
    ·
    3 days ago

    Silicon Valley spent billions building AI tollbooths while Chinese labs made models people can actually download and run. Then Washington restricted chips, and China got better at doing more with less. It’s almost poetic: America tried to corner the future of AI and accidentally made efficiency China’s competitive advantage.

    • Em Adespoton@lemmy.ca
      link
      fedilink
      English
      arrow-up
      52
      ·
      3 days ago

      It’s worse than that even… frontier models now have guardrails restrictive enough that I can’t use them for legitimate work. And the ones that DO work have token prices at exorbitant rates, and chew through them like there’s no tomorrow.

      Meanwhile, I can download Qwen3 and run it on my own hardware, and it’s about as good as the last generation US model without the annoying guardrails.

      Hmm… which model am I going to choose to use?

        • brucethemoose@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          18 hours ago

          LLM weights aren’t code; the engines that run them are completely separate, so they don’t have traditional “backdoors.”

          It’s possible some elaborate prompt trigger was trained into the weights, but there’s never been any evidence of that, for years. I’d say worrying about that is paranoid unless you work at the DoD or something, and some full-weights finetuning would scramble it anyway.

          • brucethemoose@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            18 hours ago

            It’s a mixed bag TBH. The issue is that Qwen 3.8 27B is so good.

            It depends on the quant you are running though, and the way you are running it. If you have 16GB or less VRAM and a generous amount of CPU RAM, and you are running a regular GGUF instead of something exotic, Qwen next is probably better, with the right hybrid inference engine.