This is an MoE model with 1.6T-A49B

The weights were up briefly then taken down due to some issues in the repo files apparently, now they’re back up:

GGUFs are out as well:

DeepSeek published benchmarks for reference:

    • SirDimples@programming.devOP
      link
      fedilink
      English
      arrow-up
      6
      ·
      23 days ago

      free to use if you have the hardware. For this model because of its size, the main problem is the hardware availability/cost. But in general there are 3 ways to run an open weights model:

      • pay a provider like DeepSeek/OpenRouter per usage
      • buy hardware that can run it locally: actually not a bad investment for a business
      • rent hardware that can run it from a cloud provider, hardware can be rented dedicated or time-shared (so called serverless).
      • Jo Miran@lemmy.ml
        link
        fedilink
        English
        arrow-up
        1
        ·
        23 days ago

        Is there some sort of calculator to help one determine the best model to run?