Local LLaMA Server Setup Documentation

github.com

Local LLaMA Server Setup Documentation

github.com

zhenbo_endle@lemmy.caM to TIL about Computer Science@lemmy.ca · 1 year ago

GitHub - varunvasudeva1/llm-server-docs: Documentation on setting up a local LLM server on Debian from scratch, using Ollama/llama.cpp/vLLM, Open WebUI, Kokoro FastAPI, and ComfyUI.

github.com

Documentation on setting up a local LLM server on Debian from scratch, using Ollama/llama.cpp/vLLM, Open WebUI, Kokoro FastAPI, and ComfyUI. - varunvasudeva1/llm-server-docs

You must log in or # to comment.

Chat

TIL about Computer Science@lemmy.ca

til_about_computer_science@lemmy.ca

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !til_about_computer_science@lemmy.ca

A place to share everything you like about Computer Science. Feel free to consider here as a public “Read it Later” service.

Rules:

Any posting, commenting and voting means you’d like to follow these rules:

You follow the rules of lemmy.ca.
Only post things you like.
No piracy and respect paywalls.
Share the original link when possible.
Upload images only if necessary. Proper alt text is a must.
Self-promotion for your own blog/project is allowed, but please be honest.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
1 user / 6 months
1 local subscriber
76 subscribers
5 Posts
1 Comment
Modlog

mods:
zhenbo_endle@lemmy.ca