r/selfhosted • • Apr 07 '26

Official Quarter 2 Update - Revisiting Rules. Again.

388 Upvotes

April Post - 2nd Quarter Intro

Welcome to Quarter 2 2026! The moderators are here and grateful for everyone's participation and feedback.

Let's get right into it.

Previous Rules Changes

After review of many of the responsive, constructive, and thoughtful comments and mod mails regarding the most recent rules change, it's clear that we missed the mark on this one. AI is taking the world by storm, and applying such a universally "uninvolved" perspective, showcased by the rules we last implemented, is inconsistent with the subreddit's long-term goals.

Here are the next steps we want to implement to wrangle the shotgun of AI-created tools and software we've been flooded with since AI chatbots became prevalent:

New Project Megathread

A new megathread will be introduced each Friday.

This megathread will feature New Projects. Each Friday, the thread will replace itself, keeping the page fresh and easy to navigate. Notably, those who wish to share their new projects may make a top-level comment in this megathread any day of the week, but they must utilize this post.

AI-Compliance Auto Comment

The bot we implement will also feature a new mode in which most new posts will be automatically removed and a comment added. The OP will be required to reply to the bot stating how AI is involved, even if AI is not actively involved in the post. Upon responding to the bot, the post will be automatically approved.

AI Flairs

While moderating this has proven to be difficult, it is clear that AI-related flairs are desired. Unfortunately, we can only apply a single flair per post, and having an "AI" version for every existing flair would just become daunting and unwieldy.

Needless to say, we're going to refactor the flair system and are looking for insight on what the community wants in terms of flair.

We aim to keep at least a few different versions of flairs that indicate AI involvement, but with the top-level pinned bot comment giving insight into the AI involvement info, flairs involving AI may become unnecessary. But we still seek feedback from the community at large.

Conclusion

We hope this new stage in Post-AI r/selfhosted will work out better, but as always, we are open to feedback and try our best to work with the community to improve the experience here as best we can.

For now, we will be continuing to monitor things and assessing how this works for the benefit of the community.

As always,

Happy (self)Hosting


r/selfhosted • • 6d ago

New Project Megathread New Project Megathread - Week of 08 Oct 2026

28 Upvotes

Welcome to the New Project Megathread!

This weekly thread is the new official home for sharing your new projects (younger than three months) with the community.

To keep the subreddit feed from being overwhelmed (particularly with the rapid influx of AI-generated projects) all new projects can only be posted here.

How this thread works:

  • A new thread will be posted every Friday.
  • You can post here ANY day of the week. You do not have to wait until Friday to share your new project.
  • Standalone new project posts will be removed and the author will be redirected to the current week's megathread.

To find past New Project Megathreads just use the search.

Posting a New Project

We recommend to use the following template (or include this information) in your top-level comment:

  • Project Name:
  • Repo/Website Link: (GitHub, GitLab, Codeberg, etc.)
  • Description: (What does it do? What problem does it solve? What features are included? How is it beneficial for users who may try it?)
  • Deployment: (App must be released and available for users to download/try. App must have some minimal form of documentation explaining how to install or use your app. Is there a Docker image? Docker-compose example? How can I selfhost the app?)
  • AI Involvement: (Please be transparent.)

Please keep our rules on self promotion in mind as well.

Cheers,


r/selfhosted • • 16h ago

Wednesday Exceptions Threat-hunt your selfhosted logs in 10 minutes

Thumbnail
gallery
330 Upvotes

Hey all, happy Wednesday.

Self-hoster, same as most of you. Pi-hole, mattermost, home automations, a Zeek sensor, a dozen Linux boxes and, like everyone (I expect), a /var/log I almost never open unless I'm actively troubleshooting something. But this year’s avalanche of CVEs has been sitting in the back of my head for a while: “if something got in here, would I even know?”

So I went looking for a tool and found a gap instead. There’s good ol' grep on one end and a full SIEM on the other, and not much in between for just a guy and his stuff. I ended up making my own. It’s called sigwood and is at 1.1 as of today.

What it does: point it at logs you already have (Zeek, Pi-hole/dnsmasq, syslog or journald, CloudTrail if you have any cloud stuff) and it runs a handful of statistical detectors over them. Outbound connections with a beacon rhythm, DNS names that look machine-generated, port scans, big transfers out, odd TLS setups, rare syslog lines and reboots, that kind of thing. There’s also a digest command that just profiles a log file so you know what’s in it before you do anything, and a graph command that animates your conn.log as a Sankey flows in a self-contained HTML file (second screenshot).

What it is not: not a SIEM, not an agent, nothing to deploy. No database, no daemon, no account, no network calls. pipx install sigwood, then sigwood /var/log/, and read the output. Your logs stay on your box.

A “finding” is something unusual for your network, not known-bad. There's no signatures or anything like that. On a home network it mostly finds your own stuff first. And that’s sort of the point, you get to see what your network actually talks to and then allowlist the normal stuff. When it finds nothing, the conclusion is that the network is behaving like itself during that window.

The AI part, up front: I wrote the original implementation of the detectors and have used AI to assemble it all into working tool. Claude and Codex both together in a propose/challenge harness I made for them, with me reviewing and steering. This wouldn't exist without AI, I’m not going to pretend otherwise. And some of you will bounce off that, which is entirely fair. But I'm a security professional and a privacy nerd, never been a SWE.

Anyway, the repo is here: https://github.com/helixmap/sigwood

I genuinely want feedback, good or bad. If you run it on your logs and it gets something wrong, I want to hear about it. If the output is confusing, tell me that too. If you think the whole idea is misguided, I’d still rather hear it than not.

First screenshot is an example HTML report (no real network data). Second is a still from the graph animation.


r/selfhosted • • 4h ago

Release (AI) Custom dashboard for interacting with my Minecraft server remotely

Post image
15 Upvotes

didn’t realize it was this kind of subreddit, but since I do have something I’ll share. glad to find a place to show off!

utilizes the built in Minecraft server RCON protocol to act on behalf of logged in users. prioritizes parity with vanilla files over everything.


r/selfhosted • • 13h ago

Release (No AI) TrailBase 0.34: Fast, open and single-executable Firebase alternative (5.6k⭐)

Post image
49 Upvotes

TrailBase is an open and fast(est) Firebase-like backend (BaaS) for building your apps. It provides: type-safe APIs with change subscriptions, auth, multi-DB, a WebAssembly runtime, GeoJSON, admin UI, ...

It's a single self-contained executable, easy to self-host and built with Rust, Wasmtime & SQLite and more recently also Postgres. We provide clients for many environments: JS/TS, Dart/Flutter, Go, Rust, .Net, Kotlin, Swift and Python.

Just release v0.34.6. Since the last time posting here, TrailBase has added:

  • Major UI overhauls:
    • Built-in admin OpenAPI browser with user-impersonation.
    • Table explorer: make foreign-keys followable, split data/schema/indexes into separate tabs, and organize tables/views by DB. Add `ON (DELETE|UPDATE)` referential action support to the schema editor.
    • Mobile glow-up and improved screen estate usage with sticky nav and url bar fade.
    • A searchable and interactive ERD page. Overhauled logs and accounts pages.
    • Many more: prompt users on schema changes in the SQL editor, improved dark-mode colors, add S3 settings, ...
  • Built-in MCP server.
  • Performance: a lot of detail performance optimizations (reduce allocations, ...) resulting in an additional 10+% gains.
  • CLI auto-complete.
  • Expose custom WASM endpoints in OpenAPI spec.
  • "Sign-in with Apple" token exchange for native iOS/MacOS apps.
  • Many more features and fixes, e.g.: `trail user export` CLI command for take-out combating lock-in, `trail run --read-only` flag for read replicas., batch execute support for WASM guests, custom scopes for OIDC providers, ...

The project is still young (~2 years) and rapidly evolving, any feedback is genuinely appreciated. If you're feeling adventures and end up checking it out, don't hesitate to reach out 🙏.

Take a look at the live demo, our GitHub or website.


r/selfhosted • • 15h ago

Personal Dashboard Dashboard Wednesday - Customized Homepage

Post image
67 Upvotes

r/selfhosted • • 18h ago

Personal Dashboard My homelab dashboard is a biblically accurate angel watching my containers

86 Upvotes

So i have an old thinkcentre m710q sitting in my attic (wifi only gets really hot in the summer) running a couple of my sites. And I wanted a dashboard and instead of just using homepage or glances i ended up making this.

It gives like a win2000 desktop vibe with a biblically accurate angel in the middle. Every eye is one of my services, if something goes down the eye closes and starts crying. The wheels spin faster with cpu load and it goes from white to red when the attic heats up. also lain in the neofetch window because I love it.

Yeah it's kinda cringe and the animations probably eat more of my laptop's cpu than the server uses, but it's beautiful and I like looking at it, backend is just python with no dependencies and it's read only (no docker socket, can't restart anything). keeps 6 months of temps in sqlite so i can finally see how bad the attic gets in august.

Video of it: https://imgur.com/a/rncy4Sv

repo if anyone wants to check it out: github.com/Lozano-Miguel/vault-dashboard


r/selfhosted • • 14h ago

Need Help Apparently Dockge is dead. How do I migrate to Arcane?

34 Upvotes

I've been using Dockge to manage my docker containers on a headless Debian 13 server, and I'd like to switch to Arcane, but I'm a bit of a noob so idk the best way to go about it. I only have seven stacks (backrest, beszel, immich, isponsorblock, npm, nut_webgui, and scrutiny), all of which I created directly in Dockge using the compose feature, so they should all be in /opt/stacks.

Do I just need to run mv /opt/stacks/ /app/data/projects/, install Arcane, and let it autodetect the containers? Do I need to stop all the containers first? Or is there more to it than that?


r/selfhosted • • 1d ago

Product Announcement PSA: ShredOS fake malware website

208 Upvotes

Hey r/selfhosted!

ShredOS (the open-source successor of DBAN) for secure wiping of drives is recommended frequently on data-storage related subreddits. The maintainer and I (as one of the more active developers) have been concerned with an influx of people recommending and downloading it from the top-listed "official" website on Google (shredos [dot] org) - that website is fake and contains malware. It is unfortunately actively SEO'd to appear on the top and lure users towards it... do not fall for this, even if it's recommended to you by reputable sources.

If you have a second, please report this malicious website to Google:
https://safebrowsing.google.com/safebrowsing/report_phish/

Please only ever download ShredOS or Nwipe from the official GitHub repositories.

In other (happier) news, the latest iteration of ShredOS now supports hardware-native secure erase (sanitize) for modern ATA SSD and NVMe - which may help more confident resale of such devices in times when prices are at an all time high.

Stay safe out there and thanks for keeping the hobby (and re-sale of HDDs) alive!


r/selfhosted • • 7h ago

Release (No AI) Self-host AWS: run EC2, S3, VPC and RDS on your own hardware

6 Upvotes

I'm an engineer at Mulga, and we build Spinifex, an AGPL-3.0, self-hosted platform that serves the AWS APIs on hardware you own. You point the AWS CLI, an SDK or the hashicorp/aws Terraform provider at your own endpoint and get real resources: aws ec2 run-instances boots a VM on your hardware, and terraform apply builds a VPC on your network. Emulators like Floci and LocalStack mock the APIs for testing, while Spinifex runs the infrastructure your workloads use.

What it's for

  • Move compute-heavy AWS workloads such as GPU inference onto your own hardware, without rewriting the code or the Terraform.
  • Self-host software that was built for AWS, including on an air-gapped network.
  • Learn AWS without a bill: build the VPC, EC2 and RDS stack from a cert course and leave it running for a month.
  • Keep one AWS profile for work and another for the rack in the cupboard, with the same commands for both.

Running it

Install a single node onto an existing Ubuntu 26.04 or Debian 13 machine using the binary installer https://docs.mulgadc.com/docs/install or do a fresh install using a bootable USB https://docs.mulgadc.com/docs/install-usb

Repo: https://github.com/mulgadc/spinifex


r/selfhosted • • 4h ago

Need Help I am looking for something that can access and read the database files

3 Upvotes

Recently (the last 2 days), I have been having a major problem with Grimmory not adding the new books/audio that I add to the library. With a lot of persistence, I have to use the CLI to log in to MariaDB to remove the delete record(s) that cause it to hang, and it is a real PITA to try to do from the CLI. I seem to recall seeing a program not too long ago that interfaces with the databases, but I do not recall the name, or if it was what I am thinking it was. Is there such a program or a better method for accomplishing what I need to do? It is not just MariaDB; it is other types of databases as well.


r/selfhosted • • 23h ago

Personal Dashboard Homepage Dashboard

Post image
94 Upvotes

Oracle free tier


r/selfhosted • • 8h ago

Media Serving Browse and play WebDAV files on Android TV

Post image
5 Upvotes

I'm the developer of Sidstuga. Sidstuga can connect to a WebDAV folder and browse or play media from Android TV or a phone. It can also record and transfer files to WebDAV.

You can see source details before opening a file, then use subtitle search and timing controls during playback. Jellyfin, Emby and Plex can also sit in the same Hub.

If you use WebDAV for media, do you browse by folder or prefer a library view?

r/sidstuga


r/selfhosted • • 14m ago

Webserver I got sick of going through the Ubuntu server setup for my VPS so I created this handy script

Thumbnail github.com
• Upvotes

This is actually version 2, an upgrade that offers more things like app installation, more hardening, etc. Never assume this is all that is needed, everyone has a unique situation, but it's a good start. I also suggest you do not use this script if you haven't manually setup your server a few times to learn, you should learn that. This was made for the lazy.

VPS First-Run Setup: one Python script to harden a fresh Debian/Ubuntu VPS and install self-hosted apps

  • Single file, no dependencies. Uses only the Python 3 standard library. Run it as root and it walks you through each step.
  • Basic hardening: apt update/upgrade, fail2ban for SSH (your own IP is whitelisted), UFW firewall, and a sudo user.
  • SSH key setup with a live test. It waits while you log in with the key from a new terminal, then checks the server logs to confirm it worked.
  • SSH hardening that won’t lock you out. Every change is checked with sshd -t and sshd -T and rolled back if either fails. Passwords are only disabled once your key login has worked.
  • Disables password login properly. It edits sshd_config and the drop-in files that often override it.
  • Safe SSH port change. UFW, fail2ban and Ubuntu 24.04’s ssh.socket are updated to match. The old port stays open until you confirm the new one works, and you can revert.
  • Docker + Compose from Docker’s official repository.
  • Nginx Proxy Manager with a shared Docker network. Apps publish no ports, and the proxy reaches them by container name.
  • 13 optional apps: n8n, Open WebUI, Ollama, Gitea, Nextcloud, Jellyfin, Uptime Kuma, Tailscale, Coolify, Dokploy, OpenClaw and Hermes Agent, plus Nginx Proxy Manager in apps-only mode.
  • Private by default. Docker ignores UFW, so apps are bound to 127.0.0.1 or a Tailscale IP, and the script prints the SSH tunnel command for each.
  • Secrets handled for you. Passwords and keys are generated and stored in an owner-only .env file for each app. Admin accounts are created during install where the app supports it.
  • Catches conflicts. It warns about port clashes, apps that both need 80/443, and servers with too little RAM.
  • Apps-only mode for servers that are already set up.
  • MIT licensed

r/selfhosted • • 20h ago

Wednesday Exceptions Glance Dashboard - Went for Liquid Glass Style, photo slideshow as background

Thumbnail
gallery
39 Upvotes

Dashboard:
Glance
https://github.com/glanceapp/glance

System Metrics:
Glances
https://github.com/nicolargo/glances

Weather:
Open-Meteo

Markets:
Yahoo Finance

Font:
Inter by Rasmus Andersson:
https://rsms.me/inter/

Liquid Glass:
Inspired by Apple, written from scratch by Claude using SVG displacement-filter technique

Background Photos by me

ignore Open WebUI being offline, its fine 😅


r/selfhosted • • 34m ago

Automation Self hosted ntfy notifications and deploying that server on Render Free tier: A bad or good Idea?

• Upvotes

I am new to new hosting stuff, i am trying to get my personal ai assistant to send me a message every morning of my emails , meetings , tasks etc.

So the claude suggest me ntfy i checked it and found out that ntfy is open source. I got an idea to make it super secure why not self host it by downloading the docker image and host it on Render or any other free plaforms?

Is this a good idea? Is anyone using like this? Never used ntfy in my life


r/selfhosted • • 17h ago

Photo Tools HyCanvas: a self-hosted Canva and Genspark alternative, with AI decks you can edit by hand

21 Upvotes

HyCanvas is a browser design tool in the Canva and Genspark space: social graphics, slide decks, video editing, whiteboards, docs, and sheets, with realtime collaboration. Decks can be generated from one sentence, and every generated slide stays fully editable.

The self-hosting side:

  • One Go binary with the web app embedded. The only dependency is Postgres; no Redis needed.
  • A first-run wizard sets up the database, storage (local disk or any S3 bucket), optional SMTP, and the first account.
  • Images for amd64 and arm64. No telemetry; stock photo search uses Openverse and can be turned off.
  • AI is optional and uses your own key: OpenAI, Anthropic, Amazon Bedrock, and more, or any OpenAI-compatible endpoint, including one on your own network.

Try it: download the latest build for your platform (Linux, macOS, or Windows) from https://github.com/hyscaler/HyCanvas/releases/latest, then, with a Postgres database you can start:

tar xzf hycanvas_*_linux_amd64.tar.gz
./hycanvas start

It prints a setup link and a one-time secret; the wizard in your browser connects Postgres, picks storage, and creates the first account. Run it as a regular user, not root.

Prefer Docker? The published image is hycanvas/hycanvas (amd64 and arm64), and the Docker guide has a compose file and every environment variable: https://docs.hycanvas.com/operate/docker/

License: Open Source under the AGPL 3.0.

Disclosure: I work on HyCanvas.

Happy to answer questions!


r/selfhosted • • 1h ago

Need Help Title: Looking for an open-source task and progress tracking system with automated reminders (WeCom / Lark integration)

• Upvotes

Hi everyone!

I'm working on an internal project for our company, and I'm looking for recommendations on existing open-source tools or implementation approaches.

Our goal is to build a task management system where managers can easily see what everyone is working on, track progress, and identify overdue or blocked tasks.

Key requirements:

  • Managers need a dashboard showing tasks assigned to each employee, current status, progress, and deadlines.
  • Employees should be able to update their progress and report blockers.
  • The system should automatically send reminders before deadlines, when tasks become overdue, or when progress hasn't been updated for a while.
  • Ideally, reminders should be delivered through WeCom (WeChat Work) or Lark (Feishu), since these are commonly used in our workplace.
  • Self-hosting and customization would be a big plus.

I'm considering building this ourselves, but I'd prefer to start from an existing open-source project rather than reinventing everything.

I've looked into Plane, OpenProject, and workflow automation tools like n8n.

My questions:

  1. Are there any open-source projects you'd recommend for this use case?
  2. Has anyone integrated a task management system with WeCom or Lark?
  3. Would you recommend customizing an existing platform or building a lightweight system from scratch?
  4. Are there better architectures or tools I should consider?

I'd really appreciate any suggestions, GitHub repositories, or real-world implementation examples.

Thanks!


r/selfhosted • • 10h ago

Need Help What happened to Fasten Health (healthcare records)? Alternatives?

4 Upvotes

I remember Fasten started as a project to have all your clinical health data locally as copy of it. I remember them doing well they got a way to import data from American insurers but since I am from EU I was waiting for interoperability with EU come in.... and checked today to find that fasten is now an API company that dose the interoperability presumable for US insurers and AI.

https://www.fastenhealth.com/

Looks like the selfhosted and open source project is dead:

https://github.com/fastenhealth/fasten-onprem repo is archived

https://github.com/fastenhealth/fasten-onprem/issues/629 issue thread confirms that they turned into a service.

I did not find a maintained fork.

I am lookin for selfhosted option for local records copy ideally with FHIR importing option. Is there one? I would like to have a copy of my medical records just in case system gets hacked/bombed/flooded.

P.S. Discussion Werther founder of Fasten intended to used the community to gather knowledge and 'sell out' to make a cloud service or that was just enviable because of (intentionally) high complexity of healthcare record interoperability to make low cost solutions unsustainable dose not really matter and dose not contribute to having independent health records. Please be civil.


r/selfhosted • • 21h ago

Wednesday Exceptions Selfhosted inventory manager - OpenInvento

26 Upvotes

Hey guys! After a lot of testing and beta version I released v1.0.0 of OpenInvento, a self-hosted inventory manager.

The goal of it is to make it easier to keep track of physical items and where they're stored without having to rely on a hosted third-party service.

I've been working on getting it to a stable 1.0 release, and now I'd love to get some feedback on it.

Github link (There are also some screenshots in the Readme): https://github.com/openinvento/openinvento

Deployment is quite easy, there is a docker image with a docker compose file available: https://github.com/openinvento/openinvento#docker-compose-recommended


r/selfhosted • • 5h ago

Release (AI) From bookshelves and game cartridges to a self-hosted library: why I built FolioSpace Library

Post image
0 Upvotes

I've been collecting books, games, and movies long enough to have watched the shelves change several times.

Physical books became ebooks. Game cartridges gave way to digital collections. Movies went from videotapes to DVDs, then Blu-rays, and eventually files on a drive. Comics made that journey too.

I like the convenience of digital media. But over the years, my collection ended up spread across folders and different tools. I could still find things, but it didn't quite feel like one collection anymore.

That's why I started building FolioSpace Library. I'm its developer, but I'm also the person using it to organize my own stuff.

It's an open-source, self-hosted library that runs with Docker on your own computer or a compatible NAS. It brings books, comics, and game collections into one place. I've recently added movie poster fetching through TMDB, so the film collection is starting to feel more like a shelf I can browse, too.

For the game-library side, I took inspiration from the open-source RomM project. A big thank-you to the RomM team and contributors for their work. It helped shape how I approached this part of FolioSpace Library.

What I enjoy most is a fairly ordinary thing: opening one place and seeing the things I've collected over the years. A book, a game, a film. Different formats, but all part of the same personal library.

There's something reassuring about that. The formats have changed, but the collection still feels like mine, and I can keep organizing it on a system I control.

I'd love to hear from others who've made the same journey. Do you prefer separate tools for each kind of media, or would you like a shared home for the whole collection?

GitHub: https://github.com/funland/foliospace-Library
Website: https://foliospace.app/


r/selfhosted • • 12h ago

Software Development How do you decide when a self-hosted app needs a separate data service?

4 Upvotes

I am working on Spedo, a preview single-node RESP runtime for hot, rebuildable KV/JSON data. It is not a cluster or a replacement for a system of record.

For a small self-hosted app, what makes you add a separate cache process instead of keeping rebuildable state in the app? I am interested in the operational trade-offs and the point where the extra service earns its keep.


r/selfhosted • • 1d ago

Wednesday Exceptions Dusk for Plex 1.6: SharePlay, better Apple TV playback, and more

Post image
20 Upvotes

Hey all, Dusk 1.6 is out! Last time I posted was around the Apple TV launch, so below the new stuff there's a quick catch-up of everything else that shipped since.

New in 1.6

  • SharePlay: watch together over FaceTime
  • Apple TV now matches frame rate and dynamic range to the content, and multichannel audio is fixed
  • Subtitles: font size setting and OpenSubtitles download via Plex

Also new in the last couple of months

  • Live TV: Plex Live TV with a full guide
  • AirPlay: send video to an AirPlay receiver while Dusk stays the remote
  • Plex Home: user switching with PIN
  • Seerr integration: request stuff right from search
  • AI upscaling for low-res content, on all devices
  • Generic video libraries (home videos / clips) are now supported

Plus a lot of playback and audio fixes along the way.

Thank you ❤️

At least half of this list started as a comment or DM from one of you.

Dusk is free and open source, with no ads and every feature available to everyone. The only thing that pays for it is people choosing to support it through the app. So a special thanks to everyone who does, Dusk wouldn't be possible without you.

Please keep it coming. If something is broken or feels off, tell me here or on GitHub. I read all of it.

getdusk.app

App Store


r/selfhosted • • 15h ago

Need Help Migrate files from nextcloud to opencloud

5 Upvotes

Hi guys, I copied some of my files (around 600 GB) from my nextcloud to OpenCloud directly using Krusader while OpenCloud was stopped. After it finished copying the files, I changed the ownership and permissions to match OpenCloud, then I started OpenCloud, and after around 30 to 60 seconds, my unraid hangs. I cannot access the GUI or SSH, but I can ping my Unraid.

I already copied the files before I found out about the rclone thing when migrating. That being said, how do you migrate files? Or should I delete it and restart my migration using rclone?

Here's the info:
Unraid 7.3.1
OpenCloud container via Docker Compose method
Nextcloud LSIO container.

OpenCloud directory where I copied my files into: /mnt/user/opencloud/storage/users/users/<user id>/Files/data

nextcloud directory where I copied my files from: /mnt/user/nextcloud/<username>/files/Files/data


r/selfhosted • • 11h ago

Self Help Beginner - Help with self hosted LLM build

3 Upvotes

Looking into self-hosting a LLM. I have an elitedesk mini G9 with 32gb ram and an intel i7 that I want to add a eGPU to and I’m trying to decide what GPU/setup is the right one.

I see that Newegg is selling an Aorus box with an RTX 5070 Ti 16gb for about 1000 bucks. Is this worth the deal? I’m trying to budget for this amount exactly and this deal seems too good to be true. But I figure, even if I buy a used GPU, the cost of the additional components would take to my budget limit and beyond anyway. I am an absolutely beginner at this home lab stuff. Just need some help.

I was recommended a V100 but I’ve read that they require a fan that will sound like a lawn mower/vacuum to prevent overheating and I don’t want that in my house