r/remotepython • u/FantasticVisual7783 • 20h ago
r/remotepython • u/Acrobatic-Issue-8646 • 12h ago
[For Hire] GPU and LLM inference optimization — lower latency, VRAM use, and cost per request
We are a small technical team focused on GPU kernels and production inference systems. We help AI startups, inference API teams, GPU providers, and companies running self-hosted models make inference faster, more reliable, and less expensive.
If your team is responding to slow generation or high GPU bills by adding more hardware, we can first determine whether the real constraint is kernels, memory movement, quantization, KV-cache layout, batching, scheduling, model loading, or the serving architecture.
We can help with:
- CUDA and Triton kernel development, fusion, profiling, and benchmarking
- PyTorch model-path optimization and numerical validation
- vLLM, SGLang, TensorRT-LLM, and custom serving systems
- quantization, VRAM reduction, KV-cache layout, continuous batching, and CUDA Graphs
- time to first token, inter-token latency, throughput, and tail-latency analysis
- scale-to-zero, cold-start behavior, readiness, cancellation, streaming, and failure recovery
- GPU utilization, cost-per-request analysis, and capacity planning
- reproducible before/after benchmarks with correctness gates and documented limitations
A typical engagement starts with a focused inference audit:
Define the model, framework, GPU, traffic shape, latency or throughput target, and cost constraint.
Profile the current path and identify the dominant bottlenecks.
Agree on the smallest changes worth implementing.
Deliver code, before/after measurements, correctness checks, and remaining risks.
Help integrate and validate the optimized path under realistic load.
Good fits include a slow or expensive inference endpoint, VRAM pressure preventing the desired batch size or context length, unstable serving under load, poor GPU utilization, costly cold starts, or a custom kernel/model path that needs profiling and validation.
For an initial conversation, send a Reddit chat or private message with:
- model and framework
- GPU type and VRAM
- current latency, throughput, utilization, or cost problem
- target workload and success metric
- deployment environment
- timeline and approximate budget range
We will tell you directly whether the workload appears optimizable and what evidence would be needed before making a performance or savings claim.
r/remotepython • u/Open_Catch6746 • 12h ago
[Hiring] 100% REMOTE ENGINEERING ROLE ($3,000+/month)
r/remotepython • u/One_Caregiver5201 • 14h ago
[For Hire] Python Backend & AI Developer – FastAPI, chatbots/RAG, web scraping, automation – from $15/hr or fixed price
Hi! I'm a Python backend and AI developer (final-year CS student, Dhaka, UTC+6). I build working tools, not prototypes that break.
**What I can do for you**
- AI chatbots / RAG: a bot that answers from your documents, with citations, and hands off to a human when needed
- Web scraping: Playwright/Scrapy scrapers that handle dynamic pages, pagination and retries, delivered as clean CSV/Excel
- Automation scripts: data cleaning, scheduled jobs, API integrations, webhooks
- Backend APIs: FastAPI + PostgreSQL + Redis, Dockerized, with tests
**Proof of work (public code)**
- AI Business Agent Platform – multi-tenant AI support agent with RAG, tool calling, human handoff, 570 tests in CI: https://github.com/hasinabraradib/business-agent-platform
- Daraz Price Tracker – distributed scraper with job queue, retries, Kubernetes/Terraform: https://github.com/hasinabraradib/daraz-price-tracker
**How I work**
- Small jobs welcome. Tell me the task and I'll give you a fixed price and timeline before starting.
- For a first job I'm happy to deliver a small sample first (e.g. the first 100 scraped rows) so you can check quality.
- Rate: from $15/hr, or fixed price per task.
- Payment: Payoneer. 50% upfront for larger tasks.
DM me with what you need and I'll reply quickly.