This GitHub repo provides a curated list of excellent resources for Site Reliability and Production Engineering. I use it as a solid starting point when I need to dig into SRE topics.
Visit github.com →
bunny.net positions itself as a robust European alternative to Cloudflare, offering a global edge platform that integrates CDN, security, and compute services. I find their focus on performance and comprehensive edge solutions appealing.
Anubis is a self-hostable proof-of-work software designed to defend websites against scraper bots and automated traffic.
DeepSeek's 3FS (Fire-Flyer File System) is a high-performance distributed file system specifically designed for AI training and inference workloads, leveraging SSDs and RDMA.
LiteLLM is a Python SDK and proxy server to unify 100+ LLM APIs, enabling calls in OpenAI format. This is a critical tool for abstracting LLM providers, offering features like cost tracking, load balancing, and guardrails.
OpenInference delivers OpenTelemetry instrumentation for AI observability. This allows tracing AI applications, including LLMs and their ecosystem components, providing critical insights into their runtime behavior across any OpenTelemetry-compatible backend.
This is my go-to C library for efficiently running LLaMA and other LLMs locally on consumer hardware, especially useful for Mac users where it shines on Apple Silicon. It really democratizes local AI inference.