k6 is an open-source load testing tool from Grafana. It enables engineering teams to script performance tests in JavaScript, supporting various test types for continuous application reliability.
Visit k6.io →
bunny.net positions itself as a robust European alternative to Cloudflare, offering a global edge platform that integrates CDN, security, and compute services. I find their focus on performance and comprehensive edge solutions appealing.
Anubis is a self-hostable proof-of-work software designed to defend websites against scraper bots and automated traffic.
DeepSeek's 3FS (Fire-Flyer File System) is a high-performance distributed file system specifically designed for AI training and inference workloads, leveraging SSDs and RDMA.
LiteLLM is a Python SDK and proxy server to unify 100+ LLM APIs, enabling calls in OpenAI format. This is a critical tool for abstracting LLM providers, offering features like cost tracking, load balancing, and guardrails.
OpenInference delivers OpenTelemetry instrumentation for AI observability. This allows tracing AI applications, including LLMs and their ecosystem components, providing critical insights into their runtime behavior across any OpenTelemetry-compatible backend.
This is my go-to C library for efficiently running LLaMA and other LLMs locally on consumer hardware, especially useful for Mac users where it shines on Apple Silicon. It really democratizes local AI inference.