/4 min
Is Local AI Actually Private? A Practical Threat Model for On-Device LLMs
Running an LLM locally removes network egress, but telemetry, model downloads, and RAG indexes still leak — here's what to check.
Tag
#on-device
3 posts.
/3 min/reference
Core ML vs MLX for On-Device LLMs: ANE, GPU, and When Each Wins
MLX runs on-device LLMs on the GPU for throughput; Core ML can place them on the ANE to keep the GPU free — here's how to choose.
/4 min
From Cloud Qdrant RAG to On-Device RAG: What Actually Transfers and What Doesn't
Moving a production cloud RAG pipeline on-device: the shape transfers, but index scale, embedder size, and re-ranking budgets do not.