Paolo Perrone's Recent LinkedIn Posts

Stack Overflow copy-paste was the original vibe coding. We just upgraded the source.

I've replaced $4,000/month in LLM infrastructure costs with 8 open-source repos. $48,000/year. Gone. Here's the swap list: 1️⃣ Paid serving API → vLLM (74K ⭐) Self-hosted inference. PagedAttention, continuous batching. $0.03/token → $0.002/token overnight. https://lnkd.in/eeT_HM2B 2️⃣ Cloud fine-tuning platform…

I've been training models on GPU clusters for years. I couldn't explain why Tensor Parallelism stops scaling at 8 GPUs. HuggingFace ran 4,000+ scaling experiments on up to 512 GPUs and wrote everything down. Open source. The Ultra-Scale Playbook. Here's what humbled me: 1️⃣ Activation memory is the silent killer…

A YC-backed CTO told me his team deleted every engineering metric except two. Revenue per line of code. Revenue per token. His 4-person team outships companies with 40 engineers. He says these metrics are why. Here's what they actually track: 1️⃣ Revenue per line of code = lifetime cost of ownership Every line y…

Stack Overflow copy-paste was the original vibe coding. We just upgraded the source.

I've replaced $4,000/month in LLM infrastructure costs with 8 open-source repos. $48,000/year. Gone. Here's the swap list: 1️⃣ Paid serving API → vLLM (74K ⭐) Self-hosted inference. PagedAttention, continuous batching. $0.03/token → $0.002/token overnight. https://lnkd.in/eeT_HM2B 2️⃣ Cloud fine-tuning platform…