Scaling Generative AI Features to Millions of Users Thanks to Inference Pipeline Optimizations

We'll cover how PhotoRoom uses generative AI models for real-time inference. We'll start by highlighting the techniques used for architecture optimization, followed by a deep dive into TensorRT. We'll also cover how we serve models for millions of users, leveraging Triton Inference Server.