A Rust, Python and gRPC server for text generation inference. Used in production at Hugging Face to power Hugging Chat, the Inference API and Inference Endpoint.

Devoted husband of the late Mary, brilliant Dad of Nicola and Denise, and much loved Grampy to Hermione, Ursula, Elliott, and Austin.