See the discussion here about how to add this to Caddy. https://github.com/caddyserver/caddy/issues/3336 Seems important given that a current 404 looks like a server error when likely a client error.