"Caddy's reverse proxy is slow on localhost"
"Are you using TCP?"
"Yes"
"Try unix sockets"
"Oh, it's not slow anymore."

TCP overhead is not negligible. https://github.com/caddyserver/caddy/issues/6751