A download of a big .tiff (202MB) with e.g. curl always gets curl: (56) Recv failure: Connection reset by peer at 171MB of the download. This only happens when downloading over Traefik. Traefik is using zookeeper to get its routes. Downloading the file directly from the host where Traefik sends the traffic to, succeeds without a problem. Also smaller files are working fine and serving the 202MB file from a Traefik instance with static configuration works fine too.
The curl command is the following:
curl -i http://traefik02.example.com/file.tiff -H 'Authorization: Bearer <token>' > tmp.tiff
The Traefik config is
checkNewVersion = false
debug = true
defaultEntryPoints = ["http"]
logLevel = "DEBUG"
sendAnonymousUsage = false
[forwardingTimeouts]
dialTimeout = "10m"
[zookeeper]
endpoint = "zk1.example.com:2181,zk2.example.com:2181,zk3.example.com:2181"
watch = true
[accessLog]
filePath = "/var/log/traefik/access.log"
[api]
dashboard = true
[entryPoints.web]
address = ":80"
[metrics.statsd]
address = "graphite.example.com:8125"
pushInterval = "60s"
[ping]
entryPoint = "web"
[retry]
[traefikLog]
filePath = "/var/log/traefik/traefik.log"
Debug logs for this request
time="2020-01-15T17:43:39+01:00" level=debug msg="vulcand/oxy/roundrobin/rr: Forwarding this request to URL" Request="
{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/openeo/0.4.0/jobs
/6602bed1-6b75-40b8-a897-23990faa74e5/results/out\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment
\":\"\"},\"Proto\":\"HTTP/1.1\",\"ProtoMajor\":1,\"ProtoMinor\":1,\"Header\":{\"Accept\":[\"*/*\"],\"Authorization\":[
\"Bearer basic.c3RlZmFhbg==\"],\"User-Agent\":[\"curl/7.29.0\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\
":\"traefik02.example.com\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"192.168.207.123:47864\",\"RequestURI\":\"/file.tiff\",\"TLS\":null}" ForwardURL="http://192.168.207.210:47617"
time="2020-01-15T17:43:39+01:00" level=debug msg="vulcand/oxy/forward: begin ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"http\",\"Opaque\":\"\",\"User\":null,\"Host\":\"192.168.207.210:47617\",\"Path\":\"\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\"},\"Proto\":\"HTTP/1.1\",\"ProtoMajor\":1,\"ProtoMinor\":1,\"Header\":{\"Accept\":[\"*/*\"],\"Authorization\":[\"Bearer basic.c3RlZmFhbg==\"],\"User-Agent\":[\"curl/7.29.0\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"traefik02.example.com\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"192.168.207.123:47864\",\"RequestURI\":\"/file.tiff\",\"TLS\":null}"
time="2020-01-15T17:43:39+01:00" level=debug msg="vulcand/oxy/forward/http: begin ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"http\",\"Opaque\":\"\",\"User\":null,\"Host\":\"192.168.207.210:47617\",\"Path\":\"\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\"},\"Proto\":\"HTTP/1.1\",\"ProtoMajor\":1,\"ProtoMinor\":1,\"Header\":{\"Accept\":[\"*/*\"],\"Authorization\":[\"Bearer basic.c3RlZmFhbg==\"],\"User-Agent\":[\"curl/7.29.0\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"traefik02.example.com\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"192.168.207.123:47864\",\"RequestURI\":\"/file.tiff\",\"TLS\":null}"
time="2020-01-15T17:43:39+01:00" level=debug msg="Upstream ResponseWriter of type *pipelining.writerWithoutCloseNotify does not implement http.CloseNotifier. Returning dummy channel."
time="2020-01-15T17:43:43+01:00" level=debug msg="vulcand/oxy/forward/http: completed ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"http\",\"Opaque\":\"\",\"User\":null,\"Host\":\"192.168.207.210:47617\",\"Path\":\"\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\"},\"Proto\":\"HTTP/1.1\",\"ProtoMajor\":1,\"ProtoMinor\":1,\"Header\":{\"Accept\":[\"*/*\"],\"Authorization\":[\"Bearer basic.c3RlZmFhbg==\"],\"User-Agent\":[\"curl/7.29.0\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"traefik02.example.com\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"192.168.207.123:47864\",\"RequestURI\":\"/file.tiff\",\"TLS\":null}"
time="2020-01-15T17:43:43+01:00" level=debug msg="vulcand/oxy/forward: completed ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"http\",\"Opaque\":\"\",\"User\":null,\"Host\":\"192.168.207.210:47617\",\"Path\":\"\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\"},\"Proto\":\"HTTP/1.1\",\"ProtoMajor\":1,\"ProtoMinor\":1,\"Header\":{\"Accept\":[\"*/*\"],\"Authorization\":[\"Bearer basic.c3RlZmFhbg==\"],\"User-Agent\":[\"curl/7.29.0\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"traefik02.example.com\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"192.168.207.123:47864\",\"RequestURI\":\"/file.tiff\",\"TLS\":null}"
time="2020-01-15T17:43:43+01:00" level=debug msg="vulcand/oxy/roundrobin/rr: completed ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/file.tiff\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\"},\"Proto\":\"HTTP/1.1\",\"ProtoMajor\":1,\"ProtoMinor\":1,\"Header\":{\"Accept\":[\"*/*\"],\"Authorization\":[\"Bearer basic.c3RlZmFhbg==\"],\"User-Agent\":[\"curl/7.29.0\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"traefik02.example.com\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"192.168.207.123:47864\",\"RequestURI\":\"/file.tiff\",\"TLS\":null}"
time="2020-01-15T17:43:43+01:00" level=debug msg="Request has been aborted [192.168.207.123:47864 - /file.tiff]: net/http: abort Handler"
Anyone any idea what could cause this?
Thanks in advance!