I figured it out!
I am using --providers.docker.exposedbydefault=false
to prevent the auto exposure of all containers. This issue was, that this blocked traffic from reaching the "http_catchall" router. I had to add traefik.enable=true
to the labels block on the traefik container this enables access to the "http_catchall" router.