I had to edit docker-compose.yml in:
/home/umbrel/umbrel/repos/https—github-com-getumbrel-umbrel-apps-git/invidious
changing services section as:
services:
app_proxy:
environment:
APP_HOST: invidious_web_1
APP_PORT: 3000
PROXY_AUTH_ADD: "false"
And reinstalled invidious