All services except "netbox" (also netbox-worker) are stopped unexpectly

[melectronics-it]

Current Behavior

I have updated my NetBox in docker to version 4.4.3 and since I did that I have now repeating crashes of the "backend" services (postgres, redis, netbox-worker). They appear fast after I start the docker-compose stack. Then the postgres for example throw this in its logs:

postgres-1  | 2025-10-16 23:00:06.250 UTC [1] LOG:  received fast shutdown request                                                                                                                                │
postgres-1  | 2025-10-16 23:00:06.301 UTC [1] LOG:  aborting any active transactions                                                                                                                              │
postgres-1  | 2025-10-16 23:00:06.306 UTC [13463] FATAL:  terminating connection due to administrator command                                                                                                     │
postgres-1  | 2025-10-16 23:00:06.310 UTC [13471] FATAL:  terminating connection due to administrator command                                                                                                     │
postgres-1  | 2025-10-16 23:00:06.312 UTC [1] LOG:  background worker "logical replication launcher" (PID 33) exited with exit code 1                                                                             │
postgres-1  | 2025-10-16 23:00:06.315 UTC [28] LOG:  shutting down                                                                                                                                                │
postgres-1  | 2025-10-16 23:00:06.319 UTC [28] LOG:  checkpoint starting: shutdown immediate                                                                                                                      │
postgres-1  | 2025-10-16 23:00:06.338 UTC [28] LOG:  checkpoint complete: wrote 0 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.002 s, sync=0.001 s, total=0.023 s; sync files=0, longest=0.│
postgres-1  | 2025-10-16 23:00:06.428 UTC [1] LOG:  database system is shut down

But I don´t touched anything and get it first when I wonder why my netbox is offline...

Expected Behavior

That the services stay up and running after starting it.

Docker Compose Version

Docker Compose version v2.40.0

Docker Version

Client: Docker Engine - Community
 Version:           28.5.1
 API version:       1.51
 Go version:        go1.24.8
 Git commit:        e180ab8
 Built:             Wed Oct  8 12:17:41 2025
 OS/Arch:           linux/amd64
 Context:           default

Server: Docker Engine - Community
 Engine:
  Version:          28.5.1
  API version:      1.51 (minimum version 1.24)
  Go version:       go1.24.8
  Git commit:       f8215cc
  Built:            Wed Oct  8 12:17:41 2025
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          v1.7.28
  GitCommit:        b98a3aace656320842a23f4a392a33f46af97866
 runc:
  Version:          1.3.0
  GitCommit:        v1.3.0-0-g4ca628d1
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

The git Revision

ae5f7d2

The git Status

On branch release
Your branch is up to date with 'origin/release'.

nothing to commit, working tree clean

Startup Command

docker compose up -d

NetBox Logs

netbox-1  | ↩️ Skip creating the superuser                                                                                                                                                                        │n
etbox-1  | 🧬 loaded config '/etc/netbox/config/configuration.py'                                                                                                                                                │n
etbox-1  | 🧬 loaded config '/etc/netbox/config/extra.py'                                                                                                                                                        │n
etbox-1  | 🧬 loaded config '/etc/netbox/config/logging.py'                                                                                                                                                      │n
etbox-1  | 🧬 loaded config '/etc/netbox/config/plugins.py'                                                                                                                                                      │n
etbox-1  | 146 objects imported automatically (use -v 2 for details).                                                                                                                                            │n
etbox-1  |                                                                                                                                                                                                       │n
etbox-1  | ✅ Initialisation is done.                                                                                                                                                                            │n
etbox-1  | ⏳ Waiting for control socket to be created... (1/10)                                                                                                                                                 │n
etbox-1  | 2025/10/16 17:48:06 [warn] 7#7 Unit is running unprivileged, then it cannot use arbitrary user and group.                                                                                             │n
etbox-1  | 2025/10/16 17:48:06 [info] 7#7 unit 1.34.2 started                                                                                                                                                    │n
etbox-1  | 2025/10/16 17:48:06 [info] 183#183 discovery started                                                                                                                                                  │n
etbox-1  | 2025/10/16 17:48:06 [notice] 183#183 module: python 3.12.3 "/usr/lib/unit/modules/python3.12.unit.so"                                                                                                 │n
etbox-1  | 2025/10/16 17:48:06 [info] 7#7 controller started                                                                                                                                                     │n
etbox-1  | 2025/10/16 17:48:06 [notice] 7#7 process 183 exited with code 0                                                                                                                                       │n
etbox-1  | 2025/10/16 17:48:06 [info] 185#185 router started                                                                                                                                                     │n
etbox-1  | 2025/10/16 17:48:06 [info] 185#185 OpenSSL 3.0.13 30 Jan 2024, 300000d0                                                                                                                               │n
etbox-1  | 2025/10/16 17:48:06 [info] 186#186 "netbox" prototype started                                                                                                                                         │n
etbox-1  | 2025/10/16 17:48:06 [info] 187#187 "netbox" application started                                                                                                                                       │n
etbox-1  | ⚙️ Applying configuration from /etc/unit/nginx-unit.json                                                                                                                                              │ne
tbox-1  | ✅ Unit configuration loaded successfully                                                                                                                                                             │ne
tbox-1  | 2025/10/16 17:48:10 [notice] 7#7 process 181 exited with code 0                                                                                                                                       │ne
tbox-1  | 2025/10/16 17:48:10 [info] 225#225 "netbox" application started                                                                                                                                       │ne
tbox-1  | 2025/10/16 17:48:18 [info] 258#258 "netbox" application started
netbox-1  | 2025/10/16 23:00:06 [notice] 7#7 process 184 exited with code 0                                                                                                                                       │
netbox-1  | 2025/10/16 23:00:06 [notice] 7#7 process 185 exited with code 0                                                                                                                                       │
netbox-1  | 🧬 loaded config '/etc/netbox/config/configuration.py'                                                                                                                                                │
netbox-1  | 🧬 loaded config '/etc/netbox/config/extra.py'                                                                                                                                                        │
netbox-1  | 🧬 loaded config '/etc/netbox/config/logging.py'                                                                                                                                                      │
netbox-1  | 🧬 loaded config '/etc/netbox/config/plugins.py'                                                                                                                                                      │
netbox-1  | 🧬 loaded config '/etc/netbox/config/configuration.py'                                                                                                                                                │
netbox-1  | 🧬 loaded config '/etc/netbox/config/extra.py'                                                                                                                                                        │
netbox-1  | 🧬 loaded config '/etc/netbox/config/logging.py'                                                                                                                                                      │
netbox-1  | 🧬 loaded config '/etc/netbox/config/plugins.py'                                                                                                                                                      │
netbox-1  | 2025/10/16 23:00:13 [notice] 186#186 app process 258 exited with code 0                                                                                                                               │
netbox-1  | 2025/10/16 23:00:13 [alert] 186#186 sendmsg(13, -1, -1, 2) failed (32: Broken pipe)                                                                                                                   │
netbox-1  | 2025/10/16 23:00:13 [notice] 186#186 app process 225 exited with code 0                                                                                                                               │
netbox-1  | 2025/10/16 23:00:13 [alert] 186#186 sendmsg(13, -1, -1, 2) failed (32: Broken pipe)                                                                                                                   │
netbox-1  | 2025/10/16 23:00:13 [notice] 7#7 process 186 exited with code 0
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (0s / 30s)                                                                                                                                                                        │
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (3s / 30s)                                                                                                                                                                        │
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (6s / 30s)                                                                                                                                                                        │
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (9s / 30s)                                                                                                                                                                        │
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (12s / 30s)                                                                                                                                                                       │
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (15s / 30s)                                                                                                                                                                       │
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (18s / 30s)                                                                                                                                                                       │
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (21s / 30s)                                                                                                                                                                       │
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (24s / 30s)                                                                                                                                                                       │
netbox-1  | django.db.utils.OperationalError: [Errno -2] Name or service not known                                                                                                                                │
netbox-1  | [ Use DB_WAIT_DEBUG=1 in netbox.env to print full traceback for errors here ]                                                                                                                         │
netbox-1  | ⏳ Waiting on DB... (27s / 30s)                                                                                                                                                                       │
netbox-1  | ❌ Waited 30s or more for the DB to become ready.

Content of docker-compose.override.yml

services:
  netbox:
    ports:
      - "83:8080"
    restart: unless-stopped
    environment:
      ALLOWED_HOSTS: "*"
      CSRF_TRUSTED_ORIGINS: https://netbox.***.de http://10.0.0.19:83
      DEBUG: false
    # If you want the Nginx unit status page visible from the
    # outside of the container add the following port mapping:
    # - "8001:8081"
    # healthcheck:
      # Time for which the health check can fail after the container is started.
      # This depends mostly on the performance of your database. On the first start,
      # when all tables need to be created the start_period should be higher than on
      # subsequent starts. For the first start after major version upgrades of NetBox
      # the start_period might also need to be set higher.
      # Default value in our docker-compose.yml is 60s
      # start_period: 90s
    # environment:
      # SKIP_SUPERUSER: "false"
      # SUPERUSER_API_TOKEN: ""
      # SUPERUSER_EMAIL: ""
      # SUPERUSER_NAME: ""
      # SUPERUSER_PASSWORD: ""

[melectronics-it]

PS: I have shortened the netbox log (I have deleted all the HTTP etc. querys)

[tobiasge]

The NetBox logs only show that it couldn't connect to the database. The PoreSQL will have the interesting information, but they seem incomplete. From what version did you upgrade? Was there a major version change with the database?

[melectronics-it]

Hello, thanks for the answer (GitHub don´t notify me (I don´t know why)):
It was from 4.4.2 (I think) to 4.4.3. (No, that don´t make sense because 4.4.3 was published 2025-10-14 and I have updated on 2025-10-11. Maybe I have updated from 4.3.x I think) So I don´t assume that there was a database change(?)
And the postgres log is complete, but more isn´t logged there...

[melectronics-it]

@tobiasge Have you some other ideas what can be the issue here?

[melectronics-it]

I have updated yesterday to the newest version of netbox-docker and the error still exists
These are the log messages from the postgresql container:

postgres-1  | 2025-11-15 00:00:04.159 UTC [1] LOG:  received fast shutdown request
postgres-1  | 2025-11-15 00:00:04.164 UTC [1] LOG:  aborting any active transactions
postgres-1  | 2025-11-15 00:00:04.164 UTC [18352] FATAL:  terminating connection due to administrator command
postgres-1  | 2025-11-15 00:00:04.173 UTC [1] LOG:  background worker "logical replication launcher" (PID 32) exited with exit code 1
postgres-1  | 2025-11-15 00:00:04.170 UTC [18278] FATAL:  terminating connection due to administrator command
postgres-1  | 2025-11-15 00:00:04.297 UTC [27] LOG:  shutting down
postgres-1  | 2025-11-15 00:00:04.305 UTC [27] LOG:  checkpoint starting: shutdown immediate
postgres-1  | 2025-11-15 00:00:04.339 UTC [27] LOG:  checkpoint complete: wrote 0 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.002 s, sync=0.001 s, total=0.042 s; sync
 files=0, longest=0.000 s, average=0.000 s; distance=0 kB, estimate=165 kB; lsn=0/49ECC10, redo lsn=0/49ECC10
postgres-1  | 2025-11-15 00:00:04.404 UTC [1] LOG:  database system is shut down

There is something about "administrator command" but I don´t stop the postgresql with a command or do anything else.