Solusi Docker LIMITS spawning Operation not permitted

Di beberapa docker node yang saya gunakan, docker tidak bisa dijalankan. Error yang paling jelas di service docker adalah LIMITS spawning Operation not permitted

Apr 09 17:08:52 docker-server systemd[1]: Starting Docker Socket for the API.
Apr 09 17:08:52 docker-server systemd[1630]: containerd.service: Failed at step LIMITS spawning /sbin/modprobe: Operation not permitted
Apr 09 17:08:52 docker-server systemd[1]: Started containerd container runtime.
Apr 09 17:08:52 docker-server systemd[1]: Listening on Docker Socket for the API.
Apr 09 17:08:52 docker-server systemd[1]: Starting Docker Application Container Engine...
Apr 09 17:08:52 docker-server systemd[1634]: containerd.service: Failed at step LIMITS spawning /usr/bin/containerd: Operation not permitted
Apr 09 17:08:52 docker-server systemd[1636]: docker.service: Failed at step LIMITS spawning /usr/bin/dockerd: Operation not permitted
Apr 09 17:08:52 docker-server systemd[1]: containerd.service: Main process exited, code=exited, status=205/LIMITS
 
> systemctl status containerd.service
● containerd.service - containerd container runtime
   Loaded: loaded (/lib/systemd/system/containerd.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Thu 2020-04-09 17:08:54 WIB; 2min 47s ago
     Docs: https://containerd.io
  Process: 1656 ExecStart=/usr/bin/containerd (code=exited, status=205/LIMITS)
  Process: 1653 ExecStartPre=/sbin/modprobe overlay (code=exited, status=205/LIMITS)
 Main PID: 1656 (code=exited, status=205/LIMITS)
      CPU: 857us
 
Apr 09 17:08:54 docker-server systemd[1]: Starting containerd container runtime...
Apr 09 17:08:54 docker-server systemd[1]: Started containerd container runtime.
Apr 09 17:08:54 docker-server systemd[1]: containerd.service: Main process exited, code=exited, status=
Apr 09 17:08:54 docker-server systemd[1]: containerd.service: Unit entered failed state.
Apr 09 17:08:54 docker-server systemd[1]: containerd.service: Failed with result 'exit-code'.
 
> systemctl status docker
● docker.service - Docker Application Container Engine
   Loaded: loaded (/lib/systemd/system/docker.service; enabled; vendor preset: enabled)
   Active: inactive (dead) (Result: exit-code) since Thu 2020-04-09 15:13:47 WIB; 9s ago
     Docs: https://docs.docker.com
  Process: 1279 ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock (code=exited, status=205/LIMITS)
 Main PID: 1279 (code=exited, status=205/LIMITS)
      CPU: 444us
 
Apr 09 15:13:47 docker-server systemd[1]: Failed to start Docker Application Container Engine.
Apr 09 15:13:47 docker-server systemd[1]: docker.service: Unit entered failed state.
Apr 09 15:13:47 docker-server systemd[1]: docker.service: Failed with result 'exit-code'.
Apr 09 15:13:47 docker-server systemd[1]: Stopped Docker Application Container Engine.
 
 
Apr 09 17:13:25 docker-server systemd[1]: docker.service: Start request repeated too quickly.
Apr 09 17:13:25 docker-server systemd[1]: Failed to start Docker Application Container Engine.
Apr 09 17:13:25 docker-server systemd[1]: docker.service: Unit entered failed state.
Apr 09 17:13:25 docker-server systemd[1]: docker.service: Failed with result 'exit-code'.

Beberapa hal yang perlu di cek, bila terjadi masalah seperti ini:
– Check Limit open files dkk dengan perintah ulimit -a
– Check LimitNOFILE di services aplikasi yang gagal.
– Check /etc/security/limits.conf
– Check /etc/sysctl.conf

Dari log diatas, ada dua services yang gagal jalan, yaitu containerd.service dan docker.service. Output dari ulimit -a

> ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 3892
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 550000
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 3892
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

sementara bila dilihat di /lib/systemd/system/containerd.service ada LimitNOFILE=1048576 dan /lib/systemd/system/docker.service, LimitNOFILE=infinityangka tersebut diatas maksimum limit yang diijikan oleh sistem sebesar 550000.

Solusi 1

Ganti nilai LimitNOFILE di containerd.service dan docker.service menjadi 550000 atau lebih kecil, sesuai dengan batas maksimum open files.
Setelah merubah file .service diatas, reload daemon systemctl

systemctl daemon-reload

lalu jalankan satu persatu servicenya

systemctl start containerd
systemctl start docker

Solusi 2

Hapus limit tersebut dari file /etc/security/limits.conf dan/atau /etc/sysctl.conf. Lalu reboot system anda

Solusi 1

Solusi 2

Tulisan menarik lainnya

Reader Interactions

Leave a Reply Cancel reply