Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Without container info after host reboot. #3531

Open
hidakafinzelz opened this issue May 23, 2024 · 0 comments
Open

Without container info after host reboot. #3531

hidakafinzelz opened this issue May 23, 2024 · 0 comments

Comments

@hidakafinzelz
Copy link

hidakafinzelz commented May 23, 2024

My host was reboot for somereson, and then cadvisor container restart. But when I get the metrics from api. it get lots of value without container info like tag name

docker info

Client:
Debug Mode: false
Server:
Containers: 30
Running: 30
Paused: 0
Stopped: 0
Images: 71
Server Version: 19.03.15
Storage Driver: overlay2
Backing Filesystem: f2fs
Supports d_type: true
Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 269548fa27e0089a8b8278fc4fc781d7f65a939b
runc version: ff819c7e9184c13b7c2607fe6c30ae19403a7aff
init version: fec3683
Security Options:
seccomp
Profile: default
Kernel Version: 4.4.194-g58370c8ad45d
Operating System: Ubuntu 20.04.1 LTS
OSType: linux
Architecture: aarch64
CPUs: 6
Total Memory: 3.756GiB
ID: ZHZJ:IVGI:45GF:QJJN:C3D3:FHWZ:O6LO:J7V7:VN5X:PMSY:ZXIP:SIKP
Docker Root Dir: /home/mydocker/docker
Debug Mode: false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false

`

cadvisor image
`

version: "3"
services:
cadvisor:
image: {{ .Values.image }}
container_name: {{ .Values.name }}
ports:
- 18081:8080
privileged: true
restart: always
volumes:
- /:/rootfs:ro
- /var/run:/var/run:rw
- /sys:/sys:ro
- /var/lib/docker/:/var/lib/docker:ro

zcube/cadvisor:v0.39.3
`

host
uname -a Linux 4.4.194-g58370c8ad45d #81 SMP Sat May 6 16:21:52 CST 2023 aarch64 aarch64 aarch64 GNU/Linux

metircs
`
container_fs_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-40",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-41",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-42",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-43",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-44",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-45",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-46",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-47",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-48",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-49",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-50",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-51",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-52",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-53",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-54",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-55",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-56",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-57",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-58",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-59",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-60",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-61",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-62",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-63",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-64",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-65",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-66",id="/"} 0 1716432781348
container_fs_reads_total{device="overlay_0-67",id="/"} 0 1716432781348

HELP container_fs_sector_reads_total Cumulative count of sector reads completed

TYPE container_fs_sector_reads_total counter

container_fs_sector_reads_total{device="/dev",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/dev/sda1",id="/"} 963712 1716432781348
container_fs_sector_reads_total{device="/dev/shm",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/dev/shm",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev/shm",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/run",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/run/lock",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/run/user/1000",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/run/user/112",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/sys/fs/cgroup",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/rootfs/tmp",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/run",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/run/lock",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/run/user/1000",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/run/user/112",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/sys/fs/cgroup",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev/shm",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/dev/shm",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev/shm",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/run",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/run/lock",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/run/user/1000",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/run/user/112",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/sys/fs/cgroup",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/tmp",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/run",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/run/lock",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/run/user/1000",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/run/user/112",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-40",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-41",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-42",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-43",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-44",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-45",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-46",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-47",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-48",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-49",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-50",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-51",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-52",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-53",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-54",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-55",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-56",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-57",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-58",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-59",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-60",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-61",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-62",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-63",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-64",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-65",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-66",id="/"} 0 1716432781348
container_fs_sector_reads_total{device="overlay_0-67",id="/"} 0 1716432781348

HELP container_fs_sector_writes_total Cumulative count of sector writes completed

TYPE container_fs_sector_writes_total counter

container_fs_sector_writes_total{device="/dev",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/dev/sda1",id="/"} 570376 1716432781348
container_fs_sector_writes_total{device="/dev/shm",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/dev/shm",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev/shm",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/run",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/run/lock",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/run/user/1000",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/run/user/112",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/sys/fs/cgroup",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/rootfs/tmp",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/run",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/run/lock",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/run/user/1000",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/run/user/112",id="/"} 0 1716432781348
container_fs_sector_writes_total{device="/sys/fs/cgroup",id="/"} 0 1716432781348
`
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant