File System Summary =================== Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 832K 1.2G 1% /run /dev/sda1 39G 3.6G 36G 10% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/sda15 105M 3.6M 101M 4% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 0.8 0.0 225560 9540 ? Ss 14:56:05 00:00:17 /lib/systemd/systemd --system --deserialize 34 root 0 2 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [kthreadd] root 2 4 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kworker/0:0H] root 2 6 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [mm_percpu_wq] root 2 7 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [ksoftirqd/0] root 2 8 0.0 0.0 0 0 ? I 14:56:05 00:00:01 [rcu_sched] root 2 9 0.0 0.0 0 0 ? I 14:56:05 00:00:00 [rcu_bh] root 2 10 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [migration/0] root 2 11 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [watchdog/0] root 2 12 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [cpuhp/0] root 2 13 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [cpuhp/1] root 2 14 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [watchdog/1] root 2 15 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [migration/1] root 2 16 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [ksoftirqd/1] root 2 18 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kworker/1:0H] root 2 19 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [cpuhp/2] root 2 20 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [watchdog/2] root 2 21 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [migration/2] root 2 22 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [ksoftirqd/2] root 2 24 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kworker/2:0H] root 2 25 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [cpuhp/3] root 2 26 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [watchdog/3] root 2 27 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [migration/3] root 2 28 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [ksoftirqd/3] root 2 30 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kworker/3:0H] root 2 31 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [kdevtmpfs] root 2 32 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [netns] root 2 33 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [rcu_tasks_kthre] root 2 34 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [kauditd] root 2 38 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [khungtaskd] root 2 39 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [oom_reaper] root 2 40 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [writeback] root 2 41 0.0 0.0 0 0 ? S 14:56:05 00:00:00 [kcompactd0] root 2 42 0.0 0.0 0 0 ? SN 14:56:05 00:00:00 [ksmd] root 2 43 0.0 0.0 0 0 ? SN 14:56:05 00:00:00 [khugepaged] root 2 44 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [crypto] root 2 45 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kintegrityd] root 2 46 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [kblockd] root 2 47 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [ata_sff] root 2 48 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [md] root 2 49 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [edac-poller] root 2 50 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [devfreq_wq] root 2 51 0.0 0.0 0 0 ? I< 14:56:05 00:00:00 [watchdogd] root 2 52 0.0 0.0 0 0 ? I 14:56:06 00:00:00 [kworker/u256:1] root 2 54 0.0 0.0 0 0 ? S 14:56:06 00:00:00 [kswapd0] root 2 55 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [kworker/u257:0] root 2 56 0.0 0.0 0 0 ? S 14:56:06 00:00:00 [ecryptfs-kthrea] root 2 98 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [kthrotld] root 2 99 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [acpi_thermal_pm] root 2 100 0.0 0.0 0 0 ? S 14:56:06 00:00:00 [scsi_eh_0] root 2 101 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [scsi_tmf_0] root 2 102 0.0 0.0 0 0 ? S 14:56:06 00:00:00 [scsi_eh_1] root 2 103 0.0 0.0 0 0 ? I< 14:56:06 00:00:00 [scsi_tmf_1] root 2 104 0.0 0.0 0 0 ? I 14:56:06 00:00:01 [kworker/u256:2] root 2 111 0.0 0.0 0 0 ? I< 14:56:07 00:00:00 [ipv6_addrconf] root 2 120 0.0 0.0 0 0 ? I< 14:56:07 00:00:00 [kstrp] root 2 137 0.0 0.0 0 0 ? I< 14:56:07 00:00:00 [charger_manager] root 2 184 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [hv_vmbus_con] root 2 185 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [hv_pri_chan] root 2 186 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [hv_sub_chan] root 2 220 0.0 0.0 0 0 ? S 14:56:08 00:00:00 [scsi_eh_2] root 2 223 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [scsi_tmf_2] root 2 224 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [storvsc_error_w] root 2 225 0.0 0.0 0 0 ? S 14:56:08 00:00:00 [scsi_eh_3] root 2 227 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [scsi_tmf_3] root 2 228 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [storvsc_error_w] root 2 230 0.0 0.0 0 0 ? I< 14:56:08 00:00:00 [kworker/0:1H] root 2 304 0.0 0.0 0 0 ? I< 14:56:10 00:00:00 [raid5wq] root 2 336 0.0 0.0 0 0 ? I< 14:56:10 00:00:00 [kworker/3:1H] root 2 352 0.0 0.0 0 0 ? S 14:56:10 00:00:01 [jbd2/sda1-8] root 2 353 0.0 0.0 0 0 ? I< 14:56:10 00:00:00 [ext4-rsv-conver] root 2 402 0.0 0.0 0 0 ? I< 14:56:11 00:00:00 [kworker/2:1H] root 2 413 0.0 0.0 0 0 ? I< 14:56:11 00:00:00 [kworker/1:1H] root 2 432 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [iscsi_eh] root 2 438 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [ib-comp-wq] root 2 439 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [ib_mcast] root 2 440 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [ib_nl_sa_wq] root 2 445 0.0 0.0 0 0 ? I< 14:56:12 00:00:00 [rdma_cm] root 1 450 0.0 0.0 44576 5580 ? Ss 14:56:12 00:00:01 /lib/systemd/systemd-udevd root 2 491 0.0 0.0 0 0 ? S 14:56:13 00:00:00 [hv_balloon] root 2 847 0.0 0.0 0 0 ? I 14:56:17 00:00:00 [kworker/2:2] root 1 1027 0.0 0.0 288260 7160 ? Ssl 14:56:22 00:00:00 /usr/lib/accountsservice/accounts-daemon root 1 1035 0.0 0.0 31748 3204 ? Ss 14:56:22 00:00:00 /usr/sbin/cron -f root 1 1064 0.0 0.0 70588 6156 ? Ss 14:56:22 00:00:01 /lib/systemd/systemd-logind root 1 1072 0.0 0.1 170880 17436 ? Ssl 14:56:22 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers message+ 1 1080 0.1 0.0 50296 4788 ? Ss 14:56:22 00:00:03 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only daemon 1 1108 0.0 0.0 28332 2232 ? Ss 14:56:23 00:00:00 /usr/sbin/atd -f root 1 1109 0.0 0.0 161076 1612 ? Ssl 14:56:23 00:00:00 /usr/bin/lxcfs /var/lib/lxcfs/ root 1 1137 0.0 0.0 110412 2080 ? Ssl 14:56:23 00:00:00 /usr/sbin/irqbalance --foreground root 1 1212 0.0 0.0 291480 7384 ? Ssl 14:56:23 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 1214 0.0 0.1 187720 20376 ? Ssl 14:56:23 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 1246 0.0 0.0 16412 2280 ttyS0 Ss+ 14:56:23 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 1290 0.0 0.0 14888 1908 tty1 Ss+ 14:56:23 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 1448 0.0 0.0 72296 5572 ? Ss 14:56:25 00:00:00 /usr/sbin/sshd -D root 1448 1740 0.0 0.0 107984 7176 ? Ss 15:01:06 00:00:00 sshd: ubuntu [priv] ubuntu 1 1742 0.0 0.0 76636 7180 ? Ss 15:01:06 00:00:00 /lib/systemd/systemd --user ubuntu 1742 1743 0.0 0.0 259252 2452 ? S 15:01:06 00:00:00 (sd-pam) ubuntu 1740 1818 0.0 0.0 108416 5196 ? S 15:01:07 00:00:00 sshd: ubuntu@pts/0 root 1 6377 0.2 0.0 78564 12272 ? S /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 root 1 29777 0.0 0.0 34000 2796 ? Ss 15:13:26 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf root 2 32793 0.0 0.0 0 0 ? I 15:31:28 00:00:00 [kworker/3:0] root 2 32795 0.0 0.0 0 0 ? I 15:31:28 00:00:00 [kworker/3:3] root 2 32800 0.0 0.0 0 0 ? I 15:31:28 00:00:00 [kworker/3:4] root 2 32801 0.0 0.0 0 0 ? I 15:31:28 00:00:00 [kworker/3:5] root 2 32802 0.0 0.0 0 0 ? I 15:31:28 00:00:00 [kworker/3:6] root 2 32803 0.0 0.0 0 0 ? I 15:31:28 00:00:00 [kworker/3:7] ubuntu 29455 32949 3.0 0.0 19220 9648 pts/0 S+ 15:31:28 00:00:00 bash ./stack.sh syslog 1 34460 0.0 0.0 263040 4084 ? Ssl 15:13:45 00:00:00 /usr/sbin/rsyslogd -n ubuntu 32949 35677 0.0 0.0 15224 4056 pts/0 S+ 15:31:35 00:00:00 bash ./stack.sh ubuntu 32949 35682 0.0 0.0 15224 4056 pts/0 S+ 15:31:35 00:00:00 bash ./stack.sh ubuntu 35677 35683 0.9 0.0 29644 10824 pts/0 S+ 15:31:35 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2020-11-30-153135 ubuntu 35682 35690 0.4 0.0 29644 10892 pts/0 S+ 15:31:35 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2020-11-30-153135.summary.2020-11-30-153135 rabbitmq 1 38767 0.0 0.0 4636 876 ? Ss 15:15:52 00:00:00 /bin/sh /usr/sbin/rabbitmq-server rabbitmq 38767 38778 1.0 0.4 3226556 60084 ? Sl 15:15:52 00:00:09 /usr/lib/erlang/erts-9.2/bin/beam.smp -W w -A 64 -P 1048576 -t 5000000 -stbt db -zdbbl 32000 -K true -- -root /usr/lib/erlang -progname erl -- -home /var/lib/rabbitmq -- -pa /usr/lib/rabbitmq/lib/rabbitmq_server-3.6.10/ebin -noshell -noinput -s rabbit boot -sname rabbit@n-d-764626-2 -boot start_sasl -kernel inet_default_connect_options [{nodelay,true}] -sasl errlog_type error -sasl sasl_error_logger false -rabbit error_logger {file,"/var/log/rabbitmq/rabbit@n-d-764626-2.log"} -rabbit sasl_error_logger {file,"/var/log/rabbitmq/rabbit@n-d-764626-2-sasl.log"} -rabbit enabled_plugins_file "/etc/rabbitmq/enabled_plugins" -rabbit plugins_dir "/usr/lib/rabbitmq/plugins:/usr/lib/rabbitmq/lib/rabbitmq_server-3.6.10/plugins" -rabbit plugins_expand_dir "/var/lib/rabbitmq/mnesia/rabbit@n-d-764626-2-plugins-expand" -os_mon start_cpu_sup false -os_mon start_disksup false -os_mon start_memsup false -mnesia dir "/var/lib/rabbitmq/mnesia/rabbit@n-d-764626-2" -kernel inet_dist_listen_min 25672 -kernel inet_dist_listen_max 25672 ubuntu 32949 38816 0.0 0.0 38776 12092 pts/0 S+ 15:31:50 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/worlddump.py -d /opt/stack/logs ubuntu 38816 38819 0.0 0.0 4636 820 pts/0 S+ 15:31:50 00:00:00 /bin/sh -c ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args ubuntu 38819 38820 0.0 0.0 38376 3684 pts/0 R+ 15:31:50 00:00:00 ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args rabbitmq 1 38856 0.0 0.0 26860 204 ? S 15:15:52 00:00:00 /usr/lib/erlang/erts-9.2/bin/epmd -daemon rabbitmq 38778 39008 0.0 0.0 4528 1540 ? Ss 15:15:52 00:00:00 erl_child_setup 65536 rabbitmq 39008 39035 0.0 0.0 8272 1168 ? Ss 15:15:56 00:00:00 inet_gethost 4 rabbitmq 39035 39036 0.0 0.0 10392 1704 ? S 15:15:56 00:00:00 inet_gethost 4 mysql 1 41145 0.0 1.4 1356796 177844 ? Sl 15:16:28 00:00:00 /usr/sbin/mysqld --daemonize --pid-file=/run/mysqld/mysqld.pid root 2 81762 0.0 0.0 0 0 ? I 15:22:21 00:00:00 [kworker/2:0] root 2 81764 0.0 0.0 0 0 ? I 15:22:21 00:00:00 [kworker/2:3] root 2 89509 0.0 0.0 0 0 ? I 15:23:43 00:00:00 [kworker/3:1] root 2 89510 0.0 0.0 0 0 ? I 15:23:43 00:00:00 [kworker/3:2] root 2 102487 0.0 0.0 0 0 ? I 15:24:45 00:00:00 [kworker/1:0] root 2 115399 0.0 0.0 0 0 ? I 15:25:33 00:00:00 [kworker/0:0] root 2 115400 0.0 0.0 0 0 ? I 15:25:33 00:00:00 [kworker/0:3] root 2 129867 0.0 0.0 0 0 ? I 15:28:15 00:00:00 [kworker/2:1] root 2 129868 0.0 0.0 0 0 ? I 15:28:15 00:00:00 [kworker/2:6] root 2 129869 0.0 0.0 0 0 ? I 15:28:15 00:00:00 [kworker/2:7] Network Dump ============ bridge link ----------- ip link show type bridge ------------------------ ip neigh -------- 10.222.0.1 dev eth0 lladdr 38:ea:a7:34:d4:dc REACHABLE 192.168.0.12 dev eth1 lladdr fa:16:3e:5d:de:df STALE 10.222.0.12 dev eth0 lladdr fa:16:3e:5d:de:df STALE ip addr ------- 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:89:b8:f6 brd ff:ff:ff:ff:ff:ff inet 10.222.0.41/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 85262sec preferred_lft 85262sec inet6 fe80::f816:3eff:fe89:b8f6/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:5c:44:01 brd ff:ff:ff:ff:ff:ff inet 192.168.0.39/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 85262sec preferred_lft 85262sec inet6 fe80::f816:3eff:fe5c:4401/64 scope link valid_lft forever preferred_lft forever ip link ------- 1: lo: mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2: eth0: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether fa:16:3e:89:b8:f6 brd ff:ff:ff:ff:ff:ff 3: eth1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether fa:16:3e:5c:44:01 brd ff:ff:ff:ff:ff:ff ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.41 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.41 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.39 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.39 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.41 metric 100 ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- 583eb8f7-908d-40d6-bbb6-5f1e5984c03f ovs_version: "2.12.1" IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 91307 packets, 309M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 56479 packets, 3313K bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 92662 packets, 309M bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 91305 packets, 309M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 56479 packets, 3313K bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 56479 packets, 3313K bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT sudo ebtables -t broute -L -------------------------- Bridge table: broute Bridge chain: BROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running