File System Summary =================== Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 868K 1.2G 1% /run /dev/sda1 39G 4.1G 35G 11% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/sda15 105M 3.6M 101M 4% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 tmpfs 512M 123M 390M 24% /opt/stack/data/etcd /dev/loop0 6.0G 36M 6.0G 1% /opt/stack/data/swift/drives/sdb1 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 0.5 0.0 225568 9492 ? Ss 21:09:57 00:00:24 /lib/systemd/systemd --system --deserialize 34 root 0 2 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [kthreadd] root 2 4 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [kworker/0:0H] root 2 6 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [mm_percpu_wq] root 2 7 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [ksoftirqd/0] root 2 8 0.1 0.0 0 0 ? I 21:09:57 00:00:06 [rcu_sched] root 2 9 0.0 0.0 0 0 ? I 21:09:57 00:00:00 [rcu_bh] root 2 10 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [migration/0] root 2 11 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [watchdog/0] root 2 12 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [cpuhp/0] root 2 13 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [cpuhp/1] root 2 14 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [watchdog/1] root 2 15 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [migration/1] root 2 16 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [ksoftirqd/1] root 2 18 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [kworker/1:0H] root 2 19 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [cpuhp/2] root 2 20 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [watchdog/2] root 2 21 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [migration/2] root 2 22 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [ksoftirqd/2] root 2 24 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [kworker/2:0H] root 2 25 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [cpuhp/3] root 2 26 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [watchdog/3] root 2 27 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [migration/3] root 2 28 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [ksoftirqd/3] root 2 30 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [kworker/3:0H] root 2 31 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [kdevtmpfs] root 2 32 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [netns] root 2 33 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [rcu_tasks_kthre] root 2 34 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [kauditd] root 2 38 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [khungtaskd] root 2 39 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [oom_reaper] root 2 40 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [writeback] root 2 41 0.0 0.0 0 0 ? S 21:09:57 00:00:00 [kcompactd0] root 2 42 0.0 0.0 0 0 ? SN 21:09:57 00:00:00 [ksmd] root 2 43 0.0 0.0 0 0 ? SN 21:09:57 00:00:00 [khugepaged] root 2 44 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [crypto] root 2 45 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [kintegrityd] root 2 46 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [kblockd] root 2 47 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [ata_sff] root 2 48 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [md] root 2 49 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [edac-poller] root 2 50 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [devfreq_wq] root 2 51 0.0 0.0 0 0 ? I< 21:09:57 00:00:00 [watchdogd] root 2 55 0.0 0.0 0 0 ? S 21:09:58 00:00:00 [kswapd0] root 2 56 0.0 0.0 0 0 ? I< 21:09:58 00:00:00 [kworker/u257:0] root 2 57 0.0 0.0 0 0 ? S 21:09:58 00:00:00 [ecryptfs-kthrea] root 2 99 0.0 0.0 0 0 ? I< 21:09:58 00:00:00 [kthrotld] root 2 100 0.0 0.0 0 0 ? I< 21:09:58 00:00:00 [acpi_thermal_pm] root 2 101 0.0 0.0 0 0 ? S 21:09:58 00:00:00 [scsi_eh_0] root 2 102 0.0 0.0 0 0 ? I< 21:09:58 00:00:00 [scsi_tmf_0] root 2 103 0.0 0.0 0 0 ? S 21:09:58 00:00:00 [scsi_eh_1] root 2 104 0.0 0.0 0 0 ? I< 21:09:58 00:00:00 [scsi_tmf_1] root 2 111 0.0 0.0 0 0 ? I< 21:09:59 00:00:00 [ipv6_addrconf] root 2 120 0.0 0.0 0 0 ? I< 21:09:59 00:00:00 [kstrp] root 2 137 0.0 0.0 0 0 ? I< 21:10:00 00:00:00 [charger_manager] root 2 199 0.0 0.0 0 0 ? I< 21:10:01 00:00:00 [hv_vmbus_con] root 2 200 0.0 0.0 0 0 ? I< 21:10:01 00:00:00 [hv_pri_chan] root 2 201 0.0 0.0 0 0 ? I< 21:10:01 00:00:00 [hv_sub_chan] root 2 236 0.0 0.0 0 0 ? S 21:10:01 00:00:00 [scsi_eh_2] root 2 237 0.0 0.0 0 0 ? I< 21:10:01 00:00:00 [scsi_tmf_2] root 2 238 0.0 0.0 0 0 ? I< 21:10:01 00:00:00 [storvsc_error_w] root 2 240 0.0 0.0 0 0 ? S 21:10:01 00:00:00 [scsi_eh_3] root 2 241 0.0 0.0 0 0 ? I< 21:10:01 00:00:00 [scsi_tmf_3] root 2 242 0.0 0.0 0 0 ? I< 21:10:01 00:00:00 [storvsc_error_w] root 2 244 0.0 0.0 0 0 ? I< 21:10:02 00:00:02 [kworker/0:1H] root 2 317 0.0 0.0 0 0 ? I< 21:10:04 00:00:00 [raid5wq] root 2 350 0.0 0.0 0 0 ? I< 21:10:04 00:00:00 [kworker/3:1H] root 2 366 0.1 0.0 0 0 ? S 21:10:04 00:00:07 [jbd2/sda1-8] root 2 367 0.0 0.0 0 0 ? I< 21:10:04 00:00:00 [ext4-rsv-conver] root 2 416 0.0 0.0 0 0 ? I< 21:10:05 00:00:00 [kworker/2:1H] root 2 417 0.0 0.0 0 0 ? I< 21:10:05 00:00:00 [kworker/1:1H] root 2 441 0.0 0.0 0 0 ? I< 21:10:06 00:00:00 [iscsi_eh] root 2 448 0.0 0.0 0 0 ? I< 21:10:06 00:00:00 [ib-comp-wq] root 2 449 0.0 0.0 0 0 ? I< 21:10:06 00:00:00 [ib_mcast] root 2 450 0.0 0.0 0 0 ? I< 21:10:06 00:00:00 [ib_nl_sa_wq] root 2 453 0.0 0.0 0 0 ? I< 21:10:06 00:00:00 [rdma_cm] root 1 457 0.0 0.0 43920 5008 ? Ss 21:10:06 00:00:03 /lib/systemd/systemd-udevd root 2 481 0.0 0.0 0 0 ? S 21:10:07 00:00:00 [hv_balloon] root 1 973 0.0 0.0 288092 6948 ? Ssl 21:10:17 00:00:01 /usr/lib/accountsservice/accounts-daemon daemon 1 978 0.0 0.0 28332 2396 ? Ss 21:10:17 00:00:00 /usr/sbin/atd -f root 1 1006 0.0 0.0 31748 3160 ? Ss 21:10:17 00:00:00 /usr/sbin/cron -f root 1 1014 0.0 0.0 70584 6248 ? Ss 21:10:17 00:00:02 /lib/systemd/systemd-logind root 1 1026 0.0 0.1 170880 17340 ? Ssl 21:10:17 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers message+ 1 1040 0.1 0.0 50328 4732 ? Ss 21:10:17 00:00:04 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 1080 0.0 0.1 187720 20316 ? Ssl 21:10:18 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 1111 0.0 0.0 110412 2068 ? Ssl 21:10:18 00:00:00 /usr/sbin/irqbalance --foreground root 1 1113 0.0 0.0 161076 1612 ? Ssl 21:10:18 00:00:00 /usr/bin/lxcfs /var/lib/lxcfs/ root 1 1192 0.0 0.0 291480 7268 ? Ssl 21:10:18 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 1230 0.0 0.0 16412 2276 ttyS0 Ss+ 21:10:19 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 1253 0.0 0.0 14888 1916 tty1 Ss+ 21:10:19 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 1377 0.0 0.0 72296 5668 ? Ss 21:10:20 00:00:00 /usr/sbin/sshd -D root 1377 1688 0.0 0.0 107984 7184 ? Ss 21:18:07 00:00:00 sshd: ubuntu [priv] ubuntu 1 1690 0.0 0.0 76760 7656 ? Ss 21:18:07 00:00:00 /lib/systemd/systemd --user ubuntu 1690 1691 0.0 0.0 259244 2448 ? S 21:18:07 00:00:00 (sd-pam) ubuntu 1688 1766 0.0 0.0 108404 5464 ? S 21:18:08 00:00:00 sshd: ubuntu@pts/0 root 1 2127 0.0 0.0 33608 4720 ? S /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 root 2 121885 0.0 0.0 0 0 ? I 22:07:20 00:00:00 [kworker/u256:3] root 2 121905 0.0 0.0 0 0 ? I 22:07:20 00:00:00 [kworker/3:3] root 2 121919 0.0 0.0 0 0 ? I 22:07:21 00:00:00 [kworker/2:3] root 2 123226 0.0 0.0 0 0 ? I 22:07:28 00:00:00 [kworker/0:2] ubuntu 119449 123368 0.8 0.0 19316 9676 pts/0 S+ 22:07:28 00:00:08 bash ./stack.sh ubuntu 123368 125578 0.0 0.0 15212 3592 pts/0 S+ 22:07:32 00:00:00 bash ./stack.sh ubuntu 123368 125583 0.0 0.0 15212 3720 pts/0 S+ 22:07:32 00:00:00 bash ./stack.sh ubuntu 125578 125584 0.2 0.0 29740 10912 pts/0 S+ 22:07:32 00:00:02 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2020-10-29-220732 ubuntu 125583 125589 0.0 0.0 29608 10888 pts/0 S+ 22:07:32 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2020-10-29-220732.summary.2020-10-29-220732 root 1 130524 0.4 0.4 163824 59888 ? S mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:a2:29:d2 brd ff:ff:ff:ff:ff:ff inet 10.222.0.111/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 83117sec preferred_lft 83117sec inet6 fe80::f816:3eff:fea2:29d2/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000 link/ether fa:16:3e:03:6e:c5 brd ff:ff:ff:ff:ff:ff inet6 fe80::f816:3eff:fe03:6ec5/64 scope link valid_lft forever preferred_lft forever 10: ovs-system: mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether 96:68:67:e3:21:61 brd ff:ff:ff:ff:ff:ff 11: br-int: mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether 02:a9:ba:0c:37:4f brd ff:ff:ff:ff:ff:ff 12: br-data: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether 5a:f5:1c:02:fd:47 brd ff:ff:ff:ff:ff:ff inet 192.168.0.108/22 brd 192.168.3.255 scope global br-data valid_lft forever preferred_lft forever inet6 fe80::58f5:1cff:fe02:fd47/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.111 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.111 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.111 metric 100 192.168.0.0/22 dev br-data proto kernel scope link src 192.168.0.108 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.111 metric 100 ip -6 route ----------- fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium fe80::/64 dev br-data proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- d297eefe-8713-4055-a18d-409fddebbcb3 Manager "ptcp:6640:127.0.0.1" Bridge br-data Port "eth1" Interface "eth1" Port br-data Interface br-data type: internal Bridge br-int Port br-int Interface br-int type: internal ovs_version: "2.12.1" sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-data --------------------------------------------------------------------------------------------------------- OFPT_FEATURES_REPLY (OF1.5) (xid=0x2): dpid:00005af51c02fd47 n_tables:254, n_buffers:0 capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES OFPST_PORT_DESC reply (OF1.5) (xid=0x3): 1(eth1): addr:fa:16:3e:03:6e:c5 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-data): addr:5a:f5:1c:02:fd:47 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max OFPT_GET_CONFIG_REPLY (OF1.5) (xid=0x5): frags=normal miss_send_len=0 sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-int -------------------------------------------------------------------------------------------------------- OFPT_FEATURES_REPLY (OF1.5) (xid=0x2): dpid:000002a9ba0c374f n_tables:254, n_buffers:0 capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES OFPST_PORT_DESC reply (OF1.5) (xid=0x3): LOCAL(br-int): addr:02:a9:ba:0c:37:4f config: PORT_DOWN state: LINK_DOWN speed: 0 Mbps now, 0 Mbps max OFPT_GET_CONFIG_REPLY (OF1.5) (xid=0x5): frags=normal miss_send_len=0 sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-data -------------------------------------------------------------------------------------------------------------------- OFPST_PORT_DESC reply (OF1.5) (xid=0x2): 1(eth1): addr:fa:16:3e:03:6e:c5 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-data): addr:5a:f5:1c:02:fd:47 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-int ------------------------------------------------------------------------------------------------------------------- OFPST_PORT_DESC reply (OF1.5) (xid=0x2): LOCAL(br-int): addr:02:a9:ba:0c:37:4f config: PORT_DOWN state: LINK_DOWN speed: 0 Mbps now, 0 Mbps max sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-data --------------------------------------------------------------------------------------------------------------- OFPST_PORT reply (OF1.5) (xid=0x2): 2 ports port LOCAL: rx pkts=160, bytes=23529, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=13, bytes=922, drop=0, errs=0, coll=0 duration=109.591s port 1: rx pkts=20680, bytes=2532905, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=74, bytes=6156, drop=0, errs=0, coll=0 duration=105.388s sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-int -------------------------------------------------------------------------------------------------------------- OFPST_PORT reply (OF1.5) (xid=0x2): 1 ports port LOCAL: rx pkts=0, bytes=0, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=0, bytes=0, drop=0, errs=0, coll=0 duration=109.902s sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-data --------------------------------------------------------------------------------------------------------------- OFPST_FLOW reply (OF1.5) (xid=0x2): cookie=0x0, duration=109.621s, table=0, n_packets=172, n_bytes=26536, idle_age=0, priority=0 actions=NORMAL sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-int -------------------------------------------------------------------------------------------------------------- OFPST_FLOW reply (OF1.5) (xid=0x2): cookie=0x0, duration=109.931s, table=0, n_packets=0, n_bytes=0, idle_age=109, priority=0 actions=NORMAL IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 342K packets, 364M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 333K packets, 69M bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 190K packets, 74M bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 189K packets, 74M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 186K packets, 43M bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 186K packets, 43M bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT sudo ebtables -t broute -L -------------------------- Bridge table: broute Bridge chain: BROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running