File System Summary =================== Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 868K 1.2G 1% /run /dev/sda1 39G 4.2G 35G 11% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/sda15 105M 3.6M 101M 4% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 tmpfs 512M 123M 390M 24% /opt/stack/data/etcd /dev/loop0 6.0G 36M 6.0G 1% /opt/stack/data/swift/drives/sdb1 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 0.4 0.0 225568 9472 ? Ss 21:00:39 00:00:19 /lib/systemd/systemd --system --deserialize 35 root 0 2 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [kthreadd] root 2 4 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [kworker/0:0H] root 2 6 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [mm_percpu_wq] root 2 7 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [ksoftirqd/0] root 2 8 0.1 0.0 0 0 ? I 21:00:39 00:00:04 [rcu_sched] root 2 9 0.0 0.0 0 0 ? I 21:00:39 00:00:00 [rcu_bh] root 2 10 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [migration/0] root 2 11 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [watchdog/0] root 2 12 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [cpuhp/0] root 2 13 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [cpuhp/1] root 2 14 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [watchdog/1] root 2 15 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [migration/1] root 2 16 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [ksoftirqd/1] root 2 18 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [kworker/1:0H] root 2 19 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [cpuhp/2] root 2 20 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [watchdog/2] root 2 21 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [migration/2] root 2 22 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [ksoftirqd/2] root 2 24 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [kworker/2:0H] root 2 25 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [cpuhp/3] root 2 26 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [watchdog/3] root 2 27 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [migration/3] root 2 28 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [ksoftirqd/3] root 2 30 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [kworker/3:0H] root 2 31 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [kdevtmpfs] root 2 32 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [netns] root 2 33 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [rcu_tasks_kthre] root 2 34 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [kauditd] root 2 38 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [khungtaskd] root 2 39 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [oom_reaper] root 2 40 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [writeback] root 2 41 0.0 0.0 0 0 ? S 21:00:39 00:00:00 [kcompactd0] root 2 42 0.0 0.0 0 0 ? SN 21:00:39 00:00:00 [ksmd] root 2 43 0.0 0.0 0 0 ? SN 21:00:39 00:00:00 [khugepaged] root 2 44 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [crypto] root 2 45 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [kintegrityd] root 2 46 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [kblockd] root 2 47 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [ata_sff] root 2 48 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [md] root 2 49 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [edac-poller] root 2 50 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [devfreq_wq] root 2 51 0.0 0.0 0 0 ? I< 21:00:39 00:00:00 [watchdogd] root 2 54 0.0 0.0 0 0 ? S 21:00:40 00:00:00 [kswapd0] root 2 55 0.0 0.0 0 0 ? I< 21:00:40 00:00:00 [kworker/u257:0] root 2 56 0.0 0.0 0 0 ? S 21:00:40 00:00:00 [ecryptfs-kthrea] root 2 98 0.0 0.0 0 0 ? I< 21:00:40 00:00:00 [kthrotld] root 2 99 0.0 0.0 0 0 ? I< 21:00:40 00:00:00 [acpi_thermal_pm] root 2 100 0.0 0.0 0 0 ? S 21:00:40 00:00:00 [scsi_eh_0] root 2 101 0.0 0.0 0 0 ? I< 21:00:40 00:00:00 [scsi_tmf_0] root 2 102 0.0 0.0 0 0 ? S 21:00:40 00:00:00 [scsi_eh_1] root 2 103 0.0 0.0 0 0 ? I< 21:00:40 00:00:00 [scsi_tmf_1] root 2 112 0.0 0.0 0 0 ? I< 21:00:41 00:00:00 [ipv6_addrconf] root 2 121 0.0 0.0 0 0 ? I< 21:00:41 00:00:00 [kstrp] root 2 138 0.0 0.0 0 0 ? I< 21:00:41 00:00:00 [charger_manager] root 2 196 0.0 0.0 0 0 ? I< 21:00:42 00:00:00 [hv_vmbus_con] root 2 197 0.0 0.0 0 0 ? I< 21:00:42 00:00:00 [hv_pri_chan] root 2 198 0.0 0.0 0 0 ? I< 21:00:42 00:00:00 [hv_sub_chan] root 2 231 0.0 0.0 0 0 ? S 21:00:42 00:00:00 [scsi_eh_2] root 2 232 0.0 0.0 0 0 ? I< 21:00:42 00:00:00 [scsi_tmf_2] root 2 234 0.0 0.0 0 0 ? I< 21:00:42 00:00:00 [storvsc_error_w] root 2 235 0.0 0.0 0 0 ? S 21:00:42 00:00:00 [scsi_eh_3] root 2 236 0.0 0.0 0 0 ? I< 21:00:42 00:00:00 [scsi_tmf_3] root 2 237 0.0 0.0 0 0 ? I< 21:00:42 00:00:00 [storvsc_error_w] root 2 239 0.0 0.0 0 0 ? I< 21:00:42 00:00:01 [kworker/0:1H] root 2 312 0.0 0.0 0 0 ? I< 21:00:44 00:00:00 [raid5wq] root 2 345 0.0 0.0 0 0 ? I< 21:00:44 00:00:00 [kworker/3:1H] root 2 361 0.1 0.0 0 0 ? S 21:00:45 00:00:06 [jbd2/sda1-8] root 2 362 0.0 0.0 0 0 ? I< 21:00:45 00:00:00 [ext4-rsv-conver] root 2 411 0.0 0.0 0 0 ? I< 21:00:45 00:00:00 [kworker/1:1H] root 2 430 0.0 0.0 0 0 ? I< 21:00:46 00:00:00 [kworker/2:1H] root 2 433 0.0 0.0 0 0 ? I< 21:00:46 00:00:00 [iscsi_eh] root 2 443 0.0 0.0 0 0 ? I< 21:00:46 00:00:00 [ib-comp-wq] root 2 444 0.0 0.0 0 0 ? I< 21:00:46 00:00:00 [ib_mcast] root 2 445 0.0 0.0 0 0 ? I< 21:00:46 00:00:00 [ib_nl_sa_wq] root 2 452 0.0 0.0 0 0 ? I< 21:00:46 00:00:00 [rdma_cm] root 1 456 0.0 0.0 44420 5460 ? Ss 21:00:46 00:00:02 /lib/systemd/systemd-udevd root 2 490 0.0 0.0 0 0 ? S 21:00:47 00:00:00 [hv_balloon] root 1 1032 0.0 0.0 70580 5968 ? Ss 21:00:57 00:00:02 /lib/systemd/systemd-logind root 1 1058 0.0 0.0 110412 2028 ? Ssl 21:00:57 00:00:00 /usr/sbin/irqbalance --foreground root 1 1059 0.0 0.0 161076 1612 ? Ssl 21:00:57 00:00:00 /usr/bin/lxcfs /var/lib/lxcfs/ root 1 1083 0.0 0.1 170880 17396 ? Ssl 21:00:57 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers root 1 1095 0.0 0.0 31748 3228 ? Ss 21:00:57 00:00:00 /usr/sbin/cron -f root 1 1098 0.0 0.0 288092 7020 ? Ssl 21:00:57 00:00:00 /usr/lib/accountsservice/accounts-daemon message+ 1 1114 0.1 0.0 50296 4704 ? Ss 21:00:57 00:00:04 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 1172 0.0 0.1 187720 20604 ? Ssl 21:00:57 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal daemon 1 1175 0.0 0.0 28332 2400 ? Ss 21:00:57 00:00:00 /usr/sbin/atd -f root 1 1242 0.0 0.0 291480 7432 ? Ssl 21:00:58 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 1268 0.0 0.0 16412 2348 ttyS0 Ss+ 21:00:58 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 1298 0.0 0.0 14888 1976 tty1 Ss+ 21:00:58 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 1433 0.0 0.0 72296 5624 ? Ss 21:00:59 00:00:00 /usr/sbin/sshd -D root 1433 1734 0.0 0.0 107984 7216 ? Ss 21:07:05 00:00:00 sshd: ubuntu [priv] ubuntu 1 1736 0.0 0.0 76764 7632 ? Ss 21:07:05 00:00:00 /lib/systemd/systemd --user ubuntu 1736 1737 0.0 0.0 193716 2484 ? S 21:07:05 00:00:00 (sd-pam) ubuntu 1734 1812 0.0 0.0 108404 5208 ? S 21:07:06 00:00:00 sshd: ubuntu@pts/0 root 1 2327 0.0 0.0 33608 4540 ? S /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 root 2 122078 0.0 0.0 0 0 ? I 21:54:35 00:00:00 [kworker/0:2] root 2 123392 0.0 0.0 0 0 ? I 21:54:41 00:00:00 [kworker/u256:4] ubuntu 119646 123558 0.6 0.0 19316 9556 pts/0 S+ 21:54:41 00:00:05 bash ./stack.sh ubuntu 123558 125767 0.0 0.0 15212 3596 pts/0 S+ 21:54:45 00:00:00 bash ./stack.sh ubuntu 123558 125772 0.0 0.0 15212 3596 pts/0 S+ 21:54:45 00:00:00 bash ./stack.sh ubuntu 125767 125774 0.2 0.0 29740 10824 pts/0 S+ 21:54:45 00:00:02 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2020-10-29-215445 ubuntu 125772 125778 0.0 0.0 29608 10912 pts/0 S+ 21:54:45 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2020-10-29-215445.summary.2020-10-29-215445 root 1 130725 0.3 0.5 167556 63620 ? S mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:d7:a0:a4 brd ff:ff:ff:ff:ff:ff inet 10.222.0.77/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 83308sec preferred_lft 83308sec inet6 fe80::f816:3eff:fed7:a0a4/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000 link/ether fa:16:3e:89:20:16 brd ff:ff:ff:ff:ff:ff inet6 fe80::f816:3eff:fe89:2016/64 scope link valid_lft forever preferred_lft forever 10: ovs-system: mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether ce:09:10:43:11:3a brd ff:ff:ff:ff:ff:ff 11: br-int: mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether 86:6c:6b:dd:8c:49 brd ff:ff:ff:ff:ff:ff 12: br-data: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether f2:15:88:71:af:46 brd ff:ff:ff:ff:ff:ff inet 192.168.0.74/22 brd 192.168.3.255 scope global br-data valid_lft forever preferred_lft forever inet6 fe80::f015:88ff:fe71:af46/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.77 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.77 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.77 metric 100 192.168.0.0/22 dev br-data proto kernel scope link src 192.168.0.74 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.77 metric 100 ip -6 route ----------- fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium fe80::/64 dev br-data proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- 1e088843-9ce1-419c-9856-f2eb03e82afc Manager "ptcp:6640:127.0.0.1" Bridge br-data Port "eth1" Interface "eth1" Port br-data Interface br-data type: internal Bridge br-int Port br-int Interface br-int type: internal ovs_version: "2.12.1" sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-data --------------------------------------------------------------------------------------------------------- OFPT_FEATURES_REPLY (OF1.5) (xid=0x2): dpid:0000f2158871af46 n_tables:254, n_buffers:0 capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES OFPST_PORT_DESC reply (OF1.5) (xid=0x3): 1(eth1): addr:fa:16:3e:89:20:16 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-data): addr:f2:15:88:71:af:46 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max OFPT_GET_CONFIG_REPLY (OF1.5) (xid=0x5): frags=normal miss_send_len=0 sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-int -------------------------------------------------------------------------------------------------------- OFPT_FEATURES_REPLY (OF1.5) (xid=0x2): dpid:0000866c6bdd8c49 n_tables:254, n_buffers:0 capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES OFPST_PORT_DESC reply (OF1.5) (xid=0x3): LOCAL(br-int): addr:86:6c:6b:dd:8c:49 config: PORT_DOWN state: LINK_DOWN speed: 0 Mbps now, 0 Mbps max OFPT_GET_CONFIG_REPLY (OF1.5) (xid=0x5): frags=normal miss_send_len=0 sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-data -------------------------------------------------------------------------------------------------------------------- OFPST_PORT_DESC reply (OF1.5) (xid=0x2): 1(eth1): addr:fa:16:3e:89:20:16 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-data): addr:f2:15:88:71:af:46 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-int ------------------------------------------------------------------------------------------------------------------- OFPST_PORT_DESC reply (OF1.5) (xid=0x2): LOCAL(br-int): addr:86:6c:6b:dd:8c:49 config: PORT_DOWN state: LINK_DOWN speed: 0 Mbps now, 0 Mbps max sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-data --------------------------------------------------------------------------------------------------------------- OFPST_PORT reply (OF1.5) (xid=0x2): 2 ports port LOCAL: rx pkts=221, bytes=30924, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=14, bytes=992, drop=0, errs=0, coll=0 duration=121.285s port 1: rx pkts=23415, bytes=2768336, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=76, bytes=6296, drop=0, errs=0, coll=0 duration=117.620s sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-int -------------------------------------------------------------------------------------------------------------- OFPST_PORT reply (OF1.5) (xid=0x2): 1 ports port LOCAL: rx pkts=0, bytes=0, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=0, bytes=0, drop=0, errs=0, coll=0 duration=121.512s sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-data --------------------------------------------------------------------------------------------------------------- OFPST_FLOW reply (OF1.5) (xid=0x2): cookie=0x0, duration=121.308s, table=0, n_packets=235, n_bytes=35010, idle_age=0, priority=0 actions=NORMAL sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-int -------------------------------------------------------------------------------------------------------------- OFPST_FLOW reply (OF1.5) (xid=0x2): cookie=0x0, duration=121.534s, table=0, n_packets=0, n_bytes=0, idle_age=121, priority=0 actions=NORMAL IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 345K packets, 364M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 334K packets, 69M bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 196K packets, 74M bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 194K packets, 74M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 191K packets, 44M bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 191K packets, 44M bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT sudo ebtables -t broute -L -------------------------- Bridge table: broute Bridge chain: BROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running