File System Summary =================== Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 868K 1.2G 1% /run /dev/sda1 39G 4.2G 35G 11% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/sda15 105M 3.6M 101M 4% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 tmpfs 512M 123M 390M 24% /opt/stack/data/etcd /dev/loop0 6.0G 36M 6.0G 1% /opt/stack/data/swift/drives/sdb1 Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 0.4 0.0 225564 9544 ? Ss 21:02:16 00:00:20 /lib/systemd/systemd --system --deserialize 35 root 0 2 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [kthreadd] root 2 4 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [kworker/0:0H] root 2 6 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [mm_percpu_wq] root 2 7 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [ksoftirqd/0] root 2 8 0.1 0.0 0 0 ? I 21:02:16 00:00:04 [rcu_sched] root 2 9 0.0 0.0 0 0 ? I 21:02:16 00:00:00 [rcu_bh] root 2 10 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [migration/0] root 2 11 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [watchdog/0] root 2 12 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [cpuhp/0] root 2 13 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [cpuhp/1] root 2 14 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [watchdog/1] root 2 15 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [migration/1] root 2 16 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [ksoftirqd/1] root 2 18 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [kworker/1:0H] root 2 19 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [cpuhp/2] root 2 20 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [watchdog/2] root 2 21 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [migration/2] root 2 22 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [ksoftirqd/2] root 2 24 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [kworker/2:0H] root 2 25 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [cpuhp/3] root 2 26 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [watchdog/3] root 2 27 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [migration/3] root 2 28 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [ksoftirqd/3] root 2 30 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [kworker/3:0H] root 2 31 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [kdevtmpfs] root 2 32 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [netns] root 2 33 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [rcu_tasks_kthre] root 2 34 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [kauditd] root 2 38 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [khungtaskd] root 2 39 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [oom_reaper] root 2 40 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [writeback] root 2 41 0.0 0.0 0 0 ? S 21:02:16 00:00:00 [kcompactd0] root 2 42 0.0 0.0 0 0 ? SN 21:02:16 00:00:00 [ksmd] root 2 43 0.0 0.0 0 0 ? SN 21:02:16 00:00:00 [khugepaged] root 2 44 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [crypto] root 2 45 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [kintegrityd] root 2 46 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [kblockd] root 2 47 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [ata_sff] root 2 48 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [md] root 2 49 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [edac-poller] root 2 50 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [devfreq_wq] root 2 51 0.0 0.0 0 0 ? I< 21:02:16 00:00:00 [watchdogd] root 2 54 0.0 0.0 0 0 ? S 21:02:17 00:00:00 [kswapd0] root 2 55 0.0 0.0 0 0 ? I< 21:02:17 00:00:00 [kworker/u257:0] root 2 56 0.0 0.0 0 0 ? S 21:02:17 00:00:00 [ecryptfs-kthrea] root 2 99 0.0 0.0 0 0 ? I< 21:02:17 00:00:00 [kthrotld] root 2 100 0.0 0.0 0 0 ? I< 21:02:17 00:00:00 [acpi_thermal_pm] root 2 101 0.0 0.0 0 0 ? S 21:02:17 00:00:00 [scsi_eh_0] root 2 102 0.0 0.0 0 0 ? I< 21:02:17 00:00:00 [scsi_tmf_0] root 2 103 0.0 0.0 0 0 ? S 21:02:17 00:00:00 [scsi_eh_1] root 2 104 0.0 0.0 0 0 ? I< 21:02:17 00:00:00 [scsi_tmf_1] root 2 111 0.0 0.0 0 0 ? I< 21:02:18 00:00:00 [ipv6_addrconf] root 2 120 0.0 0.0 0 0 ? I< 21:02:18 00:00:00 [kstrp] root 2 137 0.0 0.0 0 0 ? I< 21:02:19 00:00:00 [charger_manager] root 2 194 0.0 0.0 0 0 ? I< 21:02:19 00:00:00 [hv_vmbus_con] root 2 195 0.0 0.0 0 0 ? I< 21:02:19 00:00:00 [hv_pri_chan] root 2 196 0.0 0.0 0 0 ? I< 21:02:19 00:00:00 [hv_sub_chan] root 2 229 0.0 0.0 0 0 ? S 21:02:19 00:00:00 [scsi_eh_2] root 2 230 0.0 0.0 0 0 ? I< 21:02:19 00:00:00 [scsi_tmf_2] root 2 231 0.0 0.0 0 0 ? I< 21:02:19 00:00:00 [storvsc_error_w] root 2 232 0.0 0.0 0 0 ? S 21:02:20 00:00:00 [scsi_eh_3] root 2 233 0.0 0.0 0 0 ? I< 21:02:20 00:00:00 [scsi_tmf_3] root 2 234 0.0 0.0 0 0 ? I< 21:02:20 00:00:00 [storvsc_error_w] root 2 236 0.0 0.0 0 0 ? I< 21:02:20 00:00:01 [kworker/0:1H] root 2 238 0.0 0.0 0 0 ? I< 21:02:20 00:00:00 [kworker/3:1H] root 2 312 0.0 0.0 0 0 ? I< 21:02:22 00:00:00 [raid5wq] root 2 359 0.1 0.0 0 0 ? S 21:02:22 00:00:06 [jbd2/sda1-8] root 2 360 0.0 0.0 0 0 ? I< 21:02:22 00:00:00 [ext4-rsv-conver] root 2 375 0.0 0.0 0 0 ? I< 21:02:22 00:00:00 [kworker/1:1H] root 2 432 0.0 0.0 0 0 ? I< 21:02:24 00:00:00 [iscsi_eh] root 2 434 0.0 0.0 0 0 ? I< 21:02:24 00:00:00 [kworker/2:1H] root 1 442 0.0 0.0 44428 5576 ? Ss 21:02:24 00:00:02 /lib/systemd/systemd-udevd root 2 445 0.0 0.0 0 0 ? I< 21:02:24 00:00:00 [ib-comp-wq] root 2 446 0.0 0.0 0 0 ? I< 21:02:24 00:00:00 [ib_mcast] root 2 447 0.0 0.0 0 0 ? I< 21:02:24 00:00:00 [ib_nl_sa_wq] root 2 463 0.0 0.0 0 0 ? I< 21:02:24 00:00:00 [rdma_cm] root 2 487 0.0 0.0 0 0 ? S 21:02:25 00:00:00 [hv_balloon] root 1 1039 0.0 0.0 110412 2064 ? Ssl 21:02:35 00:00:00 /usr/sbin/irqbalance --foreground root 1 1046 0.0 0.0 70580 5896 ? Ss 21:02:35 00:00:02 /lib/systemd/systemd-logind daemon 1 1052 0.0 0.0 28332 2288 ? Ss 21:02:35 00:00:00 /usr/sbin/atd -f root 1 1065 0.0 0.0 161076 1548 ? Ssl 21:02:35 00:00:00 /usr/bin/lxcfs /var/lib/lxcfs/ root 1 1073 0.0 0.0 31748 3152 ? Ss 21:02:35 00:00:00 /usr/sbin/cron -f root 1 1083 0.0 0.1 170880 17540 ? Ssl 21:02:35 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers message+ 1 1111 0.0 0.0 50304 4680 ? Ss 21:02:35 00:00:03 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 1138 0.0 0.1 187720 20488 ? Ssl 21:02:35 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 1148 0.0 0.0 288088 7056 ? Ssl 21:02:36 00:00:00 /usr/lib/accountsservice/accounts-daemon root 1 1235 0.0 0.0 16412 2372 ttyS0 Ss+ 21:02:36 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 1286 0.0 0.0 291456 7376 ? Ssl 21:02:36 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 1288 0.0 0.0 14888 1916 tty1 Ss+ 21:02:36 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 1456 0.0 0.0 72296 5560 ? Ss 21:02:38 00:00:00 /usr/sbin/sshd -D root 1456 1746 0.0 0.0 107984 7040 ? Ss 21:08:50 00:00:00 sshd: ubuntu [priv] ubuntu 1 1748 0.0 0.0 76752 7764 ? Ss 21:08:51 00:00:00 /lib/systemd/systemd --user ubuntu 1748 1749 0.0 0.0 259252 2448 ? S 21:08:51 00:00:00 (sd-pam) ubuntu 1746 1824 0.0 0.0 108400 5344 ? S 21:08:51 00:00:00 sshd: ubuntu@pts/0 root 1 2327 0.0 0.0 33608 4596 ? S /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 root 2 122079 0.0 0.0 0 0 ? I 21:55:44 00:00:00 [kworker/u256:2] root 2 122115 0.0 0.0 0 0 ? I 21:55:44 00:00:00 [kworker/2:7] root 2 122495 0.0 0.0 0 0 ? I 21:55:46 00:00:00 [kworker/0:1] root 2 123282 0.0 0.0 0 0 ? I 21:55:50 00:00:00 [kworker/u256:3] root 2 123339 0.0 0.0 0 0 ? I 21:55:50 00:00:00 [kworker/0:5] ubuntu 119645 123566 0.6 0.0 19316 9684 pts/0 S+ 21:55:51 00:00:05 bash ./stack.sh ubuntu 123566 125775 0.0 0.0 15212 3584 pts/0 S+ 21:55:54 00:00:00 bash ./stack.sh ubuntu 123566 125780 0.0 0.0 15212 3648 pts/0 S+ 21:55:54 00:00:00 bash ./stack.sh ubuntu 125775 125782 0.2 0.0 29740 10940 pts/0 S+ 21:55:54 00:00:02 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2020-10-29-215554 ubuntu 125780 125787 0.0 0.0 29608 10908 pts/0 S+ 21:55:54 00:00:00 /usr/bin/python3.6 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2020-10-29-215554.summary.2020-10-29-215554 root 1 130732 0.3 0.5 166664 62756 ? S mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:02:b5:58 brd ff:ff:ff:ff:ff:ff inet 10.222.0.70/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 83305sec preferred_lft 83305sec inet6 fe80::f816:3eff:fe02:b558/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000 link/ether fa:16:3e:a3:81:68 brd ff:ff:ff:ff:ff:ff inet6 fe80::f816:3eff:fea3:8168/64 scope link valid_lft forever preferred_lft forever 10: ovs-system: mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether 52:aa:75:01:4f:c8 brd ff:ff:ff:ff:ff:ff 11: br-int: mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether ae:95:b2:20:29:4a brd ff:ff:ff:ff:ff:ff 12: br-data: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether d2:1a:69:aa:cd:43 brd ff:ff:ff:ff:ff:ff inet 192.168.0.82/22 brd 192.168.3.255 scope global br-data valid_lft forever preferred_lft forever inet6 fe80::d01a:69ff:feaa:cd43/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.70 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.70 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.70 metric 100 192.168.0.0/22 dev br-data proto kernel scope link src 192.168.0.82 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.70 metric 100 ip -6 route ----------- fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium fe80::/64 dev br-data proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- 3eb53095-42cd-4bd1-b27b-665a1120a0e6 Manager "ptcp:6640:127.0.0.1" Bridge br-int Port br-int Interface br-int type: internal Bridge br-data Port br-data Interface br-data type: internal Port "eth1" Interface "eth1" ovs_version: "2.12.1" sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-data --------------------------------------------------------------------------------------------------------- OFPT_FEATURES_REPLY (OF1.5) (xid=0x2): dpid:0000d21a69aacd43 n_tables:254, n_buffers:0 capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES OFPST_PORT_DESC reply (OF1.5) (xid=0x3): 1(eth1): addr:fa:16:3e:a3:81:68 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-data): addr:d2:1a:69:aa:cd:43 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max OFPT_GET_CONFIG_REPLY (OF1.5) (xid=0x5): frags=normal miss_send_len=0 sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 show br-int -------------------------------------------------------------------------------------------------------- OFPT_FEATURES_REPLY (OF1.5) (xid=0x2): dpid:0000ae95b220294a n_tables:254, n_buffers:0 capabilities: FLOW_STATS TABLE_STATS PORT_STATS GROUP_STATS QUEUE_STATS BUNDLES OFPST_PORT_DESC reply (OF1.5) (xid=0x3): LOCAL(br-int): addr:ae:95:b2:20:29:4a config: PORT_DOWN state: LINK_DOWN speed: 0 Mbps now, 0 Mbps max OFPT_GET_CONFIG_REPLY (OF1.5) (xid=0x5): frags=normal miss_send_len=0 sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-data -------------------------------------------------------------------------------------------------------------------- OFPST_PORT_DESC reply (OF1.5) (xid=0x2): 1(eth1): addr:fa:16:3e:a3:81:68 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max LOCAL(br-data): addr:d2:1a:69:aa:cd:43 config: 0 state: LIVE speed: 0 Mbps now, 0 Mbps max sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports-desc br-int ------------------------------------------------------------------------------------------------------------------- OFPST_PORT_DESC reply (OF1.5) (xid=0x2): LOCAL(br-int): addr:ae:95:b2:20:29:4a config: PORT_DOWN state: LINK_DOWN speed: 0 Mbps now, 0 Mbps max sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-data --------------------------------------------------------------------------------------------------------------- OFPST_PORT reply (OF1.5) (xid=0x2): 2 ports port LOCAL: rx pkts=229, bytes=33253, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=13, bytes=922, drop=0, errs=0, coll=0 duration=122.751s port 1: rx pkts=23001, bytes=2737052, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=75, bytes=6226, drop=0, errs=0, coll=0 duration=119.017s sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-ports br-int -------------------------------------------------------------------------------------------------------------- OFPST_PORT reply (OF1.5) (xid=0x2): 1 ports port LOCAL: rx pkts=0, bytes=0, drop=0, errs=0, frame=0, over=0, crc=0 tx pkts=0, bytes=0, drop=0, errs=0, coll=0 duration=122.983s sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-data --------------------------------------------------------------------------------------------------------------- OFPST_FLOW reply (OF1.5) (xid=0x2): cookie=0x0, duration=122.773s, table=0, n_packets=247, n_bytes=37644, idle_age=0, priority=0 actions=NORMAL sudo ovs-ofctl --protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13,OpenFlow14,OpenFlow15 dump-flows br-int -------------------------------------------------------------------------------------------------------------- OFPST_FLOW reply (OF1.5) (xid=0x2): cookie=0x0, duration=123.006s, table=0, n_packets=0, n_bytes=0, idle_age=123, priority=0 actions=NORMAL IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 358K packets, 365M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 348K packets, 70M bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 196K packets, 74M bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 194K packets, 74M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 191K packets, 44M bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 191K packets, 44M bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT sudo ebtables -t broute -L -------------------------- Bridge table: broute Bridge chain: BROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running