File System Summary =================== WARN: Device /dev/loop0 (/snap/lxd/19647) is 100% full, might be an issue WARN: Device /dev/loop1 (/snap/core18/1997) is 100% full, might be an issue WARN: Device /dev/loop2 (/snap/snapd/11588) is 100% full, might be an issue Filesystem Size Used Avail Use% Mounted on udev 5.9G 0 5.9G 0% /dev tmpfs 1.2G 1.2M 1.2G 1% /run /dev/sda1 39G 5.2G 34G 14% / tmpfs 5.9G 0 5.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 5.9G 0 5.9G 0% /sys/fs/cgroup /dev/loop0 71M 71M 0 100% /snap/lxd/19647 /dev/loop1 56M 56M 0 100% /snap/core18/1997 /dev/loop2 33M 33M 0 100% /snap/snapd/11588 /dev/sda15 105M 7.8M 97M 8% /boot/efi tmpfs 1.2G 0 1.2G 0% /run/user/1000 tmpfs 512M 0 512M 0% /opt/stack/data/etcd Process Listing =============== ps axo user,ppid,pid,pcpu,pmem,vsz,rss,tty,stat,start,time,args --------------------------------------------------------------- USER PPID PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 0 1 2.0 0.1 168976 13148 ? Ss 18:18:48 00:00:32 /lib/systemd/systemd --system --deserialize 27 root 0 2 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [kthreadd] root 2 3 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [rcu_gp] root 2 4 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [rcu_par_gp] root 2 6 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [kworker/0:0H-kblockd] root 2 8 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [mm_percpu_wq] root 2 9 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [ksoftirqd/0] root 2 10 0.0 0.0 0 0 ? I 18:18:48 00:00:01 [rcu_sched] root 2 11 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [migration/0] root 2 12 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [idle_inject/0] root 2 14 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [cpuhp/0] root 2 15 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [cpuhp/1] root 2 16 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [idle_inject/1] root 2 17 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [migration/1] root 2 18 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [ksoftirqd/1] root 2 20 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [kworker/1:0H-kblockd] root 2 21 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [cpuhp/2] root 2 22 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [idle_inject/2] root 2 23 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [migration/2] root 2 24 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [ksoftirqd/2] root 2 26 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [kworker/2:0H-kblockd] root 2 27 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [cpuhp/3] root 2 28 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [idle_inject/3] root 2 29 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [migration/3] root 2 30 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [ksoftirqd/3] root 2 32 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [kworker/3:0H-kblockd] root 2 33 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [kdevtmpfs] root 2 34 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [netns] root 2 35 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [rcu_tasks_kthre] root 2 36 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [kauditd] root 2 40 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [khungtaskd] root 2 41 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [oom_reaper] root 2 42 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [writeback] root 2 43 0.0 0.0 0 0 ? S 18:18:48 00:00:00 [kcompactd0] root 2 44 0.0 0.0 0 0 ? SN 18:18:48 00:00:00 [ksmd] root 2 45 0.0 0.0 0 0 ? SN 18:18:48 00:00:00 [khugepaged] root 2 91 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [kintegrityd] root 2 92 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [kblockd] root 2 93 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [blkcg_punt_bio] root 2 94 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [tpm_dev_wq] root 2 95 0.0 0.0 0 0 ? I< 18:18:48 00:00:00 [ata_sff] root 2 96 0.0 0.0 0 0 ? I< 18:18:49 00:00:00 [md] root 2 97 0.0 0.0 0 0 ? I< 18:18:49 00:00:00 [edac-poller] root 2 98 0.0 0.0 0 0 ? I< 18:18:49 00:00:00 [devfreq_wq] root 2 99 0.0 0.0 0 0 ? S 18:18:49 00:00:00 [watchdogd] root 2 100 0.0 0.0 0 0 ? I 18:18:49 00:00:00 [kworker/3:1-rcu_par_gp] root 2 101 0.0 0.0 0 0 ? I 18:18:49 00:00:01 [kworker/u256:1-events_power_efficient] root 2 103 0.0 0.0 0 0 ? S 18:18:49 00:00:00 [kswapd0] root 2 104 0.0 0.0 0 0 ? S 18:18:49 00:00:00 [ecryptfs-kthrea] root 2 106 0.0 0.0 0 0 ? I< 18:18:49 00:00:00 [kthrotld] root 2 107 0.0 0.0 0 0 ? I< 18:18:49 00:00:00 [acpi_thermal_pm] root 2 108 0.0 0.0 0 0 ? S 18:18:49 00:00:00 [scsi_eh_0] root 2 109 0.0 0.0 0 0 ? I< 18:18:49 00:00:00 [scsi_tmf_0] root 2 110 0.0 0.0 0 0 ? S 18:18:49 00:00:00 [scsi_eh_1] root 2 111 0.0 0.0 0 0 ? I< 18:18:49 00:00:00 [scsi_tmf_1] root 2 113 0.0 0.0 0 0 ? I< 18:18:49 00:00:00 [vfio-irqfd-clea] root 2 114 0.0 0.0 0 0 ? I 18:18:49 00:00:00 [kworker/2:1-events] root 2 116 0.0 0.0 0 0 ? I< 18:18:50 00:00:00 [ipv6_addrconf] root 2 126 0.0 0.0 0 0 ? I< 18:18:50 00:00:00 [kstrp] root 2 130 0.0 0.0 0 0 ? I< 18:18:50 00:00:00 [kworker/u257:0] root 2 143 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [charger_manager] root 2 180 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [hv_vmbus_con] root 2 181 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [hv_pri_chan] root 2 182 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [hv_sub_chan] root 2 184 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [kworker/3:1H-kblockd] root 2 185 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [cryptd] root 2 233 0.0 0.0 0 0 ? S 18:18:51 00:00:00 [scsi_eh_2] root 2 235 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [scsi_tmf_2] root 2 236 0.0 0.0 0 0 ? S 18:18:51 00:00:00 [scsi_eh_3] root 2 237 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [scsi_tmf_3] root 2 238 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [storvsc_error_w] root 2 239 0.0 0.0 0 0 ? I< 18:18:51 00:00:00 [storvsc_error_w] root 2 272 0.0 0.0 0 0 ? I< 18:18:53 00:00:00 [raid5wq] root 2 298 0.0 0.0 0 0 ? I< 18:18:53 00:00:00 [kworker/2:1H-kblockd] root 2 313 0.0 0.0 0 0 ? S 18:18:53 00:00:01 [jbd2/sda1-8] root 2 314 0.0 0.0 0 0 ? I< 18:18:53 00:00:00 [ext4-rsv-conver] root 2 315 0.0 0.0 0 0 ? I< 18:18:53 00:00:00 [kworker/1:1H-kblockd] root 2 350 0.0 0.0 0 0 ? I< 18:18:54 00:00:00 [kworker/0:1H-kblockd] root 1 420 0.0 0.0 19360 5680 ? Ss 18:18:55 00:00:01 /lib/systemd/systemd-udevd root 2 451 0.0 0.0 0 0 ? S 18:18:56 00:00:00 [hv_balloon] root 2 548 0.0 0.0 0 0 ? I< 18:18:56 00:00:00 [kaluad] root 2 549 0.0 0.0 0 0 ? I< 18:18:56 00:00:00 [kmpath_rdacd] root 2 550 0.0 0.0 0 0 ? I< 18:18:56 00:00:00 [kmpathd] root 2 551 0.0 0.0 0 0 ? I< 18:18:56 00:00:00 [kmpath_handlerd] root 1 552 0.0 0.1 280136 17940 ? SLsl 18:18:56 00:00:00 /sbin/multipathd -d -s root 2 561 0.0 0.0 0 0 ? S< 18:18:56 00:00:00 [loop0] root 2 564 0.0 0.0 0 0 ? S< 18:18:56 00:00:00 [loop1] root 2 567 0.0 0.0 0 0 ? S< 18:18:56 00:00:00 [loop2] root 1 777 0.0 0.0 241136 9500 ? Ssl 18:19:06 00:00:00 /usr/lib/accountsservice/accounts-daemon root 1 780 0.0 0.0 8536 2828 ? Ss 18:19:06 00:00:00 /usr/sbin/cron -f message+ 1 782 0.2 0.0 7732 4980 ? Ss 18:19:06 00:00:03 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 1 795 0.0 0.0 81828 3828 ? Ssl 18:19:06 00:00:00 /usr/sbin/irqbalance --foreground root 1 797 0.0 0.1 29264 18132 ? Ss 18:19:06 00:00:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers root 1 807 0.1 0.2 1370360 33732 ? Ssl 18:19:06 00:00:02 /usr/lib/snapd/snapd root 1 808 0.1 0.0 16780 7868 ? Ss 18:19:06 00:00:01 /lib/systemd/systemd-logind daemon 1 810 0.0 0.0 3792 2128 ? Ss 18:19:06 00:00:00 /usr/sbin/atd -f root 1 842 0.0 0.0 7352 2340 ttyS0 Ss+ 18:19:06 00:00:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220 root 1 872 0.0 0.0 5828 1780 tty1 Ss+ 18:19:06 00:00:00 /sbin/agetty -o -p -- \u --noclear tty1 linux root 1 878 0.0 0.1 108100 20820 ? Ssl 18:19:06 00:00:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal root 1 885 0.0 0.0 237748 10220 ? Ssl 18:19:06 00:00:00 /usr/lib/policykit-1/polkitd --no-debug root 1 1577 0.0 0.0 13792 9068 ? Ss 18:23:30 00:00:00 sshd: ubuntu [priv] ubuntu 1 1591 0.0 0.0 18492 9716 ? Ss 18:23:30 00:00:00 /lib/systemd/systemd --user ubuntu 1591 1593 0.0 0.0 169776 4540 ? S 18:23:30 00:00:00 (sd-pam) ubuntu 1577 1671 0.0 0.0 13924 6596 ? S 18:23:31 00:00:00 sshd: ubuntu@pts/0 root 2 2920 0.0 0.0 0 0 ? I 18:24:32 00:00:00 [kworker/u256:3-events_power_efficient] root 2 14588 0.0 0.0 0 0 ? I 18:34:05 00:00:00 [kworker/1:1-events] root 2 14590 0.0 0.0 0 0 ? I 18:34:05 00:00:00 [kworker/1:2-events] root 2 14606 0.0 0.0 0 0 ? I 18:34:43 00:00:00 [kworker/u256:0-events_power_efficient] ubuntu 1671 14844 0.0 0.0 2608 612 pts/0 Ss+ 18:35:43 00:00:00 /bin/sh -c /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1643394943.46-47210986267247/AnsiballZ_command.py && sleep 0 ubuntu 14844 14845 0.0 0.1 28120 18040 pts/0 S+ 18:35:43 00:00:00 /usr/bin/python3 /home/ubuntu/.ansible/tmp/ansible-tmp-1643394943.46-47210986267247/AnsiballZ_command.py ubuntu 14845 14847 0.0 0.0 2608 608 pts/0 S+ 18:35:43 00:00:00 /bin/sh -c # workaround get-pip breaking when setuptools installed # ref: https://github.com/pypa/pip/issues/10742 sudo -H -E pip3 uninstall setuptools -y || true ./unstack.sh > /dev/null 2>&1 ./stack.sh > /dev/null 2>&1 ubuntu 1591 14851 0.0 0.0 7108 4108 ? Ss 18:35:44 00:00:00 /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only root 2 16091 0.0 0.0 2488 588 ? S 18:35:46 00:00:00 bpfilter_umh root 2 16116 0.0 0.0 0 0 ? I 18:35:46 00:00:00 [kworker/0:0-memcg_kmem_cache] root 2 17219 0.0 0.0 0 0 ? I 18:35:48 00:00:00 [kworker/0:1-events] ubuntu 14847 17593 0.6 0.0 15056 10360 pts/0 S+ 18:35:50 00:00:03 bash ./stack.sh ubuntu 17593 19852 0.0 0.0 10636 3920 pts/0 S+ 18:35:53 00:00:00 bash ./stack.sh ubuntu 17593 19857 0.0 0.0 10636 3928 pts/0 S+ 18:35:53 00:00:00 bash ./stack.sh ubuntu 19852 19859 0.1 0.0 17384 11280 pts/0 S+ 18:35:53 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -v --no-timestamp -o /opt/stack/logs/stack.sh.log.2022-01-28-183554 ubuntu 19857 19864 0.0 0.0 17384 11184 pts/0 S+ 18:35:53 00:00:00 /usr/bin/python3.8 /home/ubuntu/devstack/tools/outfilter.py -o /opt/stack/logs/stack.sh.log.2022-01-28-183554.summary.2022-01-28-183554 root 1 21651 0.0 0.1 283808 15960 ? Ssl 18:35:56 00:00:00 /usr/lib/packagekit/packagekitd memcache 1 24697 0.0 0.0 409768 4012 ? Ssl 18:37:13 00:00:00 /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1 -P /var/run/memcached/memcached.pid root 1 24920 0.0 0.0 7744 2952 ? Ss 18:37:17 00:00:00 /usr/sbin/conntrackd -C /etc/conntrackd/conntrackd.conf root 1 25076 0.0 0.0 15304 8896 ? Ss 18:37:19 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock haproxy 25076 25077 0.0 0.0 236500 2988 ? Sl 18:37:19 00:00:00 /usr/sbin/haproxy -Ws -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -S /run/haproxy-master.sock root 2 26358 0.0 0.0 0 0 ? I 18:37:24 00:00:00 [kworker/3:0-rcu_gp] root 1 26586 0.0 0.0 12176 6864 ? Ss 18:37:29 00:00:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups pcp 1 27686 0.2 0.0 8356 4452 ? Ss 18:37:39 00:00:01 /usr/lib/pcp/bin/pmcd root 27686 27689 0.0 0.0 7736 4008 ? S 18:37:39 00:00:00 /var/lib/pcp/pmdas/root/pmdaroot root 27689 27690 0.0 0.0 8316 5056 ? S 18:37:39 00:00:00 /var/lib/pcp/pmdas/proc/pmdaproc -d 3 root 27689 27691 0.0 0.0 7212 1636 ? S 18:37:39 00:00:00 /var/lib/pcp/pmdas/xfs/pmdaxfs -d 11 root 27689 27692 0.0 0.0 8264 5092 ? S 18:37:39 00:00:00 /var/lib/pcp/pmdas/linux/pmdalinux root 27689 27693 0.0 0.0 7268 3648 ? S 18:37:39 00:00:00 /var/lib/pcp/pmdas/kvm/pmdakvm -d 95 root 2 34014 0.0 0.0 0 0 ? I 18:37:48 00:00:00 [kworker/2:0-events] root 2 34037 0.0 0.0 0 0 ? I 18:37:48 00:00:00 [kworker/2:3-rcu_par_gp] pcp 1 38660 0.2 0.0 8416 5252 ? S 18:37:54 00:00:00 /usr/lib/pcp/bin/pmlogger -P -r -T24h10m -c config.default -v 100mb -m pmlogger_check 20220128.18.37 systemd+ 1 38900 0.0 0.0 34940 7752 ? Ss 18:37:56 00:00:00 /lib/systemd/systemd-networkd systemd+ 1 38916 0.0 0.0 23900 12124 ? Ss 18:37:56 00:00:00 /lib/systemd/systemd-resolved systemd+ 1 39043 0.0 0.0 90232 6120 ? Ssl 18:37:57 00:00:00 /lib/systemd/systemd-timesyncd syslog 1 43756 0.0 0.0 224348 4424 ? Ssl 18:38:11 00:00:00 /usr/sbin/rsyslogd -n -iNONE root 1 53177 0.0 0.0 37084 10380 ? S mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:da:39:22 brd ff:ff:ff:ff:ff:ff inet 10.222.0.25/22 brd 10.222.3.255 scope global dynamic eth0 valid_lft 85954sec preferred_lft 85954sec inet6 fe80::f816:3eff:feda:3922/64 scope link valid_lft forever preferred_lft forever 3: eth1: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:3e:6c:f2 brd ff:ff:ff:ff:ff:ff inet 192.168.0.29/22 brd 192.168.3.255 scope global dynamic eth1 valid_lft 85954sec preferred_lft 85954sec inet6 fe80::f816:3eff:fe3e:6cf2/64 scope link valid_lft forever preferred_lft forever ip route -------- default via 10.222.0.1 dev eth0 proto dhcp src 10.222.0.25 metric 100 10.222.0.0/22 dev eth0 proto kernel scope link src 10.222.0.25 10.222.0.0/22 dev eth1 proto dhcp scope link src 192.168.0.29 metric 100 169.254.169.254 via 192.168.0.12 dev eth1 proto dhcp src 192.168.0.29 metric 100 169.254.169.254 via 10.222.0.12 dev eth0 proto dhcp src 10.222.0.25 metric 100 192.168.0.0/22 dev eth1 proto kernel scope link src 192.168.0.29 192.168.0.0/22 dev eth0 proto dhcp scope link src 10.222.0.25 metric 100 ip -6 route ----------- ::1 dev lo proto kernel metric 256 pref medium fe80::/64 dev eth1 proto kernel metric 256 pref medium fe80::/64 dev eth0 proto kernel metric 256 pref medium ip netns -------- Open vSwitch Dump ================= sudo ovs-vsctl show ------------------- be6b0d4e-34fb-44da-adb4-9c7eb5ceca66 ovs_version: "2.13.3" IP Tables Dump ============== sudo iptables --line-numbers -L -nv -t filter --------------------------------------------- Chain INPUT (policy ACCEPT 93808 packets, 339M bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 43404 packets, 2832K bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t nat ------------------------------------------ Chain PREROUTING (policy ACCEPT 1164 packets, 212K bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 650 packets, 178K bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 526 packets, 41540 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 526 packets, 41540 bytes) num pkts bytes target prot opt in out source destination sudo iptables --line-numbers -L -nv -t mangle --------------------------------------------- Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination Chain POSTROUTING (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination EB Tables Dump ============== sudo ebtables -t filter -L -------------------------- Bridge table: filter Bridge chain: INPUT, entries: 0, policy: ACCEPT Bridge chain: FORWARD, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT sudo ebtables -t nat -L ----------------------- Bridge table: nat Bridge chain: PREROUTING, entries: 0, policy: ACCEPT Bridge chain: OUTPUT, entries: 0, policy: ACCEPT Bridge chain: POSTROUTING, entries: 0, policy: ACCEPT Compute consoles ================ nova-compute Guru Meditation Report =================================== Skipping as nova-compute does not appear to be running neutron-dhcp-agent Guru Meditation Report ========================================= Skipping as neutron-dhcp-agent does not appear to be running neutron-l3-agent Guru Meditation Report ======================================= Skipping as neutron-l3-agent does not appear to be running neutron-linuxbridge-agent Guru Meditation Report ================================================ Skipping as neutron-linuxbridge-agent does not appear to be running neutron-metadata-agent Guru Meditation Report ============================================= Skipping as neutron-metadata-agent does not appear to be running neutron-openvswitch-agent Guru Meditation Report ================================================ Skipping as neutron-openvswitch-agent does not appear to be running cinder-volume Guru Meditation Report ==================================== Skipping as cinder-volume does not appear to be running